-- Logs begin at Thu 2022-06-16 11:46:43 UTC, end at Thu 2022-06-16 12:43:44 UTC. -- Jun 16 12:12:09.924987 dv-cinder-846149-2-smb systemd[1]: Starting Devstack devstack@keystone.service... Jun 16 12:12:09.936310 dv-cinder-846149-2-smb devstack@keystone.service[80061]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jun 16 12:12:09.936310 dv-cinder-846149-2-smb devstack@keystone.service[80061]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Jun 16 12:12:09 2022] *** Jun 16 12:12:09.936310 dv-cinder-846149-2-smb devstack@keystone.service[80061]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 16 12:12:09.936310 dv-cinder-846149-2-smb devstack@keystone.service[80061]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 16 12:12:09.936310 dv-cinder-846149-2-smb devstack@keystone.service[80061]: nodename: dv-cinder-846149-2-smb Jun 16 12:12:09.936310 dv-cinder-846149-2-smb devstack@keystone.service[80061]: machine: x86_64 Jun 16 12:12:09.936310 dv-cinder-846149-2-smb devstack@keystone.service[80061]: clock source: unix Jun 16 12:12:09.936310 dv-cinder-846149-2-smb devstack@keystone.service[80061]: pcre jit disabled Jun 16 12:12:09.937806 dv-cinder-846149-2-smb devstack@keystone.service[80061]: detected number of CPU cores: 4 Jun 16 12:12:09.937806 dv-cinder-846149-2-smb devstack@keystone.service[80061]: current working directory: / Jun 16 12:12:09.937806 dv-cinder-846149-2-smb devstack@keystone.service[80061]: detected binary path: /usr/bin/uwsgi-core Jun 16 12:12:09.937806 dv-cinder-846149-2-smb devstack@keystone.service[80061]: your processes number limit is 47680 Jun 16 12:12:09.937806 dv-cinder-846149-2-smb devstack@keystone.service[80061]: your memory page size is 4096 bytes Jun 16 12:12:09.937806 dv-cinder-846149-2-smb devstack@keystone.service[80061]: detected max file descriptor number: 2048 Jun 16 12:12:09.937806 dv-cinder-846149-2-smb devstack@keystone.service[80061]: lock engine: pthread robust mutexes Jun 16 12:12:09.937806 dv-cinder-846149-2-smb devstack@keystone.service[80061]: thunder lock: enabled Jun 16 12:12:09.937806 dv-cinder-846149-2-smb devstack@keystone.service[80061]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jun 16 12:12:09.937806 dv-cinder-846149-2-smb devstack@keystone.service[80061]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 16 12:12:09.980109 dv-cinder-846149-2-smb devstack@keystone.service[80061]: Python main interpreter initialized at 0x5622f45f79c0 Jun 16 12:12:09.980109 dv-cinder-846149-2-smb devstack@keystone.service[80061]: python threads support enabled Jun 16 12:12:09.980109 dv-cinder-846149-2-smb devstack@keystone.service[80061]: your server socket listen backlog is limited to 100 connections Jun 16 12:12:09.980109 dv-cinder-846149-2-smb devstack@keystone.service[80061]: your mercy for graceful operations on workers is 90 seconds Jun 16 12:12:09.980452 dv-cinder-846149-2-smb devstack@keystone.service[80061]: mapped 403077 bytes (393 KB) for 2 cores Jun 16 12:12:09.980527 dv-cinder-846149-2-smb devstack@keystone.service[80061]: *** Operational MODE: preforking *** Jun 16 12:12:09.980830 dv-cinder-846149-2-smb devstack@keystone.service[80061]: *** uWSGI is running in multiple interpreter mode *** Jun 16 12:12:09.980830 dv-cinder-846149-2-smb devstack@keystone.service[80061]: spawned uWSGI master process (pid: 80061) Jun 16 12:12:09.981021 dv-cinder-846149-2-smb systemd[1]: Started Devstack devstack@keystone.service. Jun 16 12:12:09.984786 dv-cinder-846149-2-smb devstack@keystone.service[80061]: spawned uWSGI worker 1 (pid: 80075, cores: 1) Jun 16 12:12:09.984786 dv-cinder-846149-2-smb devstack@keystone.service[80061]: spawned uWSGI worker 2 (pid: 80076, cores: 1) Jun 16 12:12:09.984786 dv-cinder-846149-2-smb devstack@keystone.service[80061]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 16 12:12:15.451435 dv-cinder-846149-2-smb devstack@keystone.service[80076]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 16 12:12:15.451435 dv-cinder-846149-2-smb devstack@keystone.service[80076]: from cryptography.utils import int_from_bytes Jun 16 12:12:15.452229 dv-cinder-846149-2-smb devstack@keystone.service[80075]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 16 12:12:15.452229 dv-cinder-846149-2-smb devstack@keystone.service[80075]: from cryptography.utils import int_from_bytes Jun 16 12:12:15.452641 dv-cinder-846149-2-smb devstack@keystone.service[80076]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 16 12:12:15.452641 dv-cinder-846149-2-smb devstack@keystone.service[80076]: from cryptography.utils import int_from_bytes Jun 16 12:12:15.452838 dv-cinder-846149-2-smb devstack@keystone.service[80075]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 16 12:12:15.452838 dv-cinder-846149-2-smb devstack@keystone.service[80075]: from cryptography.utils import int_from_bytes Jun 16 12:12:15.501784 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 16 12:12:15.501978 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 16 12:12:15.502149 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] command line args: [] {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 16 12:12:15.502292 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 16 12:12:15.502415 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 16 12:12:15.502498 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 16 12:12:15.502579 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] ================================================================================ {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 16 12:12:15.502675 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] command line args: [] {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 16 12:12:15.502831 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] admin_token = **** {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:12:15.502948 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 16 12:12:15.503079 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] config_dir = [] {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:12:15.503161 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] ================================================================================ {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 16 12:12:15.503268 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:12:15.503373 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] admin_token = **** {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:12:15.503455 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] config_source = [] {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:12:15.503613 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] debug = True {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:12:15.503694 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] config_dir = [] {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:12:15.503809 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:12:15.504056 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:12:15.504056 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] config_source = [] {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:12:15.504168 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] debug = True {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:12:15.504229 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:12:15.504377 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:12:15.504482 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:12:15.504615 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:12:15.504718 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:12:15.504859 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:12:15.504968 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:12:15.505077 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:12:15.505173 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] list_limit = None {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:12:15.505272 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] log_config_append = None {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:12:15.505367 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:12:15.505460 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:12:15.505571 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] list_limit = None {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:12:15.505672 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] log_dir = None {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:12:15.505767 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] log_config_append = None {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:12:15.505866 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] log_file = None {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:12:15.505973 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:12:15.506068 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:12:15.506157 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] log_dir = None {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:12:15.506157 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] log_file = None {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:12:15.506340 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:12:15.506456 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:12:15.506530 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:12:15.506642 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:12:15.506727 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:12:15.506799 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:12:15.506914 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:12:15.506993 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:12:15.507064 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:12:15.507205 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:12:15.507284 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:12:15.507411 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:12:15.507491 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:12:15.507607 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:12:15.507687 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:12:15.507862 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:12:15.507943 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:12:15.508101 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:12:15.508223 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:12:15.508339 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:12:15.508422 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:12:15.508576 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:12:15.508695 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:12:15.508836 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:12:15.508931 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:12:15.509089 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:12:15.509171 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:12:15.509340 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:12:15.510144 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.44/identity {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:12:15.510270 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:12:15.510356 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] publish_errors = False {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:12:15.510552 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:12:15.510675 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.44/identity {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:12:15.510788 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:12:15.510869 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] publish_errors = False {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:12:15.510951 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:12:15.511102 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:12:15.511187 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:12:15.511340 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:12:15.511417 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:12:15.511506 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:12:15.511645 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] standard_threads = False {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:12:15.511762 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:12:15.511879 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:12:15.512002 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:12:15.512127 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:12:15.512240 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] standard_threads = False {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:12:15.512317 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:12:15.512446 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] use_journal = False {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:12:15.512521 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:12:15.512620 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] use_json = False {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:12:15.512711 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:12:15.512813 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] use_stderr = False {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:12:15.512907 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:12:15.512990 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] use_syslog = False {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:12:15.513088 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] use_journal = False {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:12:15.513206 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:12:15.513295 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] use_json = False {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:12:15.513431 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] use_stderr = False {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:12:15.513507 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.513609 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] use_syslog = False {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:12:15.513690 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.513844 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 12:12:15.513932 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.514104 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.514186 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.514358 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.514441 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.514625 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.514712 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.514865 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.514946 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.515101 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.515175 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.515351 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.515436 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.515600 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.515676 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.515839 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.515915 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.516070 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.516157 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.516318 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.516395 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.516555 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.516639 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.516812 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.516910 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.517066 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.517143 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.517309 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.517385 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.517560 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.517714 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.517812 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.517890 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.518053 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.518135 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.518289 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.518375 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.518544 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.518620 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.518793 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.518872 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.519033 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.519117 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.519285 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.519414 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.519528 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.519605 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.519760 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.519860 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.519990 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.520072 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.520226 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.520309 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.520476 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.520560 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.520711 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.520819 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.520972 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.521065 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.521204 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.521286 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.521455 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.521544 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.521689 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.521783 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.521925 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.522002 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.522171 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.522245 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.522402 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.522478 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.522639 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.522717 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.522875 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.522950 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.523106 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.523188 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.523332 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.523405 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.523555 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.523632 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.523786 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.523868 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.524021 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.524103 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.524254 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.524337 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.524482 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.524557 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.524720 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.524815 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.524975 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.525052 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.525239 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.525323 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.525476 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.525553 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.525718 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.525793 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.525949 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.526023 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.526186 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.526262 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.526421 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.526495 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.526658 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.526765 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.526894 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.526972 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.527131 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.527235 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.527368 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.527470 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.527609 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.527719 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.527844 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.527947 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.528067 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.528155 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.528300 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.528406 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.528553 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.528682 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.528810 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.528910 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.529047 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.529147 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.529283 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.529361 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.529520 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.529601 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.529760 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.529837 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.530002 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.530082 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.530247 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.530327 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.530490 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.530574 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.530727 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.530804 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.530962 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.531043 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.531197 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.531286 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.531444 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.531520 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.531679 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.531758 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.531916 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.532003 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.532156 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.532233 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.532395 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.532474 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.532628 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.532721 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.532888 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.532967 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.533125 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.533214 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.533362 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.533447 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.533598 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.533675 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.533838 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.533915 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.534077 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.534162 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.534312 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.534388 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.534554 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.534630 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.534791 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.534943 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.535043 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.535120 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.535278 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.535354 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.535511 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.535596 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.535743 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.535836 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.535974 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.536052 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.536209 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.536287 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.536439 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.536528 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.536671 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.536764 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.536943 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.537178 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.537426 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.538382 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.538670 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.538938 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.539138 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.539216 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.539420 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.539499 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.539684 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.539762 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.539960 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.540038 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] auth.external = None {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.540206 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.540284 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.540492 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.540577 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.540775 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] auth.external = None {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.540856 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.541026 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] auth.password = None {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.541113 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.541270 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] auth.token = None {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.541356 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.541518 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.541603 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.541762 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.541840 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] auth.password = None {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.542017 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] auth.token = None {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.542095 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.542251 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.542327 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.542494 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.542571 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.542745 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.542823 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.542980 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.543056 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.543218 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] credential.caching = True {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.543295 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.543470 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.543549 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.543704 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.543780 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.543945 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] credential.caching = True {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.544023 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.544195 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.544526 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.544702 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.544794 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.544969 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.545048 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.545232 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.545336 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.545485 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.545575 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.545724 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.545813 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.545984 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.546073 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.546246 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.546352 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.546489 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.546590 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.546750 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.546831 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.546996 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.547079 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.547258 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.547336 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.547503 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] federation.caching = True {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.547582 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.547744 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.547822 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.547995 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.548078 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.548244 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] federation.caching = True {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.548322 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.548475 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.548556 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.548726 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.548855 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.548989 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.549068 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.549224 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.549301 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.549473 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.549550 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.549712 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.549790 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.549957 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.550035 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.550204 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.550286 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.550440 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] identity.caching = True {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.550517 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.550691 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.550774 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.550940 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.551088 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.551168 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] identity.caching = True {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.551238 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.551407 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.551484 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.551655 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.551740 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.551887 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.551964 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.552125 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.552202 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.552372 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.552457 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.552605 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.552681 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.552871 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.552951 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.553106 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.553198 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.553339 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.553417 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.553584 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.553662 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.553815 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.553907 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.554049 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.554128 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.554295 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.554373 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.554545 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.554632 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.554796 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.554875 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.555042 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.555119 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.555283 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.555370 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.555517 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.555596 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.555757 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.555835 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.555989 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.556075 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.556226 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.556862 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.557008 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.557085 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.557244 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.557334 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.557484 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.557563 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.557722 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.557807 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.557959 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.558046 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.558208 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.558286 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.558442 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.558519 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.558688 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.558822 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.558937 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.559015 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.559171 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.559249 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.559411 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.559497 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.559645 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.559762 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.559882 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.559960 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.560119 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.560205 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.560352 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.560430 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.560589 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.560665 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.560849 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.560942 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.561096 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.561174 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.561339 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.561417 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.561570 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.561659 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.561804 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.561882 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.562053 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.562131 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.562287 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.562372 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.562524 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.562602 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.562758 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.562834 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.562994 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.563080 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.563228 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] ldap.user = None {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.563312 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.563467 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.563546 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.563703 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.563782 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.563938 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] ldap.user = None {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.564016 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.564179 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.564258 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.564426 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.564504 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.564664 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.564742 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.564923 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.565000 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.565155 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.565235 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.565392 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.565471 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.565629 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.565708 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.565859 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.565937 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.566089 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.566166 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.566323 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.566400 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.566561 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.566640 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.566794 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.566872 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.567043 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.567121 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.567288 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.567365 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.567522 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.567600 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.567773 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.567854 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.568009 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.568087 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.568240 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.568316 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.568476 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.568552 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.568713 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.568813 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.568975 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.569053 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.569218 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.569296 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.569461 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.569558 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.569708 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.569798 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.569936 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.570014 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.570181 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.570261 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.570421 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.570498 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.570660 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.570737 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.570901 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.570981 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.571141 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.571218 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.571382 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.571459 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.571614 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.571692 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.571852 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.572526 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.572651 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.572729 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] resource.caching = True {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.572929 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.573011 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.573181 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.573260 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.573420 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.573498 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] resource.caching = True {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.573673 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.573752 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.573927 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.574005 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.574165 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.574243 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.574415 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.574494 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.574654 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.574733 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.574893 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.574972 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.575116 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] role.caching = True {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.575190 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.575365 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] role.driver = sql {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.575443 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.575598 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.575676 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.575836 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] role.caching = True {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.575914 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.576086 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.576164 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] role.driver = sql {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.576319 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.576396 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.576572 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.576657 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.576844 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.576926 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.577096 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.577184 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.577342 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.577419 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.577589 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.577667 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.577826 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.577911 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.578076 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.578154 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.578324 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.578401 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.578560 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.578646 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.578806 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.578884 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.579055 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.579202 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.579305 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.579440 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.579556 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.579692 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.579941 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.580018 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.580179 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.580264 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.580426 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.580503 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.580659 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.580738 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.580938 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.581033 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.581187 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.581265 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.581468 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.581556 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.581655 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.581746 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.581890 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.581972 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.582123 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.582201 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.582368 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.582447 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.582604 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.582682 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.582840 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.582918 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.583084 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.583163 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.583323 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.583401 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.583556 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.583633 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.583794 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] token.caching = True {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.583873 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.584033 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.584109 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.584267 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.584344 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.584502 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.584580 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] token.caching = True {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.584740 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.584838 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.585008 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.585086 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.585245 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.585324 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.585491 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.585570 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.585735 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.585813 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.585972 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.586051 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.586208 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.586285 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.586447 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.586525 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.586683 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.586762 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.586919 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.586995 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.587159 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.587237 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.587388 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.587466 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.587658 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.587737 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.587908 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.587984 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.588140 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.588219 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] database.connection = **** {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.588386 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.588474 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.588681 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.588786 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.588946 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.589025 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] database.connection = **** {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.589189 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.589280 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.589425 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.589504 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.589664 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.589742 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.589901 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.589988 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.590139 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.590216 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.590378 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.590456 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.590613 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.590698 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.590850 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.590928 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.591084 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.591162 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.591323 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.591408 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.591557 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.591635 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.591794 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.591872 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.592024 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.592109 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.592264 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.592342 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.592500 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.592577 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.592669 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 16 12:12:15.592774 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.592986 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.593224 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 12:12:15.593395 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 16 12:12:15.708469 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80076) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 12:12:15.708634 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80076) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 12:12:15.708874 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80076) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 12:12:15.709306 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80075) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 12:12:15.709540 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80075) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 12:12:15.709769 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80075) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 12:12:15.717206 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80076) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 12:12:15.718310 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80075) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 12:12:15.745353 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80076) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 12:12:15.745583 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80076) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 12:12:15.746440 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80075) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 12:12:15.746674 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80075) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 12:12:15.798653 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80076) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 12:12:15.798885 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80075) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 12:12:15.847168 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80076) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 12:12:15.847398 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80076) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 12:12:15.847583 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80075) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 12:12:15.847818 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80075) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 12:12:15.912573 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80076) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 12:12:15.912821 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80076) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 12:12:15.913004 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80075) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 12:12:15.913090 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80076) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 12:12:15.913238 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80075) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 12:12:15.913322 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80076) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 12:12:15.913451 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80076) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 12:12:15.913532 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80075) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 12:12:15.913664 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80076) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 12:12:15.913746 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80075) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 12:12:15.913887 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80075) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 12:12:15.914102 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80075) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 12:12:15.938943 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80076) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 12:12:15.939174 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80076) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 12:12:15.939365 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80075) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 12:12:15.939457 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80076) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 12:12:15.939599 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80075) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 12:12:15.939683 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80076) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 12:12:15.939808 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80076) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 12:12:15.939905 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80075) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 12:12:15.940017 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80076) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 12:12:15.940101 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80075) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 12:12:15.940228 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80076) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 12:12:15.940308 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80075) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 12:12:15.940436 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80075) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 12:12:15.940647 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80075) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 12:12:15.951385 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80076) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 12:12:15.951658 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80075) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 12:12:15.964205 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80076) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 12:12:15.964383 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80076) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 12:12:15.964479 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80075) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 12:12:15.964605 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80076) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 12:12:15.964688 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80075) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 12:12:15.964860 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80076) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 12:12:15.964944 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80075) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 12:12:15.965081 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80076) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 12:12:15.965166 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80075) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 12:12:15.965296 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80076) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 12:12:15.965378 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80075) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 12:12:15.965507 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80076) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 12:12:15.965589 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80075) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 12:12:15.965716 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80075) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 12:12:15.983102 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 12:12:15.983310 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 16 12:12:15.983644 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 12:12:15.983726 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80075) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 12:12:15.983908 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80075) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 16 12:12:15.984020 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 16 12:12:15.984244 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80075) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 12:12:15.984325 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 12:12:15.984531 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 12:12:15.984610 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80075) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 16 12:12:15.984806 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 12:12:15.984891 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80075) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 12:12:15.985061 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 12:12:15.985141 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80075) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 12:12:15.985401 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80075) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 12:12:15.985661 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80075) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 12:12:15.996435 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 12:12:15.996703 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 12:12:15.996993 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 12:12:15.997270 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 12:12:15.997365 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80075) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 12:12:15.997581 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80075) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 12:12:15.997851 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80075) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 12:12:15.998131 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80075) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 12:12:16.005413 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80076) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 12:12:16.006349 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80075) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 12:12:16.008830 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80076) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 12:12:16.009106 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 12:12:16.009403 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 12:12:16.009682 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 12:12:16.009840 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80075) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 12:12:16.009959 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 12:12:16.010117 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80075) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 12:12:16.010199 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 12:12:16.010397 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80075) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 12:12:16.010483 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 12:12:16.010677 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80075) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 12:12:16.010759 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 12:12:16.010954 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80075) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 12:12:16.011033 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 12:12:16.011207 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80075) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 12:12:16.011286 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 12:12:16.011464 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 12:12:16.011543 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80075) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 12:12:16.011729 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80075) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 12:12:16.011994 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80075) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 12:12:16.012262 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80075) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 12:12:16.012522 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80075) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 12:12:16.038186 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 12:12:16.039542 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80075) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 12:12:16.039798 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80076) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 12:12:16.040071 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 12:12:16.041706 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80075) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 12:12:16.041986 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80075) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 12:12:16.046186 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80076) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 12:12:16.046461 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 12:12:16.046735 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 12:12:16.047668 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80075) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 12:12:16.047942 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80075) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 12:12:16.048218 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80075) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 12:12:16.054330 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80076) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 12:12:16.054607 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 12:12:16.055810 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80075) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 12:12:16.056091 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80075) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 12:12:16.059670 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80076) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 12:12:16.059954 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 12:12:16.060230 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 12:12:16.060503 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 12:12:16.060788 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 12:12:16.061060 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 12:12:16.061227 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80075) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 12:12:16.061307 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 12:12:16.061510 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80075) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 12:12:16.061590 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 12:12:16.061790 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80075) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 12:12:16.062067 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80075) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 12:12:16.062340 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80075) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 12:12:16.062609 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80075) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 12:12:16.062873 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80075) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 12:12:16.063132 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80075) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 12:12:16.080362 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 12:12:16.080636 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 12:12:16.082039 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80075) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 12:12:16.082315 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80075) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 12:12:16.085246 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80076) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 12:12:16.086882 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80075) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 12:12:16.088966 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 12:12:16.089255 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 12:12:16.090586 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80075) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 12:12:16.090879 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80075) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 12:12:16.094405 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80076) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 12:12:16.096007 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80075) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 12:12:16.098047 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80076) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 12:12:16.099789 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80075) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 12:12:16.101732 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 12:12:16.102027 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 12:12:16.102308 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 12:12:16.102593 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 12:12:16.102866 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 12:12:16.103650 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 12:12:16.104041 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80075) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 12:12:16.104337 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80075) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 12:12:16.104619 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80075) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 12:12:16.104924 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80075) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 12:12:16.105202 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80075) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 12:12:16.105477 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80075) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 12:12:16.123386 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80076) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 12:12:16.123662 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 12:12:16.123924 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 12:12:16.124181 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 12:12:16.125344 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80075) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 12:12:16.125627 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80075) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 12:12:16.125902 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80075) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 12:12:16.126171 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80075) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 12:12:16.132132 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 12:12:16.133865 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 12:12:16.134148 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 12:12:16.134264 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80075) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 12:12:16.136406 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80075) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 12:12:16.136678 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80075) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 12:12:16.137752 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80076) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 12:12:16.138035 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 12:12:16.139583 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 12:12:16.139796 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80075) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 12:12:16.139878 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 12:12:16.140074 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80075) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 12:12:16.140163 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 12:12:16.141670 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80075) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 12:12:16.141970 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80075) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 12:12:16.142251 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80075) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 12:12:16.154081 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80076) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 12:12:16.154356 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 12:12:16.154632 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 12:12:16.154908 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 12:12:16.155181 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 12:12:16.155448 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 12:12:16.155716 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 12:12:16.156315 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80075) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 12:12:16.156593 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80075) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 12:12:16.156909 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80075) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 12:12:16.157188 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80075) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 12:12:16.157469 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80075) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 12:12:16.157738 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80075) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 12:12:16.158012 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80075) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 12:12:16.174128 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80076) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 12:12:16.176446 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80075) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 12:12:16.177421 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80076) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 12:12:16.179776 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80075) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 12:12:16.180736 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 12:12:16.182380 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 12:12:16.183178 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80075) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 12:12:16.184179 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80076) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 12:12:16.184452 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 12:12:16.184729 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 12:12:16.184837 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80075) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 12:12:16.186569 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80075) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 12:12:16.186847 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80075) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 12:12:16.187128 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80075) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 12:12:16.192076 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 12:12:16.193731 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80076) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 12:12:16.194516 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80075) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 12:12:16.196138 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80075) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 12:12:16.197513 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 12:12:16.197798 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 12:12:16.198073 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 12:12:16.198338 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 12:12:16.199966 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80075) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 12:12:16.200251 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80075) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 12:12:16.200529 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80075) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 12:12:16.200825 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80075) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 12:12:16.207797 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80076) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 12:12:16.208080 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 12:12:16.208355 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 12:12:16.210196 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80075) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 12:12:16.210476 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80075) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 12:12:16.210748 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80075) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 12:12:16.216922 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80076) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 12:12:16.217154 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 12:12:16.217430 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 12:12:16.217702 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 12:12:16.217968 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 12:12:16.218247 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 12:12:16.218520 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 12:12:16.218788 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 12:12:16.219057 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 12:12:16.219292 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80075) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 12:12:16.219419 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 12:12:16.219568 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80075) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 12:12:16.219687 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 12:12:16.219845 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80075) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 12:12:16.219951 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 12:12:16.220117 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80075) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 12:12:16.220206 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 12:12:16.220383 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80075) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 12:12:16.220465 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 12:12:16.220656 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80075) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 12:12:16.220960 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80075) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 12:12:16.221231 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80075) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 12:12:16.221504 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80075) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 12:12:16.221869 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80075) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 12:12:16.222139 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80075) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 12:12:16.222405 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80075) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 12:12:16.222671 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80075) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 12:12:16.222935 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80075) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 12:12:16.258722 dv-cinder-846149-2-smb devstack@keystone.service[80076]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x5622f45f79c0 pid: 80076 (default app) Jun 16 12:12:16.262004 dv-cinder-846149-2-smb devstack@keystone.service[80075]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x5622f45f79c0 pid: 80075 (default app) Jun 16 12:12:16.262673 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064edb34-d28e-4be6-96c6-b26d3b0a8610 None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:12:16.262973 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064edb34-d28e-4be6-96c6-b26d3b0a8610 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:12:16.263251 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064edb34-d28e-4be6-96c6-b26d3b0a8610 None None] PATH_INFO: `/v3` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:12:16.267464 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1/1] 10.222.0.44 () {50 vars in 791 bytes} [Thu Jun 16 12:12:16 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:12:23.935550 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c015836e-3851-4d70-9016-a0b9b9acf072 None None] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:12:23.936015 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c015836e-3851-4d70-9016-a0b9b9acf072 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:12:23.936103 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c015836e-3851-4d70-9016-a0b9b9acf072 None None] PATH_INFO: `/` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:12:23.940448 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1/2] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 12:12:23 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 12:12:23.946146 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1da2d8-7c5a-4e2f-887b-f4150ec9be8e None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:12:23.946599 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1da2d8-7c5a-4e2f-887b-f4150ec9be8e None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:12:23.946690 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1da2d8-7c5a-4e2f-887b-f4150ec9be8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:12:24.015978 dv-cinder-846149-2-smb devstack@keystone.service[80076]: INFO dbcounter [None req-3f1da2d8-7c5a-4e2f-887b-f4150ec9be8e None None] Registered counter for database keystone Jun 16 12:12:24.036672 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG oslo_db.sqlalchemy.engines [None req-3f1da2d8-7c5a-4e2f-887b-f4150ec9be8e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80076) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 12:12:24.042834 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writer thread running {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 12:12:24.218644 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG passlib.handlers.bcrypt [None req-3f1da2d8-7c5a-4e2f-887b-f4150ec9be8e None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80076) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jun 16 12:12:24.219073 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG passlib.handlers.bcrypt [None req-3f1da2d8-7c5a-4e2f-887b-f4150ec9be8e None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80076) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jun 16 12:12:24.272998 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-3f1da2d8-7c5a-4e2f-887b-f4150ec9be8e None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:12:24.274615 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-3f1da2d8-7c5a-4e2f-887b-f4150ec9be8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:12:24.394715 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 2/3] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 12:12:23 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 450 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jun 16 12:12:24.539779 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c015836e-3851-4d70-9016-a0b9b9acf072 None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:12:24.610882 dv-cinder-846149-2-smb devstack@keystone.service[80075]: INFO dbcounter [None req-c015836e-3851-4d70-9016-a0b9b9acf072 None None] Registered counter for database keystone Jun 16 12:12:24.629839 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG oslo_db.sqlalchemy.engines [None req-c015836e-3851-4d70-9016-a0b9b9acf072 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80075) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 12:12:24.635970 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writer thread running {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 12:12:24.755317 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c015836e-3851-4d70-9016-a0b9b9acf072 None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:12:24.759633 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6b2b11-f191-45c6-abbf-26b073928626 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:12:24.760291 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6b2b11-f191-45c6-abbf-26b073928626 admin admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:12:24.760575 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6b2b11-f191-45c6-abbf-26b073928626 admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:12:24.760879 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6b2b11-f191-45c6-abbf-26b073928626 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:12:24.768910 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6b2b11-f191-45c6-abbf-26b073928626 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:12:24.821637 dv-cinder-846149-2-smb devstack@keystone.service[80075]: WARNING keystone.common.rbac_enforcer.enforcer [None req-fb6b2b11-f191-45c6-abbf-26b073928626 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jun 16 12:12:24.822444 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6b2b11-f191-45c6-abbf-26b073928626 admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:12:24.831924 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 2/4] 10.222.0.44 () {58 vars in 1324 bytes} [Thu Jun 16 12:12:24 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 16 12:12:24.838426 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1da2d8-7c5a-4e2f-887b-f4150ec9be8e None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:12:24.854871 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1da2d8-7c5a-4e2f-887b-f4150ec9be8e None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:12:24.859227 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36676741-a8ee-42dc-ad67-a7795b67e953 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:12:24.860334 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36676741-a8ee-42dc-ad67-a7795b67e953 admin admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:12:24.860613 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36676741-a8ee-42dc-ad67-a7795b67e953 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:12:24.860922 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36676741-a8ee-42dc-ad67-a7795b67e953 admin admin] PATH_INFO: `/v3/projects/487834c5a8184e199d372be1da9a9d39` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:12:24.862417 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36676741-a8ee-42dc-ad67-a7795b67e953 admin admin] RBAC: Authorizing `identity:get_project(project_id=487834c5a8184e199d372be1da9a9d39)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:12:24.913699 dv-cinder-846149-2-smb devstack@keystone.service[80076]: WARNING keystone.common.rbac_enforcer.enforcer [None req-36676741-a8ee-42dc-ad67-a7795b67e953 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jun 16 12:12:24.914037 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36676741-a8ee-42dc-ad67-a7795b67e953 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:12:24.918690 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 3/5] 10.222.0.44 () {56 vars in 1207 bytes} [Thu Jun 16 12:12:24 2022] GET /identity/v3/projects/487834c5a8184e199d372be1da9a9d39 => generated 344 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:12:26.986336 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de80eee0-5744-4385-b4c0-b1e1760e77fa None None] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:12:26.986837 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de80eee0-5744-4385-b4c0-b1e1760e77fa None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:12:26.986921 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de80eee0-5744-4385-b4c0-b1e1760e77fa None None] PATH_INFO: `/` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:12:26.990974 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 3/6] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 12:12:26 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 12:12:26.997039 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c507938c-590a-448f-b95c-e51cd112c19a None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:12:26.997402 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c507938c-590a-448f-b95c-e51cd112c19a None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:12:26.997597 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c507938c-590a-448f-b95c-e51cd112c19a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:12:27.016504 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-c507938c-590a-448f-b95c-e51cd112c19a None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:12:27.018044 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-c507938c-590a-448f-b95c-e51cd112c19a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:12:27.025912 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 4/7] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 12:12:26 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jun 16 12:12:27.048241 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de80eee0-5744-4385-b4c0-b1e1760e77fa None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:12:27.060511 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de80eee0-5744-4385-b4c0-b1e1760e77fa None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:12:27.064687 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c24765-34b7-4091-afea-9f2d61fec3e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:12:27.065367 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c24765-34b7-4091-afea-9f2d61fec3e1 admin admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:12:27.065647 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c24765-34b7-4091-afea-9f2d61fec3e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:12:27.065918 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c24765-34b7-4091-afea-9f2d61fec3e1 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:12:27.073944 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c24765-34b7-4091-afea-9f2d61fec3e1 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:12:27.075697 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c24765-34b7-4091-afea-9f2d61fec3e1 admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:12:27.084192 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 4/8] 10.222.0.44 () {58 vars in 1324 bytes} [Thu Jun 16 12:12:27 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 16 12:12:27.089240 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c507938c-590a-448f-b95c-e51cd112c19a None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:12:27.097996 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c507938c-590a-448f-b95c-e51cd112c19a None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:12:27.102302 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d883fd10-9457-4f46-b428-019cf37a390f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:12:27.103661 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d883fd10-9457-4f46-b428-019cf37a390f admin admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:12:27.103933 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d883fd10-9457-4f46-b428-019cf37a390f admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:12:27.104203 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d883fd10-9457-4f46-b428-019cf37a390f admin admin] PATH_INFO: `/v3/users/63ec8f96a497486a9d373a6514f7d0be` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:12:27.105618 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d883fd10-9457-4f46-b428-019cf37a390f admin admin] RBAC: Authorizing `identity:get_user(user_id=63ec8f96a497486a9d373a6514f7d0be)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:12:27.107438 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d883fd10-9457-4f46-b428-019cf37a390f admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:12:27.109007 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 5/9] 10.222.0.44 () {56 vars in 1198 bytes} [Thu Jun 16 12:12:27 2022] GET /identity/v3/users/63ec8f96a497486a9d373a6514f7d0be => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:12:29.253774 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57129e7d-ad19-41a4-b8cb-22c554dd93f7 None None] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:12:29.254326 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57129e7d-ad19-41a4-b8cb-22c554dd93f7 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:12:29.254326 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57129e7d-ad19-41a4-b8cb-22c554dd93f7 None None] PATH_INFO: `/` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:12:29.255685 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 5/10] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 12:12:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 12:12:29.261588 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdcaa54-9c5b-498c-b9fd-7bbbdf40fbe9 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:12:29.262109 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdcaa54-9c5b-498c-b9fd-7bbbdf40fbe9 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:12:29.262204 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdcaa54-9c5b-498c-b9fd-7bbbdf40fbe9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:12:29.278962 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-cfdcaa54-9c5b-498c-b9fd-7bbbdf40fbe9 None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:12:29.280146 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-cfdcaa54-9c5b-498c-b9fd-7bbbdf40fbe9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:12:29.302062 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bebe27-fde4-4235-8189-fc02ceed31ef None None] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:12:29.302423 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bebe27-fde4-4235-8189-fc02ceed31ef None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:12:29.302766 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bebe27-fde4-4235-8189-fc02ceed31ef None None] PATH_INFO: `/` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:12:29.304180 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 6/11] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 12:12:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 12:12:29.309237 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577df1d6-63b2-425f-b7de-ca9b749d49b7 None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:12:29.309520 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577df1d6-63b2-425f-b7de-ca9b749d49b7 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:12:29.309791 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577df1d6-63b2-425f-b7de-ca9b749d49b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:12:29.348848 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG passlib.handlers.bcrypt [None req-577df1d6-63b2-425f-b7de-ca9b749d49b7 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80075) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jun 16 12:12:29.349269 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG passlib.handlers.bcrypt [None req-577df1d6-63b2-425f-b7de-ca9b749d49b7 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80075) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jun 16 12:12:29.359710 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 6/12] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 12:12:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 12:12:29.382155 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdcaa54-9c5b-498c-b9fd-7bbbdf40fbe9 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:12:29.394699 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-577df1d6-63b2-425f-b7de-ca9b749d49b7 None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:12:29.396314 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-577df1d6-63b2-425f-b7de-ca9b749d49b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:12:29.405390 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:12:29.484226 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdcaa54-9c5b-498c-b9fd-7bbbdf40fbe9 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:12:29.495530 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 7/13] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 12:12:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 12:12:29.517421 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ce7eeb-5f25-47d1-a07e-84a86132d653 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:12:29.517857 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577df1d6-63b2-425f-b7de-ca9b749d49b7 None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:12:29.518151 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ce7eeb-5f25-47d1-a07e-84a86132d653 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:12:29.518432 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ce7eeb-5f25-47d1-a07e-84a86132d653 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:12:29.518710 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ce7eeb-5f25-47d1-a07e-84a86132d653 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:12:29.530606 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ce7eeb-5f25-47d1-a07e-84a86132d653 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 12:12:29.541850 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-11ce7eeb-5f25-47d1-a07e-84a86132d653 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 12:12:29.541850 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 12:12:29.541850 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 12:12:29.541850 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 12:12:29.541850 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 12:12:29.541850 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 12:12:29.541850 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 12:12:29.541850 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 12:12:29.541850 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 12:12:29.541850 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 12:12:29.541850 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 12:12:29.541850 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 12:12:29.541850 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 12:12:29.541850 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 12:12:29.541850 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 12:12:29.541850 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 12:12:29.542921 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 12:12:29.542921 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 12:12:29.542921 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 12:12:29.542921 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 12:12:29.542921 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 12:12:29.542921 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 12:12:29.542921 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 12:12:29.542921 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 12:12:29.542921 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 12:12:29.542921 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 12:12:29.542921 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 12:12:29.542921 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jun 16 12:12:29.542921 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 12:12:29.542921 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jun 16 12:12:29.542921 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 12:12:29.542921 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 12:12:29.543777 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 12:12:29.543777 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jun 16 12:12:29.543777 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 12:12:29.543777 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jun 16 12:12:29.543777 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 12:12:29.543777 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 12:12:29.543777 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 12:12:29.543777 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 12:12:29.543777 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 12:12:29.543777 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 12:12:29.543777 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 12:12:29.543777 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jun 16 12:12:29.543777 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 7/14] 10.222.0.44 () {56 vars in 1096 bytes} [Thu Jun 16 12:12:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 12:12:29.549071 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ce7eeb-5f25-47d1-a07e-84a86132d653 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:12:29.618739 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577df1d6-63b2-425f-b7de-ca9b749d49b7 None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:12:29.621080 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:12:29.628598 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:12:29.648353 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ce7eeb-5f25-47d1-a07e-84a86132d653 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:12:29.656793 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33921bf4-6ae3-41e4-9132-d5f58375fe71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:12:29.657697 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33921bf4-6ae3-41e4-9132-d5f58375fe71 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:12:29.657985 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33921bf4-6ae3-41e4-9132-d5f58375fe71 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:12:29.658264 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33921bf4-6ae3-41e4-9132-d5f58375fe71 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:12:29.682599 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c74c04-e495-4344-ba13-2be5fe0dc237 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:12:29.683257 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c74c04-e495-4344-ba13-2be5fe0dc237 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:12:29.683534 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c74c04-e495-4344-ba13-2be5fe0dc237 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:12:29.683806 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c74c04-e495-4344-ba13-2be5fe0dc237 None admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:12:29.684556 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c74c04-e495-4344-ba13-2be5fe0dc237 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:12:29.684915 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c74c04-e495-4344-ba13-2be5fe0dc237 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:12:29.686400 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c74c04-e495-4344-ba13-2be5fe0dc237 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:12:29.703081 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 8/15] 10.222.0.44 () {56 vars in 1099 bytes} [Thu Jun 16 12:12:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 12:12:29.704038 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c74c04-e495-4344-ba13-2be5fe0dc237 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:12:29.727368 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33921bf4-6ae3-41e4-9132-d5f58375fe71 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:12:29.728925 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33921bf4-6ae3-41e4-9132-d5f58375fe71 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:12:29.800963 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c74c04-e495-4344-ba13-2be5fe0dc237 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:12:29.826383 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 8/16] 10.222.0.44 () {58 vars in 1282 bytes} [Thu Jun 16 12:12:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 16 12:12:29.832018 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33921bf4-6ae3-41e4-9132-d5f58375fe71 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:12:29.834579 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ca96b9-bd28-4e5a-aaeb-109fd531ce87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:12:29.834725 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:12:29.835455 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ca96b9-bd28-4e5a-aaeb-109fd531ce87 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:12:29.835762 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ca96b9-bd28-4e5a-aaeb-109fd531ce87 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:12:29.836009 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ca96b9-bd28-4e5a-aaeb-109fd531ce87 None admin] PATH_INFO: `/v3/users/63ec8f96a497486a9d373a6514f7d0be` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:12:29.837391 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ca96b9-bd28-4e5a-aaeb-109fd531ce87 None admin] RBAC: Authorizing `identity:get_user(user_id=63ec8f96a497486a9d373a6514f7d0be)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:12:29.838866 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ca96b9-bd28-4e5a-aaeb-109fd531ce87 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:12:29.840476 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 9/17] 10.222.0.44 () {56 vars in 1177 bytes} [Thu Jun 16 12:12:29 2022] GET /identity/v3/users/63ec8f96a497486a9d373a6514f7d0be => generated 247 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 12:12:29.845663 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ca96b9-bd28-4e5a-aaeb-109fd531ce87 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:12:29.859990 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:12:29.932342 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33921bf4-6ae3-41e4-9132-d5f58375fe71 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:12:29.945640 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ca96b9-bd28-4e5a-aaeb-109fd531ce87 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:12:29.966561 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3bcf41-535f-4161-b0e6-69875ae1f50e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:12:29.967353 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3bcf41-535f-4161-b0e6-69875ae1f50e None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:12:29.967634 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3bcf41-535f-4161-b0e6-69875ae1f50e None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:12:29.967907 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3bcf41-535f-4161-b0e6-69875ae1f50e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:12:29.978951 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd717440-ea0d-4dae-8095-754b8f050f97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:12:29.979761 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd717440-ea0d-4dae-8095-754b8f050f97 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:12:29.980020 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd717440-ea0d-4dae-8095-754b8f050f97 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:12:29.980290 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd717440-ea0d-4dae-8095-754b8f050f97 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:12:29.981476 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd717440-ea0d-4dae-8095-754b8f050f97 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:12:29.982927 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd717440-ea0d-4dae-8095-754b8f050f97 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:12:29.984507 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 10/18] 10.222.0.44 () {56 vars in 1108 bytes} [Thu Jun 16 12:12:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 12:12:29.985877 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3bcf41-535f-4161-b0e6-69875ae1f50e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:12:29.987338 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3bcf41-535f-4161-b0e6-69875ae1f50e None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:12:29.990187 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd717440-ea0d-4dae-8095-754b8f050f97 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:12:30.008859 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application [None req-ad3bcf41-535f-4161-b0e6-69875ae1f50e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 12:12:30.008859 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 12:12:30.008859 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 12:12:30.008859 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 12:12:30.008859 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 12:12:30.008859 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 12:12:30.008859 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 12:12:30.008859 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 12:12:30.008859 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 12:12:30.008859 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 12:12:30.008859 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 12:12:30.008859 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 12:12:30.008859 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 12:12:30.008859 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 12:12:30.008859 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 12:12:30.010285 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 12:12:30.010285 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 12:12:30.010285 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 12:12:30.010285 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 12:12:30.010285 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 12:12:30.010285 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 12:12:30.010285 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 12:12:30.010285 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 12:12:30.010285 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application with Lock( Jun 16 12:12:30.010285 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 12:12:30.010285 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._enter() Jun 16 12:12:30.010285 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 12:12:30.010285 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 12:12:30.010285 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 12:12:30.010285 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.creator() Jun 16 12:12:30.010285 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 12:12:30.010285 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application created_value = creator( Jun 16 12:12:30.011067 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 12:12:30.011067 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 12:12:30.011067 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 12:12:30.011067 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application Jun 16 12:12:30.011067 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 9/19] 10.222.0.44 () {56 vars in 1108 bytes} [Thu Jun 16 12:12:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 12:12:30.016150 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3bcf41-535f-4161-b0e6-69875ae1f50e None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:12:30.068972 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:12:30.072351 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:12:30.089046 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd717440-ea0d-4dae-8095-754b8f050f97 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:12:30.115580 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3bcf41-535f-4161-b0e6-69875ae1f50e None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:12:30.122998 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c117639d-340d-43c3-99f8-c6afe92801ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:12:30.123645 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c117639d-340d-43c3-99f8-c6afe92801ec None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:12:30.123922 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c117639d-340d-43c3-99f8-c6afe92801ec None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:12:30.124194 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c117639d-340d-43c3-99f8-c6afe92801ec None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:12:30.125052 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c117639d-340d-43c3-99f8-c6afe92801ec None admin] RBAC: Adding query filter params (role.id=0688968254744e3f9913653cafea3091, scope.domain.id=default, user.id=63ec8f96a497486a9d373a6514f7d0be) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:12:30.125362 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c117639d-340d-43c3-99f8-c6afe92801ec None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:12:30.126904 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c117639d-340d-43c3-99f8-c6afe92801ec None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:12:30.133621 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 11/20] 10.222.0.44 () {56 vars in 1322 bytes} [Thu Jun 16 12:12:29 2022] GET /identity/v3/role_assignments?user.id=63ec8f96a497486a9d373a6514f7d0be&scope.domain.id=default&role.id=0688968254744e3f9913653cafea3091 => generated 233 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 12:12:30.149728 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56329c19-8e50-47a6-b73d-7748f9164b5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:12:30.150413 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56329c19-8e50-47a6-b73d-7748f9164b5b None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:12:30.150698 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56329c19-8e50-47a6-b73d-7748f9164b5b None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:12:30.150973 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56329c19-8e50-47a6-b73d-7748f9164b5b None admin] PATH_INFO: `/v3/domains` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:12:30.151725 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56329c19-8e50-47a6-b73d-7748f9164b5b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:12:30.152034 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56329c19-8e50-47a6-b73d-7748f9164b5b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:12:30.153503 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56329c19-8e50-47a6-b73d-7748f9164b5b None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:12:30.173930 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 10/21] 10.222.0.44 () {56 vars in 1109 bytes} [Thu Jun 16 12:12:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 12:12:32.580680 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b368c19a-ae3d-4dd4-9e23-2fdf18273de5 None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:12:32.581744 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b368c19a-ae3d-4dd4-9e23-2fdf18273de5 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:12:32.582242 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b368c19a-ae3d-4dd4-9e23-2fdf18273de5 None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:12:32.583817 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 12/22] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 12:12:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 12:12:32.590148 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f0a65f-28ce-4b2c-9ee2-60bf917671de None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:12:32.590995 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f0a65f-28ce-4b2c-9ee2-60bf917671de None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:12:32.591480 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f0a65f-28ce-4b2c-9ee2-60bf917671de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:12:32.613933 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-b0f0a65f-28ce-4b2c-9ee2-60bf917671de None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:12:32.615454 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-b0f0a65f-28ce-4b2c-9ee2-60bf917671de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:12:32.712813 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 11/23] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 12:12:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 12:12:32.747356 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b368c19a-ae3d-4dd4-9e23-2fdf18273de5 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:12:32.837291 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07589fe7-6e3e-4e8f-9d17-6a608f5c8829 None None] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:12:32.837901 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07589fe7-6e3e-4e8f-9d17-6a608f5c8829 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:12:32.838392 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07589fe7-6e3e-4e8f-9d17-6a608f5c8829 None None] PATH_INFO: `/` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:12:32.839946 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 12/24] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 12:12:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 12:12:32.844876 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89207ec8-4a1f-49c7-8ae6-56fca2346c58 None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:12:32.845382 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89207ec8-4a1f-49c7-8ae6-56fca2346c58 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:12:32.845850 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89207ec8-4a1f-49c7-8ae6-56fca2346c58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:12:32.878507 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-89207ec8-4a1f-49c7-8ae6-56fca2346c58 None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:12:32.881193 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-89207ec8-4a1f-49c7-8ae6-56fca2346c58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:12:32.919245 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b368c19a-ae3d-4dd4-9e23-2fdf18273de5 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:12:32.984628 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:12:32.989233 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634b2148-181e-4672-ba91-4f9045c66320 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:12:32.990172 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634b2148-181e-4672-ba91-4f9045c66320 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:12:32.990453 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634b2148-181e-4672-ba91-4f9045c66320 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:12:32.990726 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634b2148-181e-4672-ba91-4f9045c66320 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:12:33.019898 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634b2148-181e-4672-ba91-4f9045c66320 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 12:12:33.027754 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-634b2148-181e-4672-ba91-4f9045c66320 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 12:12:33.027754 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 12:12:33.027754 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 12:12:33.027754 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 12:12:33.027754 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 12:12:33.027754 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 12:12:33.027754 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 12:12:33.027754 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 12:12:33.027754 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 12:12:33.027754 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 12:12:33.027754 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 12:12:33.027754 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 12:12:33.027754 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 12:12:33.027754 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 12:12:33.027754 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 12:12:33.027754 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 12:12:33.028593 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 12:12:33.028593 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 12:12:33.028593 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 12:12:33.028593 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 12:12:33.028593 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 12:12:33.028593 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 12:12:33.028593 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 12:12:33.028593 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 12:12:33.028593 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 12:12:33.028593 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 12:12:33.028593 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 12:12:33.028593 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jun 16 12:12:33.028593 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 12:12:33.028593 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jun 16 12:12:33.028593 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 12:12:33.028593 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 12:12:33.029395 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 12:12:33.029395 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jun 16 12:12:33.029395 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 12:12:33.029395 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jun 16 12:12:33.029395 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 12:12:33.029395 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 12:12:33.029395 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 12:12:33.029395 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 12:12:33.029395 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 12:12:33.029395 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 12:12:33.029395 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 12:12:33.029395 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jun 16 12:12:33.037057 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 13/25] 10.222.0.44 () {56 vars in 1096 bytes} [Thu Jun 16 12:12:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 12:12:33.044413 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634b2148-181e-4672-ba91-4f9045c66320 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:12:33.051116 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 13/26] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 12:12:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 12:12:33.053940 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:12:33.086553 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89207ec8-4a1f-49c7-8ae6-56fca2346c58 None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:12:33.244386 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634b2148-181e-4672-ba91-4f9045c66320 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:12:33.305133 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07aafa7-34e7-4300-ba07-b19688186e59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:12:33.306393 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07aafa7-34e7-4300-ba07-b19688186e59 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:12:33.307664 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07aafa7-34e7-4300-ba07-b19688186e59 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:12:33.308288 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07aafa7-34e7-4300-ba07-b19688186e59 None admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:12:33.312250 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07aafa7-34e7-4300-ba07-b19688186e59 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:12:33.312918 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07aafa7-34e7-4300-ba07-b19688186e59 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:12:33.314619 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07aafa7-34e7-4300-ba07-b19688186e59 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:12:33.330647 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 14/27] 10.222.0.44 () {56 vars in 1099 bytes} [Thu Jun 16 12:12:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 12:12:33.335468 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a538eb17-87d3-43b1-9603-abefae3f5de3 None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:12:33.337985 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a538eb17-87d3-43b1-9603-abefae3f5de3 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:12:33.339348 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a538eb17-87d3-43b1-9603-abefae3f5de3 None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:12:33.341671 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 15/28] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 12:12:33 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 12:12:33.344079 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89207ec8-4a1f-49c7-8ae6-56fca2346c58 None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:12:33.346716 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a538eb17-87d3-43b1-9603-abefae3f5de3 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:12:33.406161 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9774133a-9ebd-46e3-91ff-54c662208c23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:12:33.406967 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9774133a-9ebd-46e3-91ff-54c662208c23 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:12:33.407253 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9774133a-9ebd-46e3-91ff-54c662208c23 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:12:33.407529 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9774133a-9ebd-46e3-91ff-54c662208c23 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:12:33.418771 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9774133a-9ebd-46e3-91ff-54c662208c23 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:12:33.420698 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9774133a-9ebd-46e3-91ff-54c662208c23 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:12:33.439876 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application [None req-9774133a-9ebd-46e3-91ff-54c662208c23 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 12:12:33.439876 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 12:12:33.439876 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 12:12:33.439876 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 12:12:33.439876 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 12:12:33.439876 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 12:12:33.439876 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 12:12:33.439876 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 12:12:33.439876 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 12:12:33.439876 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 12:12:33.439876 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 12:12:33.439876 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 12:12:33.439876 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 12:12:33.439876 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 12:12:33.439876 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 12:12:33.440910 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 12:12:33.440910 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 12:12:33.440910 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 12:12:33.440910 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 12:12:33.440910 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 12:12:33.440910 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 12:12:33.440910 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 12:12:33.440910 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 12:12:33.440910 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application with Lock( Jun 16 12:12:33.440910 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 12:12:33.440910 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._enter() Jun 16 12:12:33.440910 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 12:12:33.440910 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 12:12:33.440910 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 12:12:33.440910 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.creator() Jun 16 12:12:33.440910 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 12:12:33.440910 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application created_value = creator( Jun 16 12:12:33.441815 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 12:12:33.441815 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 12:12:33.441815 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 12:12:33.441815 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application Jun 16 12:12:33.443253 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:12:33.450366 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 14/29] 10.222.0.44 () {56 vars in 1108 bytes} [Thu Jun 16 12:12:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 364 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 12:12:33.451889 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e76e20-631c-429d-a83b-dde86acdc62b None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:12:33.452357 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e76e20-631c-429d-a83b-dde86acdc62b None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:12:33.452926 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e76e20-631c-429d-a83b-dde86acdc62b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:12:33.471124 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-39e76e20-631c-429d-a83b-dde86acdc62b None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:12:33.472701 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-39e76e20-631c-429d-a83b-dde86acdc62b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:12:33.489649 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a538eb17-87d3-43b1-9603-abefae3f5de3 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:12:33.500399 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:12:33.535108 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2a9c55-2c01-4c1f-aaa7-3b5c291ee0ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:12:33.536946 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2a9c55-2c01-4c1f-aaa7-3b5c291ee0ef None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:12:33.537407 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2a9c55-2c01-4c1f-aaa7-3b5c291ee0ef None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:12:33.537856 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2a9c55-2c01-4c1f-aaa7-3b5c291ee0ef None admin] PATH_INFO: `/v3/users/63ec8f96a497486a9d373a6514f7d0be` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:12:33.539248 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2a9c55-2c01-4c1f-aaa7-3b5c291ee0ef None admin] RBAC: Authorizing `identity:get_user(user_id=63ec8f96a497486a9d373a6514f7d0be)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:12:33.541787 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2a9c55-2c01-4c1f-aaa7-3b5c291ee0ef None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:12:33.548911 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 16/30] 10.222.0.44 () {56 vars in 1177 bytes} [Thu Jun 16 12:12:33 2022] GET /identity/v3/users/63ec8f96a497486a9d373a6514f7d0be => generated 247 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:12:33.550562 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95ca1d5-95e7-45d7-86a3-545cb8d976bf None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:12:33.550847 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95ca1d5-95e7-45d7-86a3-545cb8d976bf None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:12:33.552297 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95ca1d5-95e7-45d7-86a3-545cb8d976bf None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:12:33.553910 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 17/31] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 12:12:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 12:12:33.554613 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95ca1d5-95e7-45d7-86a3-545cb8d976bf None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:12:33.567144 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 15/32] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 12:12:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 12:12:33.568517 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e76e20-631c-429d-a83b-dde86acdc62b None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:12:33.680429 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e76e20-631c-429d-a83b-dde86acdc62b None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:12:33.685259 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95ca1d5-95e7-45d7-86a3-545cb8d976bf None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:12:33.723738 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc561be3-d299-48a8-94f8-7392bcd95581 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:12:33.724414 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc561be3-d299-48a8-94f8-7392bcd95581 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:12:33.724694 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b823dd0c-1ec4-46f5-9b0a-84d324bd5d18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:12:33.725048 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc561be3-d299-48a8-94f8-7392bcd95581 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:12:33.725488 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc561be3-d299-48a8-94f8-7392bcd95581 None admin] PATH_INFO: `/v3/domains` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:12:33.725860 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b823dd0c-1ec4-46f5-9b0a-84d324bd5d18 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:12:33.726245 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b823dd0c-1ec4-46f5-9b0a-84d324bd5d18 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:12:33.726624 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b823dd0c-1ec4-46f5-9b0a-84d324bd5d18 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:12:33.726844 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc561be3-d299-48a8-94f8-7392bcd95581 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:12:33.727283 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc561be3-d299-48a8-94f8-7392bcd95581 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:12:33.728563 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b823dd0c-1ec4-46f5-9b0a-84d324bd5d18 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:12:33.729083 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc561be3-d299-48a8-94f8-7392bcd95581 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:12:33.730337 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b823dd0c-1ec4-46f5-9b0a-84d324bd5d18 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:12:33.731364 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:12:33.733099 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 16/33] 10.222.0.44 () {56 vars in 1108 bytes} [Thu Jun 16 12:12:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:12:33.734632 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50fab9b-0fd6-42af-80c1-aac5a5d37185 None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:12:33.735161 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50fab9b-0fd6-42af-80c1-aac5a5d37185 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:12:33.735638 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50fab9b-0fd6-42af-80c1-aac5a5d37185 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:12:33.754475 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 18/34] 10.222.0.44 () {56 vars in 1109 bytes} [Thu Jun 16 12:12:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:12:33.755558 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc561be3-d299-48a8-94f8-7392bcd95581 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:12:33.758107 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-a50fab9b-0fd6-42af-80c1-aac5a5d37185 None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:12:33.760064 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-a50fab9b-0fd6-42af-80c1-aac5a5d37185 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:12:33.784704 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:12:33.835802 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 17/35] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 12:12:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 12:12:33.836996 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50fab9b-0fd6-42af-80c1-aac5a5d37185 None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:12:33.885604 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc561be3-d299-48a8-94f8-7392bcd95581 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:12:33.920377 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777743a6-d2f4-42d3-abf8-3f5195c9107a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:12:33.921084 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777743a6-d2f4-42d3-abf8-3f5195c9107a None admin] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:12:33.921370 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777743a6-d2f4-42d3-abf8-3f5195c9107a None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:12:33.921651 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777743a6-d2f4-42d3-abf8-3f5195c9107a None admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:12:33.922543 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777743a6-d2f4-42d3-abf8-3f5195c9107a None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:12:33.924379 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777743a6-d2f4-42d3-abf8-3f5195c9107a None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:12:33.948107 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50fab9b-0fd6-42af-80c1-aac5a5d37185 None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:12:33.984780 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2686943-b3ef-44e7-98b3-e0dd9e6a25b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:12:33.985656 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2686943-b3ef-44e7-98b3-e0dd9e6a25b5 None admin] REQUEST_METHOD: `PUT` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:12:33.985936 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2686943-b3ef-44e7-98b3-e0dd9e6a25b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:12:33.986213 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2686943-b3ef-44e7-98b3-e0dd9e6a25b5 None admin] PATH_INFO: `/v3/domains/default/users/63ec8f96a497486a9d373a6514f7d0be/roles/0688968254744e3f9913653cafea3091` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:12:33.988600 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2686943-b3ef-44e7-98b3-e0dd9e6a25b5 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=63ec8f96a497486a9d373a6514f7d0be, role_id=0688968254744e3f9913653cafea3091)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:12:33.990162 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2686943-b3ef-44e7-98b3-e0dd9e6a25b5 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:12:34.160868 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 19/36] 10.222.0.44 () {60 vars in 1131 bytes} [Thu Jun 16 12:12:33 2022] POST /identity/v3/roles => generated 225 bytes in 398 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 12:12:34.160868 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777743a6-d2f4-42d3-abf8-3f5195c9107a None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:12:34.227200 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:12:34.229067 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 18/37] 10.222.0.44 () {58 vars in 1361 bytes} [Thu Jun 16 12:12:33 2022] PUT /identity/v3/domains/default/users/63ec8f96a497486a9d373a6514f7d0be/roles/0688968254744e3f9913653cafea3091 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:12:34.231277 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e78acc2-d227-4281-ba8f-f2fda8a16217 None None] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:12:34.231793 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e78acc2-d227-4281-ba8f-f2fda8a16217 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:12:34.232233 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e78acc2-d227-4281-ba8f-f2fda8a16217 None None] PATH_INFO: `/` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:12:34.238114 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 19/38] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 12:12:34 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 12:12:34.239183 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e78acc2-d227-4281-ba8f-f2fda8a16217 None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:12:34.271851 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:12:34.329516 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777743a6-d2f4-42d3-abf8-3f5195c9107a None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:12:34.369155 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e78acc2-d227-4281-ba8f-f2fda8a16217 None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:12:34.388625 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ec8576-70f8-46ab-a824-440911d8b412 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:12:34.389424 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ec8576-70f8-46ab-a824-440911d8b412 None admin] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:12:34.389707 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ec8576-70f8-46ab-a824-440911d8b412 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:12:34.389981 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ec8576-70f8-46ab-a824-440911d8b412 None admin] PATH_INFO: `/v3/projects` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:12:34.390716 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ec8576-70f8-46ab-a824-440911d8b412 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:12:34.392345 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ec8576-70f8-46ab-a824-440911d8b412 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:12:34.426984 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e210c417-6f7f-4668-a8a7-ea5dd095a76a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:12:34.427574 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e210c417-6f7f-4668-a8a7-ea5dd095a76a None admin] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:12:34.427902 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e210c417-6f7f-4668-a8a7-ea5dd095a76a None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:12:34.428183 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e210c417-6f7f-4668-a8a7-ea5dd095a76a None admin] PATH_INFO: `/v3/roles` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:12:34.428992 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e210c417-6f7f-4668-a8a7-ea5dd095a76a None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:12:34.432135 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 20/39] 10.222.0.44 () {60 vars in 1141 bytes} [Thu Jun 16 12:12:34 2022] POST /identity/v3/projects => generated 301 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 12:12:34.432263 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e210c417-6f7f-4668-a8a7-ea5dd095a76a None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:12:34.432335 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a1a288-5d1c-473f-89f1-0211851148c5 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:12:34.433282 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a1a288-5d1c-473f-89f1-0211851148c5 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:12:34.433386 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a1a288-5d1c-473f-89f1-0211851148c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:12:34.449902 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 20/40] 10.222.0.44 () {60 vars in 1131 bytes} [Thu Jun 16 12:12:34 2022] POST /identity/v3/roles => generated 219 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 12:12:34.451375 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f178214-c70e-43f2-a5ec-bb2f8cee2de2 None None] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:12:34.451669 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f178214-c70e-43f2-a5ec-bb2f8cee2de2 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:12:34.451944 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f178214-c70e-43f2-a5ec-bb2f8cee2de2 None None] PATH_INFO: `/` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:12:34.454333 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 21/41] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 12:12:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 12:12:34.461633 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636803af-7e33-4fc8-81e3-71bbda747392 None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:12:34.461998 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636803af-7e33-4fc8-81e3-71bbda747392 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:12:34.462854 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636803af-7e33-4fc8-81e3-71bbda747392 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:12:34.463229 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-04a1a288-5d1c-473f-89f1-0211851148c5 None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:12:34.465484 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-04a1a288-5d1c-473f-89f1-0211851148c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:12:34.485318 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-636803af-7e33-4fc8-81e3-71bbda747392 None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:12:34.487225 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-636803af-7e33-4fc8-81e3-71bbda747392 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:12:34.553379 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 21/42] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 12:12:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 12:12:34.576340 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 22/43] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 12:12:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 12:12:34.598864 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a1a288-5d1c-473f-89f1-0211851148c5 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:12:34.599567 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636803af-7e33-4fc8-81e3-71bbda747392 None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:12:34.612812 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:12:34.677715 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:12:34.752265 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636803af-7e33-4fc8-81e3-71bbda747392 None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:12:34.761637 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a1a288-5d1c-473f-89f1-0211851148c5 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:12:34.799415 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c33be2a-3281-4203-86e6-1f2c529366c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:12:34.800205 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c33be2a-3281-4203-86e6-1f2c529366c4 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:12:34.800491 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c33be2a-3281-4203-86e6-1f2c529366c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:12:34.800787 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c33be2a-3281-4203-86e6-1f2c529366c4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:12:34.801960 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c33be2a-3281-4203-86e6-1f2c529366c4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:12:34.803409 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c33be2a-3281-4203-86e6-1f2c529366c4 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:12:34.805299 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 23/44] 10.222.0.44 () {56 vars in 1108 bytes} [Thu Jun 16 12:12:34 2022] GET /identity/v3/domains/default => generated 199 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:12:34.805488 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e99e4f-40ae-4dca-86a1-6ef5a534fead None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:12:34.806730 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e99e4f-40ae-4dca-86a1-6ef5a534fead None admin] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:12:34.806985 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e99e4f-40ae-4dca-86a1-6ef5a534fead None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:12:34.807257 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e99e4f-40ae-4dca-86a1-6ef5a534fead None admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:12:34.808008 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e99e4f-40ae-4dca-86a1-6ef5a534fead None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:12:34.809422 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e99e4f-40ae-4dca-86a1-6ef5a534fead None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:12:34.811051 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c33be2a-3281-4203-86e6-1f2c529366c4 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:12:34.824799 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 22/45] 10.222.0.44 () {60 vars in 1131 bytes} [Thu Jun 16 12:12:34 2022] POST /identity/v3/roles => generated 223 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 12:12:34.902432 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:12:34.934802 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c33be2a-3281-4203-86e6-1f2c529366c4 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:12:34.970597 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d94ba2-b1ca-4f60-bb61-1828ae24c7d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:12:34.971275 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d94ba2-b1ca-4f60-bb61-1828ae24c7d2 None admin] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:12:34.971556 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d94ba2-b1ca-4f60-bb61-1828ae24c7d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:12:34.971828 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d94ba2-b1ca-4f60-bb61-1828ae24c7d2 None admin] PATH_INFO: `/v3/projects` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:12:34.972547 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d94ba2-b1ca-4f60-bb61-1828ae24c7d2 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:12:34.974041 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d94ba2-b1ca-4f60-bb61-1828ae24c7d2 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:12:35.005085 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 24/46] 10.222.0.44 () {60 vars in 1141 bytes} [Thu Jun 16 12:12:34 2022] POST /identity/v3/projects => generated 312 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 12:12:36.537806 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df142f2-08b1-4442-b54e-9d7e66517e9f None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:12:36.538337 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df142f2-08b1-4442-b54e-9d7e66517e9f None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:12:36.538424 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df142f2-08b1-4442-b54e-9d7e66517e9f None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:12:36.539740 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 23/47] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 12:12:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 12:12:36.545234 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6837e8-0570-4f08-b7b7-7fea7ed02299 None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:12:36.545642 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6837e8-0570-4f08-b7b7-7fea7ed02299 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:12:36.545873 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6837e8-0570-4f08-b7b7-7fea7ed02299 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:12:36.562604 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-2b6837e8-0570-4f08-b7b7-7fea7ed02299 None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:12:36.563804 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-2b6837e8-0570-4f08-b7b7-7fea7ed02299 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:12:36.628359 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 25/48] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 12:12:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 12:12:36.651661 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df142f2-08b1-4442-b54e-9d7e66517e9f None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:12:36.745614 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:12:36.752869 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df142f2-08b1-4442-b54e-9d7e66517e9f None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:12:36.785322 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a46f6bc-f415-48b4-a97d-12653f3ae534 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:12:36.786118 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a46f6bc-f415-48b4-a97d-12653f3ae534 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:12:36.786406 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a46f6bc-f415-48b4-a97d-12653f3ae534 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:12:36.786682 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a46f6bc-f415-48b4-a97d-12653f3ae534 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:12:36.796977 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a46f6bc-f415-48b4-a97d-12653f3ae534 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 12:12:36.804485 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-9a46f6bc-f415-48b4-a97d-12653f3ae534 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 12:12:36.804485 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 12:12:36.804485 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 12:12:36.804485 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 12:12:36.804485 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 12:12:36.804485 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 12:12:36.804485 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 12:12:36.804485 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 12:12:36.804485 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 12:12:36.804485 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 12:12:36.804485 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 12:12:36.804485 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 12:12:36.804485 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 12:12:36.804485 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 12:12:36.804485 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 12:12:36.804485 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 12:12:36.805494 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 12:12:36.805494 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 12:12:36.805494 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 12:12:36.805494 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 12:12:36.805494 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 12:12:36.805494 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 12:12:36.805494 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 12:12:36.805494 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 12:12:36.805494 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 12:12:36.805494 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 12:12:36.805494 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 12:12:36.805494 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jun 16 12:12:36.805494 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 12:12:36.805494 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jun 16 12:12:36.805494 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 12:12:36.805494 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 12:12:36.806976 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 12:12:36.806976 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jun 16 12:12:36.806976 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 12:12:36.806976 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jun 16 12:12:36.806976 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 12:12:36.806976 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 12:12:36.806976 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 12:12:36.806976 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 12:12:36.806976 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 12:12:36.806976 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 12:12:36.806976 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 12:12:36.806976 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jun 16 12:12:36.806976 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 24/49] 10.222.0.44 () {56 vars in 1096 bytes} [Thu Jun 16 12:12:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 12:12:36.813594 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6837e8-0570-4f08-b7b7-7fea7ed02299 None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:12:36.867072 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:12:36.909810 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6837e8-0570-4f08-b7b7-7fea7ed02299 None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:12:36.946913 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4bd932-9ba8-44c7-bc23-3b3b755270ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:12:36.947578 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4bd932-9ba8-44c7-bc23-3b3b755270ed None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:12:36.947858 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4bd932-9ba8-44c7-bc23-3b3b755270ed None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:12:36.948129 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4bd932-9ba8-44c7-bc23-3b3b755270ed None admin] PATH_INFO: `/v3/roles` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:12:36.948907 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4bd932-9ba8-44c7-bc23-3b3b755270ed None admin] RBAC: Adding query filter params (name=admin) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:12:36.949213 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4bd932-9ba8-44c7-bc23-3b3b755270ed None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:12:36.950580 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4bd932-9ba8-44c7-bc23-3b3b755270ed None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:12:36.962617 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 26/50] 10.222.0.44 () {56 vars in 1099 bytes} [Thu Jun 16 12:12:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:12:36.968251 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a46f6bc-f415-48b4-a97d-12653f3ae534 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:12:37.066061 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a46f6bc-f415-48b4-a97d-12653f3ae534 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:12:37.101682 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41435103-0458-47ec-b2e3-c8261db5f405 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:12:37.102568 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41435103-0458-47ec-b2e3-c8261db5f405 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:12:37.103406 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41435103-0458-47ec-b2e3-c8261db5f405 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:12:37.103678 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41435103-0458-47ec-b2e3-c8261db5f405 None admin] PATH_INFO: `/v3/users/63ec8f96a497486a9d373a6514f7d0be` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:12:37.104929 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41435103-0458-47ec-b2e3-c8261db5f405 None admin] RBAC: Authorizing `identity:get_user(user_id=63ec8f96a497486a9d373a6514f7d0be)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:12:37.106398 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41435103-0458-47ec-b2e3-c8261db5f405 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:12:37.108035 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 25/51] 10.222.0.44 () {56 vars in 1177 bytes} [Thu Jun 16 12:12:36 2022] GET /identity/v3/users/63ec8f96a497486a9d373a6514f7d0be => generated 247 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:12:37.113453 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4bd932-9ba8-44c7-bc23-3b3b755270ed None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:12:37.137607 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8babb10b-3f38-4fb8-8fd6-d1cf7659bcb4 None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:12:37.137896 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8babb10b-3f38-4fb8-8fd6-d1cf7659bcb4 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:12:37.138174 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8babb10b-3f38-4fb8-8fd6-d1cf7659bcb4 None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:12:37.139517 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 26/52] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 12:12:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 12:12:37.144355 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1970f2c-3af9-477c-97dd-df2fab9ef7bf None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:12:37.144643 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1970f2c-3af9-477c-97dd-df2fab9ef7bf None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:12:37.144952 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1970f2c-3af9-477c-97dd-df2fab9ef7bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:12:37.160820 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-b1970f2c-3af9-477c-97dd-df2fab9ef7bf None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:12:37.162010 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-b1970f2c-3af9-477c-97dd-df2fab9ef7bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:12:37.179548 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:12:37.213593 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4bd932-9ba8-44c7-bc23-3b3b755270ed None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:12:37.230788 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:12:37.230972 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 27/53] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 12:12:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 12:12:37.248866 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dbac72-6b1d-419f-b261-d028bf42353c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:12:37.249672 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dbac72-6b1d-419f-b261-d028bf42353c None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:12:37.249959 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dbac72-6b1d-419f-b261-d028bf42353c None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:12:37.250241 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dbac72-6b1d-419f-b261-d028bf42353c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:12:37.251422 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71dbac72-6b1d-419f-b261-d028bf42353c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:12:37.252919 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71dbac72-6b1d-419f-b261-d028bf42353c None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:12:37.253340 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1970f2c-3af9-477c-97dd-df2fab9ef7bf None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:12:37.254696 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 27/54] 10.222.0.44 () {56 vars in 1108 bytes} [Thu Jun 16 12:12:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:12:37.260025 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dbac72-6b1d-419f-b261-d028bf42353c None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:12:37.350683 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1970f2c-3af9-477c-97dd-df2fab9ef7bf None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:12:37.357217 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dbac72-6b1d-419f-b261-d028bf42353c None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:12:37.384835 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483c3321-5bc5-4bfa-acc2-c0534bb56252 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:12:37.385622 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483c3321-5bc5-4bfa-acc2-c0534bb56252 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:12:37.385906 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483c3321-5bc5-4bfa-acc2-c0534bb56252 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:12:37.386182 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483c3321-5bc5-4bfa-acc2-c0534bb56252 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:12:37.387388 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483c3321-5bc5-4bfa-acc2-c0534bb56252 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:12:37.388885 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483c3321-5bc5-4bfa-acc2-c0534bb56252 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:12:37.390652 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 28/55] 10.222.0.44 () {56 vars in 1108 bytes} [Thu Jun 16 12:12:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 12:12:37.391586 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b7c6ca-430d-4568-a4fd-4c52d1aaef61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:12:37.392255 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b7c6ca-430d-4568-a4fd-4c52d1aaef61 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:12:37.392523 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b7c6ca-430d-4568-a4fd-4c52d1aaef61 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:12:37.392828 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b7c6ca-430d-4568-a4fd-4c52d1aaef61 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:12:37.393718 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b7c6ca-430d-4568-a4fd-4c52d1aaef61 None admin] RBAC: Adding query filter params (role.id=0688968254744e3f9913653cafea3091, scope.domain.id=default, user.id=63ec8f96a497486a9d373a6514f7d0be) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:12:37.394036 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b7c6ca-430d-4568-a4fd-4c52d1aaef61 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:12:37.395476 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b7c6ca-430d-4568-a4fd-4c52d1aaef61 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:12:37.395866 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483c3321-5bc5-4bfa-acc2-c0534bb56252 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:12:37.404203 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 28/56] 10.222.0.44 () {56 vars in 1322 bytes} [Thu Jun 16 12:12:37 2022] GET /identity/v3/role_assignments?user.id=63ec8f96a497486a9d373a6514f7d0be&scope.domain.id=default&role.id=0688968254744e3f9913653cafea3091 => generated 530 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 12:12:37.421389 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:12:37.500107 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483c3321-5bc5-4bfa-acc2-c0534bb56252 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:12:37.535062 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f2c9ba-240f-4a74-ad57-b83381d8a763 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:12:37.535718 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f2c9ba-240f-4a74-ad57-b83381d8a763 None admin] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:12:37.535999 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f2c9ba-240f-4a74-ad57-b83381d8a763 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:12:37.536277 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f2c9ba-240f-4a74-ad57-b83381d8a763 None admin] PATH_INFO: `/v3/projects` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:12:37.537036 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f2c9ba-240f-4a74-ad57-b83381d8a763 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:12:37.538511 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f2c9ba-240f-4a74-ad57-b83381d8a763 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:12:37.567140 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 29/57] 10.222.0.44 () {60 vars in 1140 bytes} [Thu Jun 16 12:12:37 2022] POST /identity/v3/projects => generated 298 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 12:12:39.678406 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0666b56b-dbdb-462c-87f5-c59aab1c195f None None] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:12:39.678919 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0666b56b-dbdb-462c-87f5-c59aab1c195f None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:12:39.679003 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0666b56b-dbdb-462c-87f5-c59aab1c195f None None] PATH_INFO: `/` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:12:39.680364 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 29/58] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 12:12:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 12:12:39.686492 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d073e0be-c87d-4bd9-ab80-919e54bc85de None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:12:39.686909 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d073e0be-c87d-4bd9-ab80-919e54bc85de None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:12:39.687127 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d073e0be-c87d-4bd9-ab80-919e54bc85de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:12:39.706808 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-d073e0be-c87d-4bd9-ab80-919e54bc85de None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:12:39.708261 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-d073e0be-c87d-4bd9-ab80-919e54bc85de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:12:39.773158 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 30/59] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 12:12:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 12:12:39.797408 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0666b56b-dbdb-462c-87f5-c59aab1c195f None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:12:39.848297 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:12:39.897678 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0666b56b-dbdb-462c-87f5-c59aab1c195f None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:12:39.930484 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54f888e-03a8-4dbd-abf6-fa8331170426 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:12:39.931828 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54f888e-03a8-4dbd-abf6-fa8331170426 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:12:39.932110 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54f888e-03a8-4dbd-abf6-fa8331170426 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:12:39.932384 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54f888e-03a8-4dbd-abf6-fa8331170426 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:12:39.933613 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54f888e-03a8-4dbd-abf6-fa8331170426 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:12:39.935086 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54f888e-03a8-4dbd-abf6-fa8331170426 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:12:39.936697 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 30/60] 10.222.0.44 () {56 vars in 1108 bytes} [Thu Jun 16 12:12:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:12:39.942076 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d073e0be-c87d-4bd9-ab80-919e54bc85de None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:12:39.945169 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:12:40.036855 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d073e0be-c87d-4bd9-ab80-919e54bc85de None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:12:40.069784 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309205ed-8443-4ef8-b80a-8d69ecb7cc28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:12:40.070469 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309205ed-8443-4ef8-b80a-8d69ecb7cc28 None admin] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:12:40.070752 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309205ed-8443-4ef8-b80a-8d69ecb7cc28 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:12:40.071025 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309205ed-8443-4ef8-b80a-8d69ecb7cc28 None admin] PATH_INFO: `/v3/users` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:12:40.071736 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309205ed-8443-4ef8-b80a-8d69ecb7cc28 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:12:40.073205 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309205ed-8443-4ef8-b80a-8d69ecb7cc28 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:12:40.096626 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 31/61] 10.222.0.44 () {60 vars in 1132 bytes} [Thu Jun 16 12:12:39 2022] POST /identity/v3/users => generated 275 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 12:12:43.359992 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d377a9cf-e6d8-48ec-85bd-ca56c463b895 None None] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:12:43.360553 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d377a9cf-e6d8-48ec-85bd-ca56c463b895 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:12:43.360553 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d377a9cf-e6d8-48ec-85bd-ca56c463b895 None None] PATH_INFO: `/` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:12:43.361975 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 31/62] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 12:12:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 12:12:43.367888 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13025e6f-5ac4-498b-be7e-947ea43a2d95 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:12:43.369406 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13025e6f-5ac4-498b-be7e-947ea43a2d95 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:12:43.369916 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13025e6f-5ac4-498b-be7e-947ea43a2d95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:12:43.398013 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-13025e6f-5ac4-498b-be7e-947ea43a2d95 None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:12:43.399647 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-13025e6f-5ac4-498b-be7e-947ea43a2d95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:12:43.438888 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8357547e-97cc-4512-8587-0e93e7d73ce8 None None] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:12:43.439608 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8357547e-97cc-4512-8587-0e93e7d73ce8 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:12:43.440189 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8357547e-97cc-4512-8587-0e93e7d73ce8 None None] PATH_INFO: `/` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:12:43.441893 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 32/63] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 12:12:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 12:12:43.447889 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b9531c-61ae-44db-9bc4-a11918ad284d None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:12:43.448438 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b9531c-61ae-44db-9bc4-a11918ad284d None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:12:43.448948 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b9531c-61ae-44db-9bc4-a11918ad284d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:12:43.465780 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-30b9531c-61ae-44db-9bc4-a11918ad284d None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:12:43.467358 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-30b9531c-61ae-44db-9bc4-a11918ad284d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:12:43.473714 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:12:43.491299 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 32/64] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 12:12:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 12:12:43.493840 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba4a8ea-3a06-49b5-a9c7-7bfdeec2bc26 None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:12:43.494334 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba4a8ea-3a06-49b5-a9c7-7bfdeec2bc26 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:12:43.495054 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba4a8ea-3a06-49b5-a9c7-7bfdeec2bc26 None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:12:43.497289 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 33/65] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 12:12:43 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 12:12:43.503239 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b4454d-fe58-426a-a5b3-c076bc2c690a None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:12:43.503522 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b4454d-fe58-426a-a5b3-c076bc2c690a None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:12:43.503797 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b4454d-fe58-426a-a5b3-c076bc2c690a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:12:43.533372 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-05b4454d-fe58-426a-a5b3-c076bc2c690a None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:12:43.534779 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-05b4454d-fe58-426a-a5b3-c076bc2c690a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:12:43.549253 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 33/66] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 12:12:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 12:12:43.558062 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b9531c-61ae-44db-9bc4-a11918ad284d None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:12:43.611860 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:12:43.627767 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 34/67] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 12:12:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 12:12:43.628997 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b4454d-fe58-426a-a5b3-c076bc2c690a None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:12:43.695300 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b9531c-61ae-44db-9bc4-a11918ad284d None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:12:43.731432 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7555ca21-13cf-4be7-848c-d477700dc3a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:12:43.732470 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7555ca21-13cf-4be7-848c-d477700dc3a0 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:12:43.732610 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b4454d-fe58-426a-a5b3-c076bc2c690a None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:12:43.733046 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7555ca21-13cf-4be7-848c-d477700dc3a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:12:43.733462 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7555ca21-13cf-4be7-848c-d477700dc3a0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:12:43.746108 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7555ca21-13cf-4be7-848c-d477700dc3a0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 12:12:43.755449 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application [None req-7555ca21-13cf-4be7-848c-d477700dc3a0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 12:12:43.755449 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 12:12:43.755449 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 12:12:43.755449 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 12:12:43.755449 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 12:12:43.755449 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 12:12:43.755449 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 12:12:43.755449 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 12:12:43.755449 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 12:12:43.755449 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 12:12:43.755449 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 12:12:43.755449 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 12:12:43.755449 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 12:12:43.755449 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 12:12:43.755449 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 12:12:43.755449 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 12:12:43.756461 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 12:12:43.756461 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 12:12:43.756461 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 12:12:43.756461 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 12:12:43.756461 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 12:12:43.756461 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 12:12:43.756461 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 12:12:43.756461 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 12:12:43.756461 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 12:12:43.756461 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 12:12:43.756461 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 12:12:43.756461 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application with Lock( Jun 16 12:12:43.756461 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 12:12:43.756461 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._enter() Jun 16 12:12:43.756461 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 12:12:43.756461 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 12:12:43.757274 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 12:12:43.757274 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.creator() Jun 16 12:12:43.757274 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 12:12:43.757274 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application created_value = creator( Jun 16 12:12:43.757274 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 12:12:43.757274 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 12:12:43.757274 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 12:12:43.757274 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 12:12:43.757274 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 12:12:43.757274 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 12:12:43.757274 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 12:12:43.757274 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application Jun 16 12:12:43.759844 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 34/68] 10.222.0.44 () {56 vars in 1096 bytes} [Thu Jun 16 12:12:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 12:12:43.761127 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7555ca21-13cf-4be7-848c-d477700dc3a0 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:12:43.769285 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:12:43.777628 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5993ed3-bd3e-4c10-bdc3-8fd088670229 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:12:43.778591 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5993ed3-bd3e-4c10-bdc3-8fd088670229 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:12:43.778941 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5993ed3-bd3e-4c10-bdc3-8fd088670229 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:12:43.779380 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5993ed3-bd3e-4c10-bdc3-8fd088670229 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:12:43.792078 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5993ed3-bd3e-4c10-bdc3-8fd088670229 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 12:12:43.800855 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-c5993ed3-bd3e-4c10-bdc3-8fd088670229 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 12:12:43.800855 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 12:12:43.800855 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 12:12:43.800855 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 12:12:43.800855 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 12:12:43.800855 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 12:12:43.800855 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 12:12:43.800855 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 12:12:43.800855 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 12:12:43.800855 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 12:12:43.800855 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 12:12:43.800855 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 12:12:43.800855 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 12:12:43.800855 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 12:12:43.800855 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 12:12:43.800855 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 12:12:43.801731 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 12:12:43.801731 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 12:12:43.801731 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 12:12:43.801731 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 12:12:43.801731 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 12:12:43.801731 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 12:12:43.801731 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 12:12:43.801731 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 12:12:43.801731 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 12:12:43.801731 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 12:12:43.801731 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 12:12:43.801731 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jun 16 12:12:43.801731 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 12:12:43.801731 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jun 16 12:12:43.801731 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 12:12:43.801731 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 12:12:43.802472 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 12:12:43.802472 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jun 16 12:12:43.802472 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 12:12:43.802472 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jun 16 12:12:43.802472 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 12:12:43.802472 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 12:12:43.802472 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 12:12:43.802472 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 12:12:43.802472 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 12:12:43.802472 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 12:12:43.802472 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 12:12:43.802472 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jun 16 12:12:43.805358 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 35/69] 10.222.0.44 () {56 vars in 1114 bytes} [Thu Jun 16 12:12:43 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 12:12:43.811348 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5993ed3-bd3e-4c10-bdc3-8fd088670229 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:12:43.881671 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7555ca21-13cf-4be7-848c-d477700dc3a0 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:12:43.891920 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:12:43.920795 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6132656-01a8-4655-86f3-dfeb4fa78b64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:12:43.921828 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6132656-01a8-4655-86f3-dfeb4fa78b64 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:12:43.922257 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6132656-01a8-4655-86f3-dfeb4fa78b64 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:12:43.923025 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5993ed3-bd3e-4c10-bdc3-8fd088670229 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:12:43.923394 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6132656-01a8-4655-86f3-dfeb4fa78b64 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:12:43.938821 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6132656-01a8-4655-86f3-dfeb4fa78b64 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 12:12:43.947164 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application [None req-c6132656-01a8-4655-86f3-dfeb4fa78b64 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 16 12:12:43.947164 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 12:12:43.947164 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 12:12:43.947164 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 12:12:43.947164 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 12:12:43.947164 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 12:12:43.947164 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 12:12:43.947164 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 12:12:43.947164 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 12:12:43.947164 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 12:12:43.947164 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 12:12:43.947164 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 12:12:43.947164 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 12:12:43.947164 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 12:12:43.947164 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 12:12:43.947164 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 12:12:43.948286 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 12:12:43.948286 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 12:12:43.948286 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 12:12:43.948286 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 12:12:43.948286 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 12:12:43.948286 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 12:12:43.948286 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 12:12:43.948286 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 12:12:43.948286 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 12:12:43.948286 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 12:12:43.948286 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 12:12:43.948286 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application with Lock( Jun 16 12:12:43.948286 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 12:12:43.948286 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._enter() Jun 16 12:12:43.948286 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 12:12:43.948286 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 12:12:43.949279 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 12:12:43.949279 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.creator() Jun 16 12:12:43.949279 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 12:12:43.949279 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application created_value = creator( Jun 16 12:12:43.949279 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 12:12:43.949279 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 12:12:43.949279 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 12:12:43.949279 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 12:12:43.949279 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 12:12:43.949279 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 12:12:43.949279 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 16 12:12:43.949279 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application Jun 16 12:12:43.951418 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 35/70] 10.222.0.44 () {56 vars in 1099 bytes} [Thu Jun 16 12:12:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 12:12:43.952530 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6132656-01a8-4655-86f3-dfeb4fa78b64 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:12:43.970763 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8b02ff-1973-4307-a810-91b0ce922113 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:12:43.971582 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8b02ff-1973-4307-a810-91b0ce922113 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:12:43.971936 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8b02ff-1973-4307-a810-91b0ce922113 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:12:43.972284 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8b02ff-1973-4307-a810-91b0ce922113 None admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:12:43.973182 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8b02ff-1973-4307-a810-91b0ce922113 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:12:43.973568 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8b02ff-1973-4307-a810-91b0ce922113 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:12:43.975051 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8b02ff-1973-4307-a810-91b0ce922113 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:12:43.984705 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 36/71] 10.222.0.44 () {56 vars in 1099 bytes} [Thu Jun 16 12:12:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:12:43.986044 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fd5ce9-c17c-4f86-9ce9-e0c270649764 None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:12:43.986337 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fd5ce9-c17c-4f86-9ce9-e0c270649764 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:12:43.986619 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fd5ce9-c17c-4f86-9ce9-e0c270649764 None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:12:43.988051 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 37/72] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 12:12:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 12:12:43.992432 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fd5ce9-c17c-4f86-9ce9-e0c270649764 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:12:44.037246 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:12:44.063938 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6132656-01a8-4655-86f3-dfeb4fa78b64 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:12:44.093814 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fd5ce9-c17c-4f86-9ce9-e0c270649764 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:12:44.096364 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e02a5c-4b12-4296-b389-b6119ec71182 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:12:44.097062 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e02a5c-4b12-4296-b389-b6119ec71182 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:12:44.097349 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e02a5c-4b12-4296-b389-b6119ec71182 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:12:44.097629 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e02a5c-4b12-4296-b389-b6119ec71182 None admin] PATH_INFO: `/v3/roles` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:12:44.098378 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e02a5c-4b12-4296-b389-b6119ec71182 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:12:44.098692 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e02a5c-4b12-4296-b389-b6119ec71182 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:12:44.100072 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e02a5c-4b12-4296-b389-b6119ec71182 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:12:44.108365 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 36/73] 10.222.0.44 () {56 vars in 1111 bytes} [Thu Jun 16 12:12:43 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:12:44.109382 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e02a5c-4b12-4296-b389-b6119ec71182 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:12:44.128027 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be931831-a2be-40ee-bd1e-48cb8cad8b66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:12:44.128688 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be931831-a2be-40ee-bd1e-48cb8cad8b66 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:12:44.129004 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be931831-a2be-40ee-bd1e-48cb8cad8b66 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:12:44.129277 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be931831-a2be-40ee-bd1e-48cb8cad8b66 None admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:12:44.130017 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be931831-a2be-40ee-bd1e-48cb8cad8b66 None admin] RBAC: Adding query filter params (name=member) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:12:44.130320 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be931831-a2be-40ee-bd1e-48cb8cad8b66 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:12:44.131733 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be931831-a2be-40ee-bd1e-48cb8cad8b66 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:12:44.140174 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 38/74] 10.222.0.44 () {56 vars in 1101 bytes} [Thu Jun 16 12:12:43 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:12:44.141253 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb9bc77-426d-4645-85e0-b707e088a8df None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:12:44.141537 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb9bc77-426d-4645-85e0-b707e088a8df None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:12:44.141801 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb9bc77-426d-4645-85e0-b707e088a8df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:12:44.142407 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:12:44.158202 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-afb9bc77-426d-4645-85e0-b707e088a8df None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:12:44.159381 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-afb9bc77-426d-4645-85e0-b707e088a8df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:12:44.218876 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e02a5c-4b12-4296-b389-b6119ec71182 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:12:44.229115 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 39/75] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 12:12:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 12:12:44.230216 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5362ea4-e7ec-4fab-bd0a-349a9f13475e None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:12:44.230503 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5362ea4-e7ec-4fab-bd0a-349a9f13475e None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:12:44.230776 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5362ea4-e7ec-4fab-bd0a-349a9f13475e None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:12:44.232040 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 40/76] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 12:12:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 12:12:44.232879 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5362ea4-e7ec-4fab-bd0a-349a9f13475e None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:12:44.269161 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d45d1f2-72ad-4c6e-9f95-e74b98f60ead None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:12:44.270039 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d45d1f2-72ad-4c6e-9f95-e74b98f60ead None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:12:44.270142 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:12:44.270315 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d45d1f2-72ad-4c6e-9f95-e74b98f60ead None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:12:44.270775 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d45d1f2-72ad-4c6e-9f95-e74b98f60ead None admin] PATH_INFO: `/v3/users/63ec8f96a497486a9d373a6514f7d0be` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:12:44.271866 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d45d1f2-72ad-4c6e-9f95-e74b98f60ead None admin] RBAC: Authorizing `identity:get_user(user_id=63ec8f96a497486a9d373a6514f7d0be)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:12:44.273369 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d45d1f2-72ad-4c6e-9f95-e74b98f60ead None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:12:44.275561 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 37/77] 10.222.0.44 () {56 vars in 1177 bytes} [Thu Jun 16 12:12:44 2022] GET /identity/v3/users/63ec8f96a497486a9d373a6514f7d0be => generated 247 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:12:44.276323 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d45d1f2-72ad-4c6e-9f95-e74b98f60ead None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:12:44.339453 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5362ea4-e7ec-4fab-bd0a-349a9f13475e None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:12:44.369259 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:12:44.371931 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa0b51d-990f-48eb-89a1-62a65cb12eb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:12:44.372852 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa0b51d-990f-48eb-89a1-62a65cb12eb3 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:12:44.373136 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa0b51d-990f-48eb-89a1-62a65cb12eb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:12:44.373230 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d45d1f2-72ad-4c6e-9f95-e74b98f60ead None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:12:44.373404 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa0b51d-990f-48eb-89a1-62a65cb12eb3 None admin] PATH_INFO: `/v3/users/057c3bd7c27f458f8c008fb91e974956` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:12:44.386898 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa0b51d-990f-48eb-89a1-62a65cb12eb3 None admin] RBAC: Authorizing `identity:get_user(user_id=057c3bd7c27f458f8c008fb91e974956)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:12:44.388297 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa0b51d-990f-48eb-89a1-62a65cb12eb3 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:12:44.389965 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 41/78] 10.222.0.44 () {56 vars in 1177 bytes} [Thu Jun 16 12:12:44 2022] GET /identity/v3/users/057c3bd7c27f458f8c008fb91e974956 => generated 275 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:12:44.391109 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e27c3a7-ddf6-4b95-baf3-700fc6a2ef34 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:12:44.391390 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e27c3a7-ddf6-4b95-baf3-700fc6a2ef34 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:12:44.391664 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e27c3a7-ddf6-4b95-baf3-700fc6a2ef34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:12:44.407645 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d0deb6-6de7-4946-b0bb-5277142d0ee0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:12:44.408121 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-7e27c3a7-ddf6-4b95-baf3-700fc6a2ef34 None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:12:44.408513 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d0deb6-6de7-4946-b0bb-5277142d0ee0 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:12:44.408818 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d0deb6-6de7-4946-b0bb-5277142d0ee0 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:12:44.409096 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d0deb6-6de7-4946-b0bb-5277142d0ee0 None admin] PATH_INFO: `/v3/users/057c3bd7c27f458f8c008fb91e974956` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:12:44.409331 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-7e27c3a7-ddf6-4b95-baf3-700fc6a2ef34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:12:44.410294 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d0deb6-6de7-4946-b0bb-5277142d0ee0 None admin] RBAC: Authorizing `identity:get_user(user_id=057c3bd7c27f458f8c008fb91e974956)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:12:44.411720 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d0deb6-6de7-4946-b0bb-5277142d0ee0 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:12:44.413373 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 38/79] 10.222.0.44 () {56 vars in 1177 bytes} [Thu Jun 16 12:12:44 2022] GET /identity/v3/users/057c3bd7c27f458f8c008fb91e974956 => generated 275 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:12:44.414128 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d0deb6-6de7-4946-b0bb-5277142d0ee0 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:12:44.475574 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 42/80] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 12:12:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 12:12:44.476389 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e27c3a7-ddf6-4b95-baf3-700fc6a2ef34 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:12:44.504719 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:12:44.512629 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d0deb6-6de7-4946-b0bb-5277142d0ee0 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:12:44.546458 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4f6c95-d3b3-468e-b2f1-7b15707b2517 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:12:44.547248 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4f6c95-d3b3-468e-b2f1-7b15707b2517 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:12:44.547530 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4f6c95-d3b3-468e-b2f1-7b15707b2517 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:12:44.547804 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4f6c95-d3b3-468e-b2f1-7b15707b2517 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:12:44.558463 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4f6c95-d3b3-468e-b2f1-7b15707b2517 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 12:12:44.566033 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application [None req-7e4f6c95-d3b3-468e-b2f1-7b15707b2517 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 16 12:12:44.566033 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 12:12:44.566033 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 12:12:44.566033 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 12:12:44.566033 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 12:12:44.566033 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 12:12:44.566033 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 12:12:44.566033 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 12:12:44.566033 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 12:12:44.566033 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 12:12:44.566033 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 12:12:44.566033 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 12:12:44.566033 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 12:12:44.566033 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 12:12:44.566033 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 12:12:44.566033 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 12:12:44.566978 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 12:12:44.566978 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 12:12:44.566978 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 12:12:44.566978 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 12:12:44.566978 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 12:12:44.566978 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 12:12:44.566978 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 12:12:44.566978 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 12:12:44.566978 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 12:12:44.566978 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 12:12:44.566978 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 12:12:44.566978 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application with Lock( Jun 16 12:12:44.566978 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 12:12:44.566978 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._enter() Jun 16 12:12:44.566978 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 12:12:44.566978 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 12:12:44.567726 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 12:12:44.567726 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.creator() Jun 16 12:12:44.567726 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 12:12:44.567726 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application created_value = creator( Jun 16 12:12:44.567726 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 12:12:44.567726 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 12:12:44.567726 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 12:12:44.567726 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 12:12:44.567726 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 12:12:44.567726 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 12:12:44.567726 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 16 12:12:44.567726 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application Jun 16 12:12:44.567726 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 39/81] 10.222.0.44 () {56 vars in 1099 bytes} [Thu Jun 16 12:12:44 2022] GET /identity/v3/roles/member => generated 84 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 12:12:44.568338 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4f6c95-d3b3-468e-b2f1-7b15707b2517 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:12:44.583525 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e27c3a7-ddf6-4b95-baf3-700fc6a2ef34 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:12:44.595073 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:12:44.617065 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a288ab76-8c5d-4046-966e-797f02da10fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:12:44.617709 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a288ab76-8c5d-4046-966e-797f02da10fa None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:12:44.618049 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a288ab76-8c5d-4046-966e-797f02da10fa None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:12:44.618826 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a288ab76-8c5d-4046-966e-797f02da10fa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:12:44.668526 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4f6c95-d3b3-468e-b2f1-7b15707b2517 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:12:44.684932 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a288ab76-8c5d-4046-966e-797f02da10fa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:12:44.686397 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a288ab76-8c5d-4046-966e-797f02da10fa None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:12:44.701859 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53e9e07-410b-42c0-9365-bf607951bd54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:12:44.702499 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53e9e07-410b-42c0-9365-bf607951bd54 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:12:44.702782 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53e9e07-410b-42c0-9365-bf607951bd54 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:12:44.703059 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53e9e07-410b-42c0-9365-bf607951bd54 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:12:44.708595 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:12:44.768218 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53e9e07-410b-42c0-9365-bf607951bd54 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:12:44.769720 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53e9e07-410b-42c0-9365-bf607951bd54 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:12:44.784513 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 43/82] 10.222.0.44 () {58 vars in 1282 bytes} [Thu Jun 16 12:12:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 12:12:44.785373 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a288ab76-8c5d-4046-966e-797f02da10fa None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:12:44.796646 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:12:44.868613 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 40/83] 10.222.0.44 () {58 vars in 1282 bytes} [Thu Jun 16 12:12:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 12:12:44.869485 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53e9e07-410b-42c0-9365-bf607951bd54 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:12:44.885524 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a288ab76-8c5d-4046-966e-797f02da10fa None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:12:44.907860 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:12:44.920877 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c144a54b-40f3-47b7-9e04-fbe0be17ab59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:12:44.921518 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c144a54b-40f3-47b7-9e04-fbe0be17ab59 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:12:44.921877 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c144a54b-40f3-47b7-9e04-fbe0be17ab59 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:12:44.922069 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c144a54b-40f3-47b7-9e04-fbe0be17ab59 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:12:44.968155 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53e9e07-410b-42c0-9365-bf607951bd54 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:12:44.987912 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c144a54b-40f3-47b7-9e04-fbe0be17ab59 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:12:44.989426 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c144a54b-40f3-47b7-9e04-fbe0be17ab59 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:12:44.993441 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:12:45.002106 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc9120d-13ab-4129-a718-38ab1d6a07e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:12:45.002895 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc9120d-13ab-4129-a718-38ab1d6a07e7 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:12:45.003172 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc9120d-13ab-4129-a718-38ab1d6a07e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:12:45.003446 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc9120d-13ab-4129-a718-38ab1d6a07e7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:12:45.004612 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc9120d-13ab-4129-a718-38ab1d6a07e7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:12:45.006129 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc9120d-13ab-4129-a718-38ab1d6a07e7 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:12:45.007720 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 41/84] 10.222.0.44 () {56 vars in 1108 bytes} [Thu Jun 16 12:12:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:12:45.008478 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc9120d-13ab-4129-a718-38ab1d6a07e7 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:12:45.089167 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 44/85] 10.222.0.44 () {58 vars in 1282 bytes} [Thu Jun 16 12:12:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 12:12:45.090010 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c144a54b-40f3-47b7-9e04-fbe0be17ab59 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:12:45.110305 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc9120d-13ab-4129-a718-38ab1d6a07e7 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:12:45.112246 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:12:45.143285 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6a77f5-a522-4777-abba-2546a831a971 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:12:45.143948 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6a77f5-a522-4777-abba-2546a831a971 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:12:45.144232 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6a77f5-a522-4777-abba-2546a831a971 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:12:45.144518 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6a77f5-a522-4777-abba-2546a831a971 None admin] PATH_INFO: `/v3/roles` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:12:45.145298 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6a77f5-a522-4777-abba-2546a831a971 None admin] RBAC: Adding query filter params (name=member) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:12:45.145606 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6a77f5-a522-4777-abba-2546a831a971 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:12:45.146970 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6a77f5-a522-4777-abba-2546a831a971 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:12:45.155359 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 42/86] 10.222.0.44 () {56 vars in 1101 bytes} [Thu Jun 16 12:12:45 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:12:45.156136 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6a77f5-a522-4777-abba-2546a831a971 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:12:45.187337 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c144a54b-40f3-47b7-9e04-fbe0be17ab59 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:12:45.210238 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:12:45.221327 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddf68f2-7347-4f07-a17a-f0ba43632d6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:12:45.222197 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddf68f2-7347-4f07-a17a-f0ba43632d6d None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:12:45.222475 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddf68f2-7347-4f07-a17a-f0ba43632d6d None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:12:45.222751 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddf68f2-7347-4f07-a17a-f0ba43632d6d None admin] PATH_INFO: `/v3/projects/02e13d55192e4bfc8385150aa7249e83` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:12:45.223953 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddf68f2-7347-4f07-a17a-f0ba43632d6d None admin] RBAC: Authorizing `identity:get_project(project_id=02e13d55192e4bfc8385150aa7249e83)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:12:45.225467 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddf68f2-7347-4f07-a17a-f0ba43632d6d None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:12:45.227159 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 45/87] 10.222.0.44 () {56 vars in 1186 bytes} [Thu Jun 16 12:12:45 2022] GET /identity/v3/projects/02e13d55192e4bfc8385150aa7249e83 => generated 298 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:12:45.227934 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddf68f2-7347-4f07-a17a-f0ba43632d6d None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:12:45.255133 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6a77f5-a522-4777-abba-2546a831a971 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:12:45.288997 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cedfa1c-d79b-46f4-8ea2-c5aa1714d28c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:12:45.289873 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cedfa1c-d79b-46f4-8ea2-c5aa1714d28c None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:12:45.290161 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cedfa1c-d79b-46f4-8ea2-c5aa1714d28c None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:12:45.290442 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cedfa1c-d79b-46f4-8ea2-c5aa1714d28c None admin] PATH_INFO: `/v3/projects/02e13d55192e4bfc8385150aa7249e83` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:12:45.291656 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cedfa1c-d79b-46f4-8ea2-c5aa1714d28c None admin] RBAC: Authorizing `identity:get_project(project_id=02e13d55192e4bfc8385150aa7249e83)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:12:45.293144 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cedfa1c-d79b-46f4-8ea2-c5aa1714d28c None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:12:45.295102 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 43/88] 10.222.0.44 () {56 vars in 1186 bytes} [Thu Jun 16 12:12:45 2022] GET /identity/v3/projects/02e13d55192e4bfc8385150aa7249e83 => generated 298 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:12:45.295868 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cedfa1c-d79b-46f4-8ea2-c5aa1714d28c None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:12:45.314776 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:12:45.325013 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddf68f2-7347-4f07-a17a-f0ba43632d6d None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:12:45.358257 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb3b5e4-e668-4ab6-aa7c-8b698eec88ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:12:45.358925 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb3b5e4-e668-4ab6-aa7c-8b698eec88ee None admin] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:12:45.359206 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb3b5e4-e668-4ab6-aa7c-8b698eec88ee None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:12:45.359481 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb3b5e4-e668-4ab6-aa7c-8b698eec88ee None admin] PATH_INFO: `/v3/users` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:12:45.360200 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb3b5e4-e668-4ab6-aa7c-8b698eec88ee None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:12:45.361672 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb3b5e4-e668-4ab6-aa7c-8b698eec88ee None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:12:45.380785 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 46/89] 10.222.0.44 () {60 vars in 1132 bytes} [Thu Jun 16 12:12:45 2022] POST /identity/v3/users => generated 289 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 12:12:45.381591 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb3b5e4-e668-4ab6-aa7c-8b698eec88ee None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:12:45.397062 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cedfa1c-d79b-46f4-8ea2-c5aa1714d28c None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:12:45.424063 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:12:45.436625 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e650e2-f95b-4480-946f-53cd154daf96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:12:45.437603 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e650e2-f95b-4480-946f-53cd154daf96 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:12:45.437837 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e650e2-f95b-4480-946f-53cd154daf96 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:12:45.438117 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e650e2-f95b-4480-946f-53cd154daf96 None admin] PATH_INFO: `/v3/projects/02e13d55192e4bfc8385150aa7249e83` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:12:45.439450 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e650e2-f95b-4480-946f-53cd154daf96 None admin] RBAC: Authorizing `identity:get_project(project_id=02e13d55192e4bfc8385150aa7249e83)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:12:45.441014 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e650e2-f95b-4480-946f-53cd154daf96 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:12:45.442869 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 44/90] 10.222.0.44 () {56 vars in 1186 bytes} [Thu Jun 16 12:12:45 2022] GET /identity/v3/projects/02e13d55192e4bfc8385150aa7249e83 => generated 298 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:12:45.443690 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e650e2-f95b-4480-946f-53cd154daf96 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:12:45.512851 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb3b5e4-e668-4ab6-aa7c-8b698eec88ee None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:12:45.552662 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19723e0a-de1b-49c5-9b04-36912206abca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:12:45.553265 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19723e0a-de1b-49c5-9b04-36912206abca None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:12:45.553542 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19723e0a-de1b-49c5-9b04-36912206abca None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:12:45.553816 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19723e0a-de1b-49c5-9b04-36912206abca None admin] PATH_INFO: `/v3/users/057c3bd7c27f458f8c008fb91e974956` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:12:45.555026 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19723e0a-de1b-49c5-9b04-36912206abca None admin] RBAC: Authorizing `identity:get_user(user_id=057c3bd7c27f458f8c008fb91e974956)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:12:45.556820 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e650e2-f95b-4480-946f-53cd154daf96 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:12:45.557641 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19723e0a-de1b-49c5-9b04-36912206abca None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:12:45.559442 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 47/91] 10.222.0.44 () {56 vars in 1177 bytes} [Thu Jun 16 12:12:45 2022] GET /identity/v3/users/057c3bd7c27f458f8c008fb91e974956 => generated 275 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:12:45.560216 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19723e0a-de1b-49c5-9b04-36912206abca None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:12:45.580230 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:12:45.602840 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2a5c12-bc39-406a-9275-07f03c86a6d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:12:45.603503 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2a5c12-bc39-406a-9275-07f03c86a6d3 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:12:45.603785 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2a5c12-bc39-406a-9275-07f03c86a6d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:12:45.604062 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2a5c12-bc39-406a-9275-07f03c86a6d3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:12:45.604947 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2a5c12-bc39-406a-9275-07f03c86a6d3 None admin] RBAC: Adding query filter params (role.id=0688968254744e3f9913653cafea3091, scope.project.id=02e13d55192e4bfc8385150aa7249e83, user.id=63ec8f96a497486a9d373a6514f7d0be) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:12:45.605260 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2a5c12-bc39-406a-9275-07f03c86a6d3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:12:45.608164 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2a5c12-bc39-406a-9275-07f03c86a6d3 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:12:45.624781 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 45/92] 10.222.0.44 () {56 vars in 1374 bytes} [Thu Jun 16 12:12:45 2022] GET /identity/v3/role_assignments?user.id=63ec8f96a497486a9d373a6514f7d0be&scope.project.id=02e13d55192e4bfc8385150aa7249e83&role.id=0688968254744e3f9913653cafea3091 => generated 259 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:12:45.624781 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2a5c12-bc39-406a-9275-07f03c86a6d3 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:12:45.679338 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19723e0a-de1b-49c5-9b04-36912206abca None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:12:45.699809 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:12:45.729925 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af4096d-0f06-4231-9ef2-4506e32e7300 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:12:45.730605 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af4096d-0f06-4231-9ef2-4506e32e7300 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:12:45.730885 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af4096d-0f06-4231-9ef2-4506e32e7300 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:12:45.731160 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af4096d-0f06-4231-9ef2-4506e32e7300 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:12:45.732019 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af4096d-0f06-4231-9ef2-4506e32e7300 None admin] RBAC: Adding query filter params (role.id=e24b3707bc514b1fa606efab092047e6, scope.project.id=02e13d55192e4bfc8385150aa7249e83, user.id=057c3bd7c27f458f8c008fb91e974956) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:12:45.732328 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af4096d-0f06-4231-9ef2-4506e32e7300 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:12:45.735143 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af4096d-0f06-4231-9ef2-4506e32e7300 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:12:45.743839 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 48/93] 10.222.0.44 () {56 vars in 1374 bytes} [Thu Jun 16 12:12:45 2022] GET /identity/v3/role_assignments?user.id=057c3bd7c27f458f8c008fb91e974956&scope.project.id=02e13d55192e4bfc8385150aa7249e83&role.id=e24b3707bc514b1fa606efab092047e6 => generated 259 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:12:45.744900 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af4096d-0f06-4231-9ef2-4506e32e7300 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:12:45.763740 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2a5c12-bc39-406a-9275-07f03c86a6d3 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:12:45.805132 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6716d4-fef8-4a58-9d0d-f067c8079f17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:12:45.806337 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6716d4-fef8-4a58-9d0d-f067c8079f17 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:12:45.806621 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6716d4-fef8-4a58-9d0d-f067c8079f17 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:12:45.806891 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6716d4-fef8-4a58-9d0d-f067c8079f17 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:12:45.807752 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6716d4-fef8-4a58-9d0d-f067c8079f17 None admin] RBAC: Adding query filter params (role.id=c39882b202e942479a7cdac2fc6da72c, scope.project.id=02e13d55192e4bfc8385150aa7249e83, user.id=057c3bd7c27f458f8c008fb91e974956) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:12:45.808240 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6716d4-fef8-4a58-9d0d-f067c8079f17 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:12:45.809828 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6716d4-fef8-4a58-9d0d-f067c8079f17 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:12:45.817155 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 46/94] 10.222.0.44 () {56 vars in 1374 bytes} [Thu Jun 16 12:12:45 2022] GET /identity/v3/role_assignments?user.id=057c3bd7c27f458f8c008fb91e974956&scope.project.id=02e13d55192e4bfc8385150aa7249e83&role.id=c39882b202e942479a7cdac2fc6da72c => generated 259 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:12:45.853723 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:12:45.881942 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af4096d-0f06-4231-9ef2-4506e32e7300 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:12:45.923347 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b81b5b-697e-430c-a08d-06d51b660e51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:12:45.924028 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b81b5b-697e-430c-a08d-06d51b660e51 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:12:45.924311 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b81b5b-697e-430c-a08d-06d51b660e51 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:12:45.924590 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b81b5b-697e-430c-a08d-06d51b660e51 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:12:46.008440 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b81b5b-697e-430c-a08d-06d51b660e51 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:12:46.010114 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b81b5b-697e-430c-a08d-06d51b660e51 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:12:46.093136 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:12:46.115295 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 49/95] 10.222.0.44 () {58 vars in 1282 bytes} [Thu Jun 16 12:12:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 12:12:46.121973 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6716d4-fef8-4a58-9d0d-f067c8079f17 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:12:46.272428 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6716d4-fef8-4a58-9d0d-f067c8079f17 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:12:46.300687 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:12:46.315936 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869d24b3-6628-4f0c-a0dc-0e4cca40773b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:12:46.316832 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869d24b3-6628-4f0c-a0dc-0e4cca40773b None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:12:46.317115 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869d24b3-6628-4f0c-a0dc-0e4cca40773b None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:12:46.317389 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869d24b3-6628-4f0c-a0dc-0e4cca40773b None admin] PATH_INFO: `/v3/projects/05880ea4c4f744d2ae0ed40a19c054e7` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:12:46.321602 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869d24b3-6628-4f0c-a0dc-0e4cca40773b None admin] RBAC: Authorizing `identity:get_project(project_id=05880ea4c4f744d2ae0ed40a19c054e7)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:12:46.323058 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869d24b3-6628-4f0c-a0dc-0e4cca40773b None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:12:46.325103 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 47/96] 10.222.0.44 () {56 vars in 1186 bytes} [Thu Jun 16 12:12:46 2022] GET /identity/v3/projects/05880ea4c4f744d2ae0ed40a19c054e7 => generated 312 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:12:46.331894 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b81b5b-697e-430c-a08d-06d51b660e51 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:12:46.468691 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b81b5b-697e-430c-a08d-06d51b660e51 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:12:46.508284 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5013886-a181-4448-a88b-a1bb37f9caa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:12:46.509550 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5013886-a181-4448-a88b-a1bb37f9caa2 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:12:46.509826 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5013886-a181-4448-a88b-a1bb37f9caa2 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:12:46.510097 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5013886-a181-4448-a88b-a1bb37f9caa2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:12:46.510936 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5013886-a181-4448-a88b-a1bb37f9caa2 None admin] RBAC: Adding query filter params (role.id=c39882b202e942479a7cdac2fc6da72c, scope.project.id=05880ea4c4f744d2ae0ed40a19c054e7, user.id=057c3bd7c27f458f8c008fb91e974956) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:12:46.511243 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5013886-a181-4448-a88b-a1bb37f9caa2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:12:46.512706 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5013886-a181-4448-a88b-a1bb37f9caa2 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:12:46.518943 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 50/97] 10.222.0.44 () {56 vars in 1374 bytes} [Thu Jun 16 12:12:46 2022] GET /identity/v3/role_assignments?user.id=057c3bd7c27f458f8c008fb91e974956&scope.project.id=05880ea4c4f744d2ae0ed40a19c054e7&role.id=c39882b202e942479a7cdac2fc6da72c => generated 259 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:12:48.178946 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334b5d4f-1aed-4798-9b3f-4c745aedb4cb None None] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:12:48.179423 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334b5d4f-1aed-4798-9b3f-4c745aedb4cb None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:12:48.179423 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334b5d4f-1aed-4798-9b3f-4c745aedb4cb None None] PATH_INFO: `/` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:12:48.181092 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 48/98] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 12:12:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 12:12:48.186163 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17afef0-1300-433c-85b1-d514a1534cdd None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:12:48.186943 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17afef0-1300-433c-85b1-d514a1534cdd None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:12:48.187358 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17afef0-1300-433c-85b1-d514a1534cdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:12:48.210196 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-c17afef0-1300-433c-85b1-d514a1534cdd None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:12:48.211660 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-c17afef0-1300-433c-85b1-d514a1534cdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:12:48.253495 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:12:48.294234 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 51/99] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 12:12:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 12:12:48.317663 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334b5d4f-1aed-4798-9b3f-4c745aedb4cb None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:12:48.455264 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334b5d4f-1aed-4798-9b3f-4c745aedb4cb None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:12:48.503069 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c3489a-b838-48fd-bf07-e6d46affc8dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:12:48.503864 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c3489a-b838-48fd-bf07-e6d46affc8dd None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:12:48.504143 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c3489a-b838-48fd-bf07-e6d46affc8dd None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:12:48.504568 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c3489a-b838-48fd-bf07-e6d46affc8dd None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:12:48.519278 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c3489a-b838-48fd-bf07-e6d46affc8dd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 12:12:48.527754 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application [None req-51c3489a-b838-48fd-bf07-e6d46affc8dd None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 16 12:12:48.527754 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 12:12:48.527754 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 12:12:48.527754 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 12:12:48.527754 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 12:12:48.527754 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 12:12:48.527754 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 12:12:48.527754 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 12:12:48.527754 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 12:12:48.527754 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 12:12:48.527754 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 12:12:48.527754 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 12:12:48.527754 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 12:12:48.527754 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 12:12:48.527754 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 12:12:48.527754 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 12:12:48.528805 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 12:12:48.528805 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 12:12:48.528805 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 12:12:48.528805 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 12:12:48.528805 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 12:12:48.528805 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 12:12:48.528805 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 12:12:48.528805 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 12:12:48.528805 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 12:12:48.528805 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 12:12:48.528805 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 12:12:48.528805 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application with Lock( Jun 16 12:12:48.528805 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 12:12:48.528805 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._enter() Jun 16 12:12:48.528805 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 12:12:48.528805 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 12:12:48.529633 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 12:12:48.529633 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.creator() Jun 16 12:12:48.529633 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 12:12:48.529633 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application created_value = creator( Jun 16 12:12:48.529633 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 12:12:48.529633 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 12:12:48.529633 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 12:12:48.529633 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 12:12:48.529633 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 12:12:48.529633 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 12:12:48.529633 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 16 12:12:48.529633 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application Jun 16 12:12:48.529633 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 49/100] 10.222.0.44 () {56 vars in 1099 bytes} [Thu Jun 16 12:12:48 2022] GET /identity/v3/roles/reader => generated 84 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 12:12:48.534726 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17afef0-1300-433c-85b1-d514a1534cdd None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:12:48.687235 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17afef0-1300-433c-85b1-d514a1534cdd None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:12:48.734109 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb1987b-73e0-47a5-bc99-8e198f82620d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:12:48.735197 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb1987b-73e0-47a5-bc99-8e198f82620d None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:12:48.735672 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb1987b-73e0-47a5-bc99-8e198f82620d None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:12:48.736144 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb1987b-73e0-47a5-bc99-8e198f82620d None admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:12:48.737124 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb1987b-73e0-47a5-bc99-8e198f82620d None admin] RBAC: Adding query filter params (name=reader) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:12:48.737623 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb1987b-73e0-47a5-bc99-8e198f82620d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:12:48.739251 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb1987b-73e0-47a5-bc99-8e198f82620d None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:12:48.748541 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 52/101] 10.222.0.44 () {56 vars in 1101 bytes} [Thu Jun 16 12:12:48 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:12:48.754206 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c3489a-b838-48fd-bf07-e6d46affc8dd None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:12:48.819244 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97b15f5-e8d3-4b20-87fc-bf6cc4172c7a None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:12:48.819864 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97b15f5-e8d3-4b20-87fc-bf6cc4172c7a None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:12:48.820336 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97b15f5-e8d3-4b20-87fc-bf6cc4172c7a None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:12:48.822989 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 53/102] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 12:12:48 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 12:12:48.829310 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86f5c55-a74a-4700-8e1c-741330fa4a34 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:12:48.830187 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86f5c55-a74a-4700-8e1c-741330fa4a34 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:12:48.830663 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86f5c55-a74a-4700-8e1c-741330fa4a34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:12:48.831686 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:12:48.863333 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-c86f5c55-a74a-4700-8e1c-741330fa4a34 None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:12:48.864895 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-c86f5c55-a74a-4700-8e1c-741330fa4a34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:12:48.916785 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:12:48.955663 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 54/103] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 12:12:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 12:12:48.957339 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556738e4-9384-46b1-b4e9-2cf60270e4ad None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:12:48.958260 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556738e4-9384-46b1-b4e9-2cf60270e4ad None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:12:48.958744 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556738e4-9384-46b1-b4e9-2cf60270e4ad None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:12:48.960277 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 55/104] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 12:12:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 12:12:48.966516 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5655d3-201d-4da9-a0bb-9faf2d0c79b3 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:12:48.967046 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5655d3-201d-4da9-a0bb-9faf2d0c79b3 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:12:48.967533 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5655d3-201d-4da9-a0bb-9faf2d0c79b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:12:48.983656 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c3489a-b838-48fd-bf07-e6d46affc8dd None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:12:48.992968 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-fe5655d3-201d-4da9-a0bb-9faf2d0c79b3 None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:12:48.994557 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-fe5655d3-201d-4da9-a0bb-9faf2d0c79b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:12:49.018808 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f9ec6d-99e8-40ca-8a92-6beb38227973 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:12:49.019553 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f9ec6d-99e8-40ca-8a92-6beb38227973 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:12:49.019840 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f9ec6d-99e8-40ca-8a92-6beb38227973 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:12:49.020113 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f9ec6d-99e8-40ca-8a92-6beb38227973 None admin] PATH_INFO: `/v3/users/777678ad7bdb4716ad6ad7c9c3d3d0fe` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:12:49.037691 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f9ec6d-99e8-40ca-8a92-6beb38227973 None admin] RBAC: Authorizing `identity:get_user(user_id=777678ad7bdb4716ad6ad7c9c3d3d0fe)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:12:49.039169 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f9ec6d-99e8-40ca-8a92-6beb38227973 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:12:49.041259 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 50/105] 10.222.0.44 () {56 vars in 1177 bytes} [Thu Jun 16 12:12:48 2022] GET /identity/v3/users/777678ad7bdb4716ad6ad7c9c3d3d0fe => generated 289 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:12:49.042044 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f9ec6d-99e8-40ca-8a92-6beb38227973 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:12:49.077276 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 56/106] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 12:12:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 12:12:49.078584 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5655d3-201d-4da9-a0bb-9faf2d0c79b3 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:12:49.151191 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f9ec6d-99e8-40ca-8a92-6beb38227973 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:12:49.159897 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:12:49.190923 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abbfb3e-79af-4c85-915e-8a9463f73515 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:12:49.191783 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abbfb3e-79af-4c85-915e-8a9463f73515 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:12:49.192094 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abbfb3e-79af-4c85-915e-8a9463f73515 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:12:49.192384 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abbfb3e-79af-4c85-915e-8a9463f73515 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:12:49.193879 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:12:49.194296 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abbfb3e-79af-4c85-915e-8a9463f73515 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:12:49.197317 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abbfb3e-79af-4c85-915e-8a9463f73515 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:12:49.199923 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 51/107] 10.222.0.44 () {56 vars in 1108 bytes} [Thu Jun 16 12:12:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:12:49.201002 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abbfb3e-79af-4c85-915e-8a9463f73515 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:12:49.203708 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5655d3-201d-4da9-a0bb-9faf2d0c79b3 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:12:49.244844 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089f4dcc-8b61-4f1f-b1db-d62034890ccb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:12:49.246348 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089f4dcc-8b61-4f1f-b1db-d62034890ccb None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:12:49.246830 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089f4dcc-8b61-4f1f-b1db-d62034890ccb None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:12:49.247754 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089f4dcc-8b61-4f1f-b1db-d62034890ccb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:12:49.307000 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abbfb3e-79af-4c85-915e-8a9463f73515 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:12:49.330310 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089f4dcc-8b61-4f1f-b1db-d62034890ccb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:12:49.331797 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089f4dcc-8b61-4f1f-b1db-d62034890ccb None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:12:49.343329 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0e162a-f95f-4f93-8bb0-d0d6db1a77ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:12:49.344133 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0e162a-f95f-4f93-8bb0-d0d6db1a77ce None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:12:49.344412 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0e162a-f95f-4f93-8bb0-d0d6db1a77ce None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:12:49.344678 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0e162a-f95f-4f93-8bb0-d0d6db1a77ce None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:12:49.356310 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0e162a-f95f-4f93-8bb0-d0d6db1a77ce None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 12:12:49.364491 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application [None req-8c0e162a-f95f-4f93-8bb0-d0d6db1a77ce None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 12:12:49.364491 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 12:12:49.364491 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 12:12:49.364491 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 12:12:49.364491 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 12:12:49.364491 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 12:12:49.364491 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 12:12:49.364491 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 12:12:49.364491 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 12:12:49.364491 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 12:12:49.364491 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 12:12:49.364491 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 12:12:49.364491 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 12:12:49.364491 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 12:12:49.364491 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 12:12:49.364491 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 12:12:49.365588 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 12:12:49.365588 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 12:12:49.365588 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 12:12:49.365588 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 12:12:49.365588 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 12:12:49.365588 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 12:12:49.365588 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 12:12:49.365588 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 12:12:49.365588 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 12:12:49.365588 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 12:12:49.365588 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 12:12:49.365588 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application with Lock( Jun 16 12:12:49.365588 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 12:12:49.365588 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._enter() Jun 16 12:12:49.365588 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 12:12:49.365588 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 12:12:49.366397 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 12:12:49.366397 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.creator() Jun 16 12:12:49.366397 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 12:12:49.366397 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application created_value = creator( Jun 16 12:12:49.366397 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 12:12:49.366397 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 12:12:49.366397 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 12:12:49.366397 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 12:12:49.366397 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 12:12:49.366397 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 12:12:49.366397 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 12:12:49.366397 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application Jun 16 12:12:49.366397 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 52/108] 10.222.0.44 () {56 vars in 1114 bytes} [Thu Jun 16 12:12:49 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 12:12:49.367048 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223cb003-71e1-4634-883d-6cd816ed831a None None] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:12:49.367244 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223cb003-71e1-4634-883d-6cd816ed831a None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:12:49.367521 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223cb003-71e1-4634-883d-6cd816ed831a None None] PATH_INFO: `/` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:12:49.369500 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 53/109] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 12:12:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 12:12:49.370008 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223cb003-71e1-4634-883d-6cd816ed831a None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:12:49.409242 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:12:49.433563 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:12:49.441001 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 57/110] 10.222.0.44 () {58 vars in 1282 bytes} [Thu Jun 16 12:12:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 12:12:49.446606 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e239853a-da51-4219-8fb7-c4434459509b None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:12:49.446606 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e239853a-da51-4219-8fb7-c4434459509b None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:12:49.446606 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e239853a-da51-4219-8fb7-c4434459509b None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:12:49.446606 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 58/111] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 12:12:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 12:12:49.446606 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e239853a-da51-4219-8fb7-c4434459509b None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:12:49.487820 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223cb003-71e1-4634-883d-6cd816ed831a None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:12:49.524898 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ca2587-729c-4d31-92fd-7014bdefb7f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:12:49.525489 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ca2587-729c-4d31-92fd-7014bdefb7f7 None admin] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:12:49.525769 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ca2587-729c-4d31-92fd-7014bdefb7f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:12:49.526045 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ca2587-729c-4d31-92fd-7014bdefb7f7 None admin] PATH_INFO: `/v3/projects` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:12:49.526750 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ca2587-729c-4d31-92fd-7014bdefb7f7 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:12:49.528193 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ca2587-729c-4d31-92fd-7014bdefb7f7 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:12:49.553516 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 54/112] 10.222.0.44 () {60 vars in 1141 bytes} [Thu Jun 16 12:12:49 2022] POST /identity/v3/projects => generated 302 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 12:12:49.554397 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e239853a-da51-4219-8fb7-c4434459509b None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:12:49.554763 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4ea67f-82b8-466a-9ea0-2b0c34f2009b None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:12:49.555053 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4ea67f-82b8-466a-9ea0-2b0c34f2009b None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:12:49.555848 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4ea67f-82b8-466a-9ea0-2b0c34f2009b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:12:49.574203 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-3d4ea67f-82b8-466a-9ea0-2b0c34f2009b None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:12:49.575425 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-3d4ea67f-82b8-466a-9ea0-2b0c34f2009b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:12:49.608928 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacfd90a-5bf0-4e92-8038-17b67789c49b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:12:49.610642 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacfd90a-5bf0-4e92-8038-17b67789c49b None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:12:49.611267 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacfd90a-5bf0-4e92-8038-17b67789c49b None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:12:49.611789 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacfd90a-5bf0-4e92-8038-17b67789c49b None admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:12:49.612977 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacfd90a-5bf0-4e92-8038-17b67789c49b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:12:49.613535 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacfd90a-5bf0-4e92-8038-17b67789c49b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:12:49.615303 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacfd90a-5bf0-4e92-8038-17b67789c49b None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:12:49.629202 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 59/113] 10.222.0.44 () {56 vars in 1111 bytes} [Thu Jun 16 12:12:49 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:12:49.630410 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacfd90a-5bf0-4e92-8038-17b67789c49b None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:12:49.662437 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 55/114] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 12:12:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 12:12:49.670503 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4e48db-8f45-497d-b60d-d846caabcd8b None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:12:49.670705 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4e48db-8f45-497d-b60d-d846caabcd8b None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:12:49.671047 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4e48db-8f45-497d-b60d-d846caabcd8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:12:49.705118 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:12:49.705306 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-aa4e48db-8f45-497d-b60d-d846caabcd8b None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:12:49.706643 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-aa4e48db-8f45-497d-b60d-d846caabcd8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:12:49.720442 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:12:49.769150 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacfd90a-5bf0-4e92-8038-17b67789c49b None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:12:49.794795 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 56/115] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 12:12:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 12:12:49.796141 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4e48db-8f45-497d-b60d-d846caabcd8b None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:12:49.812111 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e222526f-5ddf-4f14-bed9-92cfbbb25236 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:12:49.813067 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e222526f-5ddf-4f14-bed9-92cfbbb25236 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:12:49.813349 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e222526f-5ddf-4f14-bed9-92cfbbb25236 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:12:49.813623 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e222526f-5ddf-4f14-bed9-92cfbbb25236 None admin] PATH_INFO: `/v3/projects/02e13d55192e4bfc8385150aa7249e83` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:12:49.814816 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e222526f-5ddf-4f14-bed9-92cfbbb25236 None admin] RBAC: Authorizing `identity:get_project(project_id=02e13d55192e4bfc8385150aa7249e83)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:12:49.816270 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e222526f-5ddf-4f14-bed9-92cfbbb25236 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:12:49.818161 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 60/116] 10.222.0.44 () {56 vars in 1186 bytes} [Thu Jun 16 12:12:49 2022] GET /identity/v3/projects/02e13d55192e4bfc8385150aa7249e83 => generated 298 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:12:49.818766 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e222526f-5ddf-4f14-bed9-92cfbbb25236 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:12:49.916499 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4e48db-8f45-497d-b60d-d846caabcd8b None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:12:49.948458 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e222526f-5ddf-4f14-bed9-92cfbbb25236 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:12:49.957545 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0bf95a-0304-4c01-a705-4ec7d16f4a1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:12:49.958555 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0bf95a-0304-4c01-a705-4ec7d16f4a1e None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:12:49.958938 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0bf95a-0304-4c01-a705-4ec7d16f4a1e None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:12:49.959216 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0bf95a-0304-4c01-a705-4ec7d16f4a1e None admin] PATH_INFO: `/v3/users/057c3bd7c27f458f8c008fb91e974956` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:12:49.960609 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0bf95a-0304-4c01-a705-4ec7d16f4a1e None admin] RBAC: Authorizing `identity:get_user(user_id=057c3bd7c27f458f8c008fb91e974956)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:12:49.962780 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0bf95a-0304-4c01-a705-4ec7d16f4a1e None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:12:49.964923 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 57/117] 10.222.0.44 () {56 vars in 1177 bytes} [Thu Jun 16 12:12:49 2022] GET /identity/v3/users/057c3bd7c27f458f8c008fb91e974956 => generated 275 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:12:49.965498 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0bf95a-0304-4c01-a705-4ec7d16f4a1e None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:12:49.975304 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:12:49.988134 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:12:49.989661 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1a53db-38d2-4eb1-be4e-af2519801178 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:12:49.990692 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1a53db-38d2-4eb1-be4e-af2519801178 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:12:49.991075 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1a53db-38d2-4eb1-be4e-af2519801178 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:12:49.991445 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1a53db-38d2-4eb1-be4e-af2519801178 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:12:50.004048 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1a53db-38d2-4eb1-be4e-af2519801178 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 12:12:50.012683 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-bb1a53db-38d2-4eb1-be4e-af2519801178 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 12:12:50.012683 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 12:12:50.012683 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 12:12:50.012683 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 12:12:50.012683 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 12:12:50.012683 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 12:12:50.012683 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 12:12:50.012683 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 12:12:50.012683 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 12:12:50.012683 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 12:12:50.012683 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 12:12:50.012683 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 12:12:50.012683 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 12:12:50.012683 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 12:12:50.012683 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 12:12:50.012683 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 12:12:50.013634 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 12:12:50.013634 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 12:12:50.013634 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 12:12:50.013634 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 12:12:50.013634 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 12:12:50.013634 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 12:12:50.013634 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 12:12:50.013634 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 12:12:50.013634 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 12:12:50.013634 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 12:12:50.013634 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 12:12:50.013634 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jun 16 12:12:50.013634 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 12:12:50.013634 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jun 16 12:12:50.013634 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 12:12:50.013634 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 12:12:50.016308 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 12:12:50.016308 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jun 16 12:12:50.016308 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 12:12:50.016308 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jun 16 12:12:50.016308 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 12:12:50.016308 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 12:12:50.016308 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 12:12:50.016308 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 12:12:50.016308 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 12:12:50.016308 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 12:12:50.016308 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 12:12:50.016308 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jun 16 12:12:50.016308 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 61/118] 10.222.0.44 () {56 vars in 1096 bytes} [Thu Jun 16 12:12:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 12:12:50.016308 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1a53db-38d2-4eb1-be4e-af2519801178 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:12:50.078504 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0bf95a-0304-4c01-a705-4ec7d16f4a1e None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:12:50.116206 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90262ab4-c658-4d2f-a978-be8bff8a441f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:12:50.117344 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90262ab4-c658-4d2f-a978-be8bff8a441f None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:12:50.117798 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90262ab4-c658-4d2f-a978-be8bff8a441f None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:12:50.118078 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90262ab4-c658-4d2f-a978-be8bff8a441f None admin] PATH_INFO: `/v3/roles/member` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:12:50.126303 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1a53db-38d2-4eb1-be4e-af2519801178 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:12:50.128164 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90262ab4-c658-4d2f-a978-be8bff8a441f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 12:12:50.135920 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application [None req-90262ab4-c658-4d2f-a978-be8bff8a441f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 16 12:12:50.135920 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 12:12:50.135920 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 12:12:50.135920 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 12:12:50.135920 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 12:12:50.135920 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 12:12:50.135920 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 12:12:50.135920 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 12:12:50.135920 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 12:12:50.135920 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 12:12:50.135920 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 12:12:50.135920 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 12:12:50.135920 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 12:12:50.135920 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 12:12:50.135920 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 12:12:50.135920 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 12:12:50.137007 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 12:12:50.137007 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 12:12:50.137007 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 12:12:50.137007 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 12:12:50.137007 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 12:12:50.137007 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 12:12:50.137007 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 12:12:50.137007 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 12:12:50.137007 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 12:12:50.137007 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 12:12:50.137007 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 12:12:50.137007 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application with Lock( Jun 16 12:12:50.137007 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 12:12:50.137007 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._enter() Jun 16 12:12:50.137007 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 12:12:50.137007 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 12:12:50.143086 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 12:12:50.143086 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.creator() Jun 16 12:12:50.143086 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 12:12:50.143086 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application created_value = creator( Jun 16 12:12:50.143086 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 12:12:50.143086 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 12:12:50.143086 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 12:12:50.143086 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 12:12:50.143086 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 12:12:50.143086 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 12:12:50.143086 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 16 12:12:50.143086 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application Jun 16 12:12:50.143086 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 58/119] 10.222.0.44 () {56 vars in 1099 bytes} [Thu Jun 16 12:12:49 2022] GET /identity/v3/roles/member => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 12:12:50.143086 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90262ab4-c658-4d2f-a978-be8bff8a441f None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:12:50.162864 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e34a205-5043-4c27-96ee-a112dc9554ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:12:50.163601 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e34a205-5043-4c27-96ee-a112dc9554ae None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:12:50.163952 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e34a205-5043-4c27-96ee-a112dc9554ae None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:12:50.164321 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e34a205-5043-4c27-96ee-a112dc9554ae None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:12:50.165872 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e34a205-5043-4c27-96ee-a112dc9554ae None admin] RBAC: Adding query filter params (role.id=8b8940c737364011a624755f642bf504, scope.project.id=02e13d55192e4bfc8385150aa7249e83, user.id=777678ad7bdb4716ad6ad7c9c3d3d0fe) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:12:50.166189 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e34a205-5043-4c27-96ee-a112dc9554ae None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:12:50.167648 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e34a205-5043-4c27-96ee-a112dc9554ae None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:12:50.180795 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 62/120] 10.222.0.44 () {56 vars in 1374 bytes} [Thu Jun 16 12:12:50 2022] GET /identity/v3/role_assignments?user.id=777678ad7bdb4716ad6ad7c9c3d3d0fe&scope.project.id=02e13d55192e4bfc8385150aa7249e83&role.id=8b8940c737364011a624755f642bf504 => generated 259 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:12:50.180795 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a578a9-0b55-4801-80c9-bedce0845a45 None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:12:50.180795 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a578a9-0b55-4801-80c9-bedce0845a45 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:12:50.180795 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a578a9-0b55-4801-80c9-bedce0845a45 None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:12:50.180795 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 63/121] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 12:12:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 12:12:50.180795 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a578a9-0b55-4801-80c9-bedce0845a45 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:12:50.246910 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:12:50.249913 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:12:50.283428 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90262ab4-c658-4d2f-a978-be8bff8a441f None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:12:50.314075 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a578a9-0b55-4801-80c9-bedce0845a45 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:12:50.339015 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527fa946-e6ff-4b2e-bea8-111a654bb63f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:12:50.339842 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527fa946-e6ff-4b2e-bea8-111a654bb63f None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:12:50.340125 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527fa946-e6ff-4b2e-bea8-111a654bb63f None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:12:50.340400 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527fa946-e6ff-4b2e-bea8-111a654bb63f None admin] PATH_INFO: `/v3/projects/02e13d55192e4bfc8385150aa7249e83` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:12:50.341998 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527fa946-e6ff-4b2e-bea8-111a654bb63f None admin] RBAC: Authorizing `identity:get_project(project_id=02e13d55192e4bfc8385150aa7249e83)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:12:50.344243 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527fa946-e6ff-4b2e-bea8-111a654bb63f None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:12:50.351184 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 59/122] 10.222.0.44 () {56 vars in 1186 bytes} [Thu Jun 16 12:12:50 2022] GET /identity/v3/projects/02e13d55192e4bfc8385150aa7249e83 => generated 298 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:12:50.351184 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527fa946-e6ff-4b2e-bea8-111a654bb63f None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:12:50.361952 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2234d595-af92-4fe6-b115-397336da43a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:12:50.362652 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2234d595-af92-4fe6-b115-397336da43a3 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:12:50.362907 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2234d595-af92-4fe6-b115-397336da43a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:12:50.363184 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2234d595-af92-4fe6-b115-397336da43a3 None admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:12:50.363943 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2234d595-af92-4fe6-b115-397336da43a3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:12:50.364248 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2234d595-af92-4fe6-b115-397336da43a3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:12:50.365691 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2234d595-af92-4fe6-b115-397336da43a3 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:12:50.381832 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 64/123] 10.222.0.44 () {56 vars in 1099 bytes} [Thu Jun 16 12:12:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:12:50.383061 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa166a4f-33e8-4cf4-9ced-1e3f84c71fbc None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:12:50.383349 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa166a4f-33e8-4cf4-9ced-1e3f84c71fbc None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:12:50.384188 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa166a4f-33e8-4cf4-9ced-1e3f84c71fbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:12:50.411007 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-fa166a4f-33e8-4cf4-9ced-1e3f84c71fbc None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:12:50.413189 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-fa166a4f-33e8-4cf4-9ced-1e3f84c71fbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:12:50.462720 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527fa946-e6ff-4b2e-bea8-111a654bb63f None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:12:50.498272 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582304c6-41b0-48e7-82d0-11d622bbd6b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:12:50.499085 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582304c6-41b0-48e7-82d0-11d622bbd6b5 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:12:50.499429 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582304c6-41b0-48e7-82d0-11d622bbd6b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:12:50.499704 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582304c6-41b0-48e7-82d0-11d622bbd6b5 None admin] PATH_INFO: `/v3/roles` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:12:50.500965 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582304c6-41b0-48e7-82d0-11d622bbd6b5 None admin] RBAC: Adding query filter params (name=member) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:12:50.501391 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582304c6-41b0-48e7-82d0-11d622bbd6b5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:12:50.502778 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582304c6-41b0-48e7-82d0-11d622bbd6b5 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:12:50.505557 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 65/124] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 12:12:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 12:12:50.506393 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa166a4f-33e8-4cf4-9ced-1e3f84c71fbc None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:12:50.524805 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 60/125] 10.222.0.44 () {56 vars in 1101 bytes} [Thu Jun 16 12:12:50 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:12:50.527362 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582304c6-41b0-48e7-82d0-11d622bbd6b5 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:12:50.535459 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:12:50.563357 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:12:50.623026 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa166a4f-33e8-4cf4-9ced-1e3f84c71fbc None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:12:50.645626 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582304c6-41b0-48e7-82d0-11d622bbd6b5 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:12:50.658178 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a449c176-3bd8-4ce2-9e0b-e515040ebfc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:12:50.659116 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a449c176-3bd8-4ce2-9e0b-e515040ebfc3 None admin] REQUEST_METHOD: `PUT` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:12:50.659398 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a449c176-3bd8-4ce2-9e0b-e515040ebfc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:12:50.659669 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a449c176-3bd8-4ce2-9e0b-e515040ebfc3 None admin] PATH_INFO: `/v3/projects/02e13d55192e4bfc8385150aa7249e83/users/057c3bd7c27f458f8c008fb91e974956/roles/e24b3707bc514b1fa606efab092047e6` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:12:50.661987 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a449c176-3bd8-4ce2-9e0b-e515040ebfc3 None admin] RBAC: Authorizing `identity:create_grant(project_id=02e13d55192e4bfc8385150aa7249e83, user_id=057c3bd7c27f458f8c008fb91e974956, role_id=e24b3707bc514b1fa606efab092047e6)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:12:50.663556 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a449c176-3bd8-4ce2-9e0b-e515040ebfc3 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:12:50.679469 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 66/126] 10.222.0.44 () {58 vars in 1439 bytes} [Thu Jun 16 12:12:50 2022] PUT /identity/v3/projects/02e13d55192e4bfc8385150aa7249e83/users/057c3bd7c27f458f8c008fb91e974956/roles/e24b3707bc514b1fa606efab092047e6 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:12:50.685202 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a449c176-3bd8-4ce2-9e0b-e515040ebfc3 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:12:50.711597 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f1ae34-50b4-4fac-ab00-2d02e5ea49b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:12:50.713505 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f1ae34-50b4-4fac-ab00-2d02e5ea49b2 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:12:50.714008 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f1ae34-50b4-4fac-ab00-2d02e5ea49b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:12:50.714508 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f1ae34-50b4-4fac-ab00-2d02e5ea49b2 None admin] PATH_INFO: `/v3/users/63ec8f96a497486a9d373a6514f7d0be` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:12:50.721741 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f1ae34-50b4-4fac-ab00-2d02e5ea49b2 None admin] RBAC: Authorizing `identity:get_user(user_id=63ec8f96a497486a9d373a6514f7d0be)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:12:50.723656 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f1ae34-50b4-4fac-ab00-2d02e5ea49b2 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:12:50.725741 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 61/127] 10.222.0.44 () {56 vars in 1177 bytes} [Thu Jun 16 12:12:50 2022] GET /identity/v3/users/63ec8f96a497486a9d373a6514f7d0be => generated 247 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:12:50.726876 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f1ae34-50b4-4fac-ab00-2d02e5ea49b2 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:12:50.800288 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a449c176-3bd8-4ce2-9e0b-e515040ebfc3 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:12:50.816561 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:12:50.841735 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44ab9fc-6395-47b1-b83f-d04bec9eb7c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:12:50.842819 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44ab9fc-6395-47b1-b83f-d04bec9eb7c8 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:12:50.843104 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44ab9fc-6395-47b1-b83f-d04bec9eb7c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:12:50.843428 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44ab9fc-6395-47b1-b83f-d04bec9eb7c8 None admin] PATH_INFO: `/v3/users/057c3bd7c27f458f8c008fb91e974956` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:12:50.845375 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44ab9fc-6395-47b1-b83f-d04bec9eb7c8 None admin] RBAC: Authorizing `identity:get_user(user_id=057c3bd7c27f458f8c008fb91e974956)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:12:50.846990 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44ab9fc-6395-47b1-b83f-d04bec9eb7c8 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:12:50.848959 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 67/128] 10.222.0.44 () {56 vars in 1177 bytes} [Thu Jun 16 12:12:50 2022] GET /identity/v3/users/057c3bd7c27f458f8c008fb91e974956 => generated 275 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:12:50.849745 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44ab9fc-6395-47b1-b83f-d04bec9eb7c8 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:12:50.865885 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:12:50.928187 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f1ae34-50b4-4fac-ab00-2d02e5ea49b2 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:12:50.980004 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a451ec33-9afc-4b97-acb8-34798680c378 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:12:50.980834 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a451ec33-9afc-4b97-acb8-34798680c378 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:12:50.981124 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a451ec33-9afc-4b97-acb8-34798680c378 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:12:50.981404 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a451ec33-9afc-4b97-acb8-34798680c378 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:12:51.000472 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a451ec33-9afc-4b97-acb8-34798680c378 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 12:12:51.008269 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application [None req-a451ec33-9afc-4b97-acb8-34798680c378 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 16 12:12:51.008269 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 12:12:51.008269 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 12:12:51.008269 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 12:12:51.008269 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 12:12:51.008269 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 12:12:51.008269 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 12:12:51.008269 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 12:12:51.008269 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 12:12:51.008269 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 12:12:51.008269 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 12:12:51.008269 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 12:12:51.008269 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 12:12:51.008269 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 12:12:51.008269 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 12:12:51.008269 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 12:12:51.009194 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 12:12:51.009194 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 12:12:51.009194 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 12:12:51.009194 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 12:12:51.009194 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 12:12:51.009194 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 12:12:51.009194 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 12:12:51.009194 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 12:12:51.009194 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 12:12:51.009194 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 12:12:51.009194 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 12:12:51.009194 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application with Lock( Jun 16 12:12:51.009194 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 12:12:51.009194 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._enter() Jun 16 12:12:51.009194 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 12:12:51.009194 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 12:12:51.009937 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 12:12:51.009937 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.creator() Jun 16 12:12:51.009937 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 12:12:51.009937 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application created_value = creator( Jun 16 12:12:51.009937 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 12:12:51.009937 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 12:12:51.009937 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 12:12:51.009937 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 12:12:51.009937 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 12:12:51.009937 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 12:12:51.009937 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 16 12:12:51.009937 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application Jun 16 12:12:51.009937 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 62/129] 10.222.0.44 () {56 vars in 1099 bytes} [Thu Jun 16 12:12:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 12:12:51.010643 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a451ec33-9afc-4b97-acb8-34798680c378 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:12:51.013217 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44ab9fc-6395-47b1-b83f-d04bec9eb7c8 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:12:51.068182 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fffbf6c-4f62-4158-a946-18d2e3ad0ee9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:12:51.069469 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fffbf6c-4f62-4158-a946-18d2e3ad0ee9 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:12:51.070103 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fffbf6c-4f62-4158-a946-18d2e3ad0ee9 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:12:51.073063 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fffbf6c-4f62-4158-a946-18d2e3ad0ee9 None admin] PATH_INFO: `/v3/projects/02e13d55192e4bfc8385150aa7249e83` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:12:51.075291 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fffbf6c-4f62-4158-a946-18d2e3ad0ee9 None admin] RBAC: Authorizing `identity:get_project(project_id=02e13d55192e4bfc8385150aa7249e83)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:12:51.078962 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fffbf6c-4f62-4158-a946-18d2e3ad0ee9 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:12:51.080968 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 68/130] 10.222.0.44 () {56 vars in 1186 bytes} [Thu Jun 16 12:12:50 2022] GET /identity/v3/projects/02e13d55192e4bfc8385150aa7249e83 => generated 298 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:12:51.084547 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fffbf6c-4f62-4158-a946-18d2e3ad0ee9 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:12:51.163296 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:12:51.212197 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fffbf6c-4f62-4158-a946-18d2e3ad0ee9 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:12:51.245568 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34b06a5-ee5d-4b8a-b922-35b7f2b327d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:12:51.246645 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34b06a5-ee5d-4b8a-b922-35b7f2b327d1 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:12:51.247121 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34b06a5-ee5d-4b8a-b922-35b7f2b327d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:12:51.248023 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34b06a5-ee5d-4b8a-b922-35b7f2b327d1 None admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:12:51.248989 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34b06a5-ee5d-4b8a-b922-35b7f2b327d1 None admin] RBAC: Adding query filter params (name=member) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:12:51.249486 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34b06a5-ee5d-4b8a-b922-35b7f2b327d1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:12:51.250721 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a451ec33-9afc-4b97-acb8-34798680c378 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:12:51.251561 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34b06a5-ee5d-4b8a-b922-35b7f2b327d1 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:12:51.260854 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 69/131] 10.222.0.44 () {56 vars in 1101 bytes} [Thu Jun 16 12:12:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:12:51.261881 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34b06a5-ee5d-4b8a-b922-35b7f2b327d1 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:12:51.300622 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:12:51.313625 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d04b0f-157b-43bb-96dd-9cf10015b976 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:12:51.314507 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d04b0f-157b-43bb-96dd-9cf10015b976 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:12:51.314796 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d04b0f-157b-43bb-96dd-9cf10015b976 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:12:51.315076 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d04b0f-157b-43bb-96dd-9cf10015b976 None admin] PATH_INFO: `/v3/projects/02e13d55192e4bfc8385150aa7249e83` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:12:51.320446 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d04b0f-157b-43bb-96dd-9cf10015b976 None admin] RBAC: Authorizing `identity:get_project(project_id=02e13d55192e4bfc8385150aa7249e83)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:12:51.322434 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d04b0f-157b-43bb-96dd-9cf10015b976 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:12:51.324689 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 63/132] 10.222.0.44 () {56 vars in 1186 bytes} [Thu Jun 16 12:12:51 2022] GET /identity/v3/projects/02e13d55192e4bfc8385150aa7249e83 => generated 298 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:12:51.325197 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d04b0f-157b-43bb-96dd-9cf10015b976 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:12:51.364607 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:12:51.369031 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34b06a5-ee5d-4b8a-b922-35b7f2b327d1 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:12:51.407225 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8fa5f4-97e3-49d6-8a9c-c230481985ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:12:51.408511 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8fa5f4-97e3-49d6-8a9c-c230481985ff None admin] REQUEST_METHOD: `PUT` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:12:51.409011 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8fa5f4-97e3-49d6-8a9c-c230481985ff None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:12:51.409478 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8fa5f4-97e3-49d6-8a9c-c230481985ff None admin] PATH_INFO: `/v3/projects/02e13d55192e4bfc8385150aa7249e83/users/63ec8f96a497486a9d373a6514f7d0be/roles/0688968254744e3f9913653cafea3091` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:12:51.411863 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8fa5f4-97e3-49d6-8a9c-c230481985ff None admin] RBAC: Authorizing `identity:create_grant(project_id=02e13d55192e4bfc8385150aa7249e83, user_id=63ec8f96a497486a9d373a6514f7d0be, role_id=0688968254744e3f9913653cafea3091)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:12:51.413530 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8fa5f4-97e3-49d6-8a9c-c230481985ff None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:12:51.432540 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 70/133] 10.222.0.44 () {58 vars in 1439 bytes} [Thu Jun 16 12:12:51 2022] PUT /identity/v3/projects/02e13d55192e4bfc8385150aa7249e83/users/63ec8f96a497486a9d373a6514f7d0be/roles/0688968254744e3f9913653cafea3091 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:12:51.433732 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8fa5f4-97e3-49d6-8a9c-c230481985ff None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:12:51.553696 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d04b0f-157b-43bb-96dd-9cf10015b976 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:12:51.601897 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8fa5f4-97e3-49d6-8a9c-c230481985ff None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:12:51.634099 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec3f1bd-229d-440e-8ffd-09b5f4f977fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:12:51.635110 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec3f1bd-229d-440e-8ffd-09b5f4f977fb None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:12:51.635284 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec3f1bd-229d-440e-8ffd-09b5f4f977fb None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:12:51.635553 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec3f1bd-229d-440e-8ffd-09b5f4f977fb None admin] PATH_INFO: `/v3/users/057c3bd7c27f458f8c008fb91e974956` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:12:51.637568 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec3f1bd-229d-440e-8ffd-09b5f4f977fb None admin] RBAC: Authorizing `identity:get_user(user_id=057c3bd7c27f458f8c008fb91e974956)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:12:51.639124 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec3f1bd-229d-440e-8ffd-09b5f4f977fb None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:12:51.641050 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 64/134] 10.222.0.44 () {56 vars in 1177 bytes} [Thu Jun 16 12:12:51 2022] GET /identity/v3/users/057c3bd7c27f458f8c008fb91e974956 => generated 275 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:12:51.644563 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0f40dd-5731-4b97-a3eb-0e403d08baae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:12:51.645745 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0f40dd-5731-4b97-a3eb-0e403d08baae None admin] REQUEST_METHOD: `PUT` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:12:51.646158 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec3f1bd-229d-440e-8ffd-09b5f4f977fb None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:12:51.646439 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0f40dd-5731-4b97-a3eb-0e403d08baae None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:12:51.646920 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0f40dd-5731-4b97-a3eb-0e403d08baae None admin] PATH_INFO: `/v3/projects/02e13d55192e4bfc8385150aa7249e83/users/057c3bd7c27f458f8c008fb91e974956/roles/c39882b202e942479a7cdac2fc6da72c` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:12:51.649324 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0f40dd-5731-4b97-a3eb-0e403d08baae None admin] RBAC: Authorizing `identity:create_grant(project_id=02e13d55192e4bfc8385150aa7249e83, user_id=057c3bd7c27f458f8c008fb91e974956, role_id=c39882b202e942479a7cdac2fc6da72c)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:12:51.651397 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0f40dd-5731-4b97-a3eb-0e403d08baae None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:12:51.671737 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 71/135] 10.222.0.44 () {58 vars in 1439 bytes} [Thu Jun 16 12:12:51 2022] PUT /identity/v3/projects/02e13d55192e4bfc8385150aa7249e83/users/057c3bd7c27f458f8c008fb91e974956/roles/c39882b202e942479a7cdac2fc6da72c => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:12:51.740660 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:12:51.787445 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec3f1bd-229d-440e-8ffd-09b5f4f977fb None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:12:51.831424 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d475a21-a055-4881-ba0d-33333f351b35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:12:51.832218 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d475a21-a055-4881-ba0d-33333f351b35 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:12:51.832504 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d475a21-a055-4881-ba0d-33333f351b35 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:12:51.832804 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d475a21-a055-4881-ba0d-33333f351b35 None admin] PATH_INFO: `/v3/projects/05880ea4c4f744d2ae0ed40a19c054e7` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:12:51.837638 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d475a21-a055-4881-ba0d-33333f351b35 None admin] RBAC: Authorizing `identity:get_project(project_id=05880ea4c4f744d2ae0ed40a19c054e7)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:12:51.839122 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d475a21-a055-4881-ba0d-33333f351b35 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:12:51.840935 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 65/136] 10.222.0.44 () {56 vars in 1186 bytes} [Thu Jun 16 12:12:51 2022] GET /identity/v3/projects/05880ea4c4f744d2ae0ed40a19c054e7 => generated 312 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 12:12:51.846922 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0f40dd-5731-4b97-a3eb-0e403d08baae None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:12:51.884483 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:12:51.976274 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0f40dd-5731-4b97-a3eb-0e403d08baae None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:12:52.021758 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91831d49-d95d-4cab-9fb2-cd9f2f5c8afb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:12:52.022708 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91831d49-d95d-4cab-9fb2-cd9f2f5c8afb None admin] REQUEST_METHOD: `PUT` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:12:52.022988 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91831d49-d95d-4cab-9fb2-cd9f2f5c8afb None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:12:52.023261 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91831d49-d95d-4cab-9fb2-cd9f2f5c8afb None admin] PATH_INFO: `/v3/projects/05880ea4c4f744d2ae0ed40a19c054e7/users/057c3bd7c27f458f8c008fb91e974956/roles/c39882b202e942479a7cdac2fc6da72c` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:12:52.027411 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91831d49-d95d-4cab-9fb2-cd9f2f5c8afb None admin] RBAC: Authorizing `identity:create_grant(project_id=05880ea4c4f744d2ae0ed40a19c054e7, user_id=057c3bd7c27f458f8c008fb91e974956, role_id=c39882b202e942479a7cdac2fc6da72c)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:12:52.028980 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91831d49-d95d-4cab-9fb2-cd9f2f5c8afb None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:12:52.048590 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 72/137] 10.222.0.44 () {58 vars in 1439 bytes} [Thu Jun 16 12:12:51 2022] PUT /identity/v3/projects/05880ea4c4f744d2ae0ed40a19c054e7/users/057c3bd7c27f458f8c008fb91e974956/roles/c39882b202e942479a7cdac2fc6da72c => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:12:52.192962 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e437dd51-07be-446a-8565-1403d87748e3 None None] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:12:52.193591 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e437dd51-07be-446a-8565-1403d87748e3 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:12:52.194147 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e437dd51-07be-446a-8565-1403d87748e3 None None] PATH_INFO: `/` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:12:52.195750 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 66/138] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 12:12:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 12:12:52.201696 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbc6f78-1809-4318-b07e-bb609d5cee7f None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:12:52.201989 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbc6f78-1809-4318-b07e-bb609d5cee7f None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:12:52.202243 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbc6f78-1809-4318-b07e-bb609d5cee7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:12:52.224068 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-4fbc6f78-1809-4318-b07e-bb609d5cee7f None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:12:52.225306 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-4fbc6f78-1809-4318-b07e-bb609d5cee7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:12:52.311991 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 73/139] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 12:12:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 12:12:52.354280 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e437dd51-07be-446a-8565-1403d87748e3 None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:12:52.480679 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e437dd51-07be-446a-8565-1403d87748e3 None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:12:52.525986 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cff439-8548-47a9-8644-ac83d0c1f638 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:12:52.526788 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cff439-8548-47a9-8644-ac83d0c1f638 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:12:52.527070 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cff439-8548-47a9-8644-ac83d0c1f638 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:12:52.527340 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cff439-8548-47a9-8644-ac83d0c1f638 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:12:52.528519 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72cff439-8548-47a9-8644-ac83d0c1f638 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:12:52.530045 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72cff439-8548-47a9-8644-ac83d0c1f638 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:12:52.531671 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 67/140] 10.222.0.44 () {56 vars in 1108 bytes} [Thu Jun 16 12:12:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:12:52.537221 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbc6f78-1809-4318-b07e-bb609d5cee7f None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:12:52.550999 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:12:52.658509 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbc6f78-1809-4318-b07e-bb609d5cee7f None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:12:52.701385 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1103bb5-652c-4df3-b389-50847c86e91a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:12:52.702067 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1103bb5-652c-4df3-b389-50847c86e91a None admin] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:12:52.702347 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1103bb5-652c-4df3-b389-50847c86e91a None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:12:52.702629 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1103bb5-652c-4df3-b389-50847c86e91a None admin] PATH_INFO: `/v3/users` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:12:52.703362 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1103bb5-652c-4df3-b389-50847c86e91a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:12:52.704854 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1103bb5-652c-4df3-b389-50847c86e91a None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:12:52.734475 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 74/141] 10.222.0.44 () {60 vars in 1132 bytes} [Thu Jun 16 12:12:52 2022] POST /identity/v3/users => generated 283 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 12:12:52.792782 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c959db3-af8e-4118-987d-cc1b3980a3fe None None] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:12:52.793082 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c959db3-af8e-4118-987d-cc1b3980a3fe None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:12:52.793341 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c959db3-af8e-4118-987d-cc1b3980a3fe None None] PATH_INFO: `/` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:12:52.794978 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 68/142] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 12:12:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 12:12:52.800895 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535f339a-737e-4426-9d07-b3381c1eae9a None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:12:52.801173 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535f339a-737e-4426-9d07-b3381c1eae9a None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:12:52.801453 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535f339a-737e-4426-9d07-b3381c1eae9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:12:52.819829 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-535f339a-737e-4426-9d07-b3381c1eae9a None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:12:52.821085 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-535f339a-737e-4426-9d07-b3381c1eae9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:12:52.911234 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:12:52.927262 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 75/143] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 12:12:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 12:12:52.962802 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c959db3-af8e-4118-987d-cc1b3980a3fe None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:12:52.967287 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:12:53.076585 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c959db3-af8e-4118-987d-cc1b3980a3fe None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:12:53.112482 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d40ff01-9a75-4189-b532-827f4a80d091 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:12:53.113313 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d40ff01-9a75-4189-b532-827f4a80d091 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:12:53.113598 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d40ff01-9a75-4189-b532-827f4a80d091 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:12:53.113880 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d40ff01-9a75-4189-b532-827f4a80d091 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:12:53.124655 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d40ff01-9a75-4189-b532-827f4a80d091 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 12:12:53.132729 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application [None req-1d40ff01-9a75-4189-b532-827f4a80d091 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 16 12:12:53.132729 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 12:12:53.132729 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 12:12:53.132729 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 12:12:53.132729 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 12:12:53.132729 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 12:12:53.132729 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 12:12:53.132729 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 12:12:53.132729 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 12:12:53.132729 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 12:12:53.132729 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 12:12:53.132729 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 12:12:53.132729 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 12:12:53.132729 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 12:12:53.132729 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 12:12:53.132729 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 12:12:53.133647 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 12:12:53.133647 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 12:12:53.133647 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 12:12:53.133647 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 12:12:53.133647 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 12:12:53.133647 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 12:12:53.133647 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 12:12:53.133647 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 12:12:53.133647 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 12:12:53.133647 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 12:12:53.133647 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 12:12:53.133647 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application with Lock( Jun 16 12:12:53.133647 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 12:12:53.133647 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._enter() Jun 16 12:12:53.133647 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 12:12:53.133647 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 12:12:53.134401 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 12:12:53.134401 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.creator() Jun 16 12:12:53.134401 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 12:12:53.134401 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application created_value = creator( Jun 16 12:12:53.134401 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 12:12:53.134401 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 12:12:53.134401 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 12:12:53.134401 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 12:12:53.134401 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 12:12:53.134401 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 12:12:53.134401 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 16 12:12:53.134401 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application Jun 16 12:12:53.134401 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 69/144] 10.222.0.44 () {56 vars in 1099 bytes} [Thu Jun 16 12:12:52 2022] GET /identity/v3/roles/reader => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 12:12:53.141861 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535f339a-737e-4426-9d07-b3381c1eae9a None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:12:53.315553 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535f339a-737e-4426-9d07-b3381c1eae9a None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:12:53.362457 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ef4b53-5863-4081-8840-b4029af6fefa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:12:53.363059 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ef4b53-5863-4081-8840-b4029af6fefa None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:12:53.363341 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ef4b53-5863-4081-8840-b4029af6fefa None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:12:53.363615 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ef4b53-5863-4081-8840-b4029af6fefa None admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:12:53.364374 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ef4b53-5863-4081-8840-b4029af6fefa None admin] RBAC: Adding query filter params (name=reader) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:12:53.364818 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ef4b53-5863-4081-8840-b4029af6fefa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:12:53.366271 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ef4b53-5863-4081-8840-b4029af6fefa None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:12:53.380856 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 76/145] 10.222.0.44 () {56 vars in 1101 bytes} [Thu Jun 16 12:12:53 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:12:53.387621 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d40ff01-9a75-4189-b532-827f4a80d091 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:12:53.501187 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:12:53.531299 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d40ff01-9a75-4189-b532-827f4a80d091 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:12:53.572438 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5790e4e-4e55-4fd4-a6d1-e91bc0dbec5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:12:53.573362 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5790e4e-4e55-4fd4-a6d1-e91bc0dbec5d None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:12:53.573651 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5790e4e-4e55-4fd4-a6d1-e91bc0dbec5d None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:12:53.573930 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5790e4e-4e55-4fd4-a6d1-e91bc0dbec5d None admin] PATH_INFO: `/v3/users/777678ad7bdb4716ad6ad7c9c3d3d0fe` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:12:53.577500 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5790e4e-4e55-4fd4-a6d1-e91bc0dbec5d None admin] RBAC: Authorizing `identity:get_user(user_id=777678ad7bdb4716ad6ad7c9c3d3d0fe)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:12:53.578982 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5790e4e-4e55-4fd4-a6d1-e91bc0dbec5d None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:12:53.580655 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 70/146] 10.222.0.44 () {56 vars in 1177 bytes} [Thu Jun 16 12:12:53 2022] GET /identity/v3/users/777678ad7bdb4716ad6ad7c9c3d3d0fe => generated 289 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:12:53.589869 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ef4b53-5863-4081-8840-b4029af6fefa None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:12:53.680558 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:12:53.731917 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ef4b53-5863-4081-8840-b4029af6fefa None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:12:53.768226 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eca793d-5ba9-478c-8768-1cfae0a04e42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:12:53.769244 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eca793d-5ba9-478c-8768-1cfae0a04e42 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:12:53.769524 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eca793d-5ba9-478c-8768-1cfae0a04e42 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:12:53.769798 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eca793d-5ba9-478c-8768-1cfae0a04e42 None admin] PATH_INFO: `/v3/projects/02e13d55192e4bfc8385150aa7249e83` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:12:53.771010 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eca793d-5ba9-478c-8768-1cfae0a04e42 None admin] RBAC: Authorizing `identity:get_project(project_id=02e13d55192e4bfc8385150aa7249e83)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:12:53.772575 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eca793d-5ba9-478c-8768-1cfae0a04e42 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:12:53.774352 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 77/147] 10.222.0.44 () {56 vars in 1186 bytes} [Thu Jun 16 12:12:53 2022] GET /identity/v3/projects/02e13d55192e4bfc8385150aa7249e83 => generated 298 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:12:53.780305 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5790e4e-4e55-4fd4-a6d1-e91bc0dbec5d None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:12:53.946816 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5790e4e-4e55-4fd4-a6d1-e91bc0dbec5d None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:12:53.976314 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:12:53.981876 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec6e9de-6a0a-441e-b5a3-5943a5a1ee8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:12:53.982778 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec6e9de-6a0a-441e-b5a3-5943a5a1ee8e None admin] REQUEST_METHOD: `PUT` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:12:53.983063 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec6e9de-6a0a-441e-b5a3-5943a5a1ee8e None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:12:53.983340 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec6e9de-6a0a-441e-b5a3-5943a5a1ee8e None admin] PATH_INFO: `/v3/projects/02e13d55192e4bfc8385150aa7249e83/users/777678ad7bdb4716ad6ad7c9c3d3d0fe/roles/8b8940c737364011a624755f642bf504` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:12:53.985395 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec6e9de-6a0a-441e-b5a3-5943a5a1ee8e None admin] RBAC: Authorizing `identity:create_grant(project_id=02e13d55192e4bfc8385150aa7249e83, user_id=777678ad7bdb4716ad6ad7c9c3d3d0fe, role_id=8b8940c737364011a624755f642bf504)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:12:53.987217 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec6e9de-6a0a-441e-b5a3-5943a5a1ee8e None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:12:54.002478 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 71/148] 10.222.0.44 () {58 vars in 1439 bytes} [Thu Jun 16 12:12:53 2022] PUT /identity/v3/projects/02e13d55192e4bfc8385150aa7249e83/users/777678ad7bdb4716ad6ad7c9c3d3d0fe/roles/8b8940c737364011a624755f642bf504 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:12:54.016831 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16442c39-6f81-420f-90c4-5eadef9e3eb9 None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:12:54.017173 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16442c39-6f81-420f-90c4-5eadef9e3eb9 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:12:54.017463 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16442c39-6f81-420f-90c4-5eadef9e3eb9 None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:12:54.019272 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 78/149] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 12:12:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 12:12:54.025600 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b04901-7002-4e9e-8e2a-eadfd5c213e8 None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:12:54.025899 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b04901-7002-4e9e-8e2a-eadfd5c213e8 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:12:54.026221 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b04901-7002-4e9e-8e2a-eadfd5c213e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:12:54.046252 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-98b04901-7002-4e9e-8e2a-eadfd5c213e8 None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:12:54.047489 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-98b04901-7002-4e9e-8e2a-eadfd5c213e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:12:54.125245 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 72/150] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 12:12:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 12:12:54.164340 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16442c39-6f81-420f-90c4-5eadef9e3eb9 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:12:54.288361 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16442c39-6f81-420f-90c4-5eadef9e3eb9 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:12:54.315121 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:12:54.328516 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f5e420-c4d9-4808-9860-57fa57575f5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:12:54.329376 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f5e420-c4d9-4808-9860-57fa57575f5c None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:12:54.329660 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f5e420-c4d9-4808-9860-57fa57575f5c None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:12:54.329937 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f5e420-c4d9-4808-9860-57fa57575f5c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:12:54.342748 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f5e420-c4d9-4808-9860-57fa57575f5c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 12:12:54.351122 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-95f5e420-c4d9-4808-9860-57fa57575f5c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 12:12:54.351122 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 12:12:54.351122 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 12:12:54.351122 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 12:12:54.351122 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 12:12:54.351122 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 12:12:54.351122 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 12:12:54.351122 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 12:12:54.351122 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 12:12:54.351122 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 12:12:54.351122 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 12:12:54.351122 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 12:12:54.351122 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 12:12:54.351122 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 12:12:54.351122 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 12:12:54.351122 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 12:12:54.354005 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 12:12:54.354005 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 12:12:54.354005 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 12:12:54.354005 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 12:12:54.354005 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 12:12:54.354005 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 12:12:54.354005 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 12:12:54.354005 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 12:12:54.354005 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 12:12:54.354005 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 12:12:54.354005 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 12:12:54.354005 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jun 16 12:12:54.354005 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 12:12:54.354005 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jun 16 12:12:54.354005 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 12:12:54.354005 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 12:12:54.355880 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 12:12:54.355880 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jun 16 12:12:54.355880 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 12:12:54.355880 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jun 16 12:12:54.355880 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 12:12:54.355880 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 12:12:54.355880 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 12:12:54.355880 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 12:12:54.355880 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 12:12:54.355880 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 12:12:54.355880 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 12:12:54.355880 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jun 16 12:12:54.361438 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 79/151] 10.222.0.44 () {56 vars in 1114 bytes} [Thu Jun 16 12:12:54 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 12:12:54.363108 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b04901-7002-4e9e-8e2a-eadfd5c213e8 None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:12:54.497126 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b04901-7002-4e9e-8e2a-eadfd5c213e8 None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:12:54.521099 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:12:54.540483 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b2fe7c-06e8-4e31-8101-78353276a45c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:12:54.541123 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b2fe7c-06e8-4e31-8101-78353276a45c None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:12:54.541407 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b2fe7c-06e8-4e31-8101-78353276a45c None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:12:54.541681 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b2fe7c-06e8-4e31-8101-78353276a45c None admin] PATH_INFO: `/v3/roles` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:12:54.542536 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b2fe7c-06e8-4e31-8101-78353276a45c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:12:54.542844 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b2fe7c-06e8-4e31-8101-78353276a45c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:12:54.544278 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b2fe7c-06e8-4e31-8101-78353276a45c None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:12:54.556903 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 73/152] 10.222.0.44 () {56 vars in 1111 bytes} [Thu Jun 16 12:12:54 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:12:54.559607 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f5e420-c4d9-4808-9860-57fa57575f5c None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:12:54.688267 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f5e420-c4d9-4808-9860-57fa57575f5c None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:12:54.723599 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fceb464c-0c76-451e-b078-46cdb30aa3e5 None None] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:12:54.723948 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fceb464c-0c76-451e-b078-46cdb30aa3e5 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:12:54.724155 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fceb464c-0c76-451e-b078-46cdb30aa3e5 None None] PATH_INFO: `/` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:12:54.725576 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 74/153] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 12:12:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 12:12:54.728797 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d92b25-54d0-4389-867b-afe0c00fe9ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:12:54.729686 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d92b25-54d0-4389-867b-afe0c00fe9ec None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:12:54.729969 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d92b25-54d0-4389-867b-afe0c00fe9ec None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:12:54.731426 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d676070-ca03-41c3-b406-97795900bb99 None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:12:54.731705 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d676070-ca03-41c3-b406-97795900bb99 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:12:54.731980 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d676070-ca03-41c3-b406-97795900bb99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:12:54.733333 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d92b25-54d0-4389-867b-afe0c00fe9ec None admin] PATH_INFO: `/v3/users/057c3bd7c27f458f8c008fb91e974956` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:12:54.738856 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d92b25-54d0-4389-867b-afe0c00fe9ec None admin] RBAC: Authorizing `identity:get_user(user_id=057c3bd7c27f458f8c008fb91e974956)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:12:54.745223 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d92b25-54d0-4389-867b-afe0c00fe9ec None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:12:54.746922 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 80/154] 10.222.0.44 () {56 vars in 1177 bytes} [Thu Jun 16 12:12:54 2022] GET /identity/v3/users/057c3bd7c27f458f8c008fb91e974956 => generated 275 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:12:54.752162 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-2d676070-ca03-41c3-b406-97795900bb99 None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:12:54.753392 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-2d676070-ca03-41c3-b406-97795900bb99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:12:54.756053 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d92b25-54d0-4389-867b-afe0c00fe9ec None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:12:54.849262 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:12:54.924672 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d92b25-54d0-4389-867b-afe0c00fe9ec None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:12:54.963630 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 75/155] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 12:12:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 12:12:55.002800 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d807c2-ba88-4375-8010-473386cef33a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:12:55.003456 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d807c2-ba88-4375-8010-473386cef33a None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:12:55.003735 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d807c2-ba88-4375-8010-473386cef33a None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:12:55.004005 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d807c2-ba88-4375-8010-473386cef33a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:12:55.012179 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d676070-ca03-41c3-b406-97795900bb99 None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:12:55.104683 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d807c2-ba88-4375-8010-473386cef33a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:12:55.109962 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d807c2-ba88-4375-8010-473386cef33a None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:12:55.155470 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d676070-ca03-41c3-b406-97795900bb99 None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:12:55.185159 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:12:55.192539 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:12:55.218195 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b5068e-09bf-4b7b-bbed-bd3b5ac99cf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:12:55.219007 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b5068e-09bf-4b7b-bbed-bd3b5ac99cf5 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:12:55.219282 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b5068e-09bf-4b7b-bbed-bd3b5ac99cf5 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:12:55.219551 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b5068e-09bf-4b7b-bbed-bd3b5ac99cf5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:12:55.257622 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b5068e-09bf-4b7b-bbed-bd3b5ac99cf5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 12:12:55.280066 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application [None req-27b5068e-09bf-4b7b-bbed-bd3b5ac99cf5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 12:12:55.280066 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 12:12:55.280066 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 12:12:55.280066 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 12:12:55.280066 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 12:12:55.280066 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 12:12:55.280066 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 12:12:55.280066 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 12:12:55.280066 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 12:12:55.280066 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 12:12:55.280066 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 12:12:55.280066 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 12:12:55.280066 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 12:12:55.280066 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 12:12:55.280066 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 12:12:55.280066 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 12:12:55.281226 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 12:12:55.281226 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 12:12:55.281226 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 12:12:55.281226 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 12:12:55.281226 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 12:12:55.281226 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 12:12:55.281226 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 12:12:55.281226 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 12:12:55.281226 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 12:12:55.281226 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 12:12:55.281226 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 12:12:55.281226 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application with Lock( Jun 16 12:12:55.281226 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 12:12:55.281226 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._enter() Jun 16 12:12:55.281226 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 12:12:55.281226 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 12:12:55.282083 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 12:12:55.282083 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.creator() Jun 16 12:12:55.282083 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 12:12:55.282083 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application created_value = creator( Jun 16 12:12:55.282083 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 12:12:55.282083 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 12:12:55.282083 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 12:12:55.282083 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 12:12:55.282083 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 12:12:55.282083 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 12:12:55.282083 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 12:12:55.282083 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application Jun 16 12:12:55.282083 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 76/156] 10.222.0.44 () {56 vars in 1096 bytes} [Thu Jun 16 12:12:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 12:12:55.288775 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b5068e-09bf-4b7b-bbed-bd3b5ac99cf5 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:12:55.332720 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 81/157] 10.222.0.44 () {58 vars in 1282 bytes} [Thu Jun 16 12:12:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 577 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 12:12:55.358094 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d807c2-ba88-4375-8010-473386cef33a None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:12:55.540804 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b5068e-09bf-4b7b-bbed-bd3b5ac99cf5 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:12:55.615781 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665d1ee1-0c28-488b-a60c-d0abd1019a81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:12:55.616387 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665d1ee1-0c28-488b-a60c-d0abd1019a81 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:12:55.616667 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665d1ee1-0c28-488b-a60c-d0abd1019a81 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:12:55.616970 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665d1ee1-0c28-488b-a60c-d0abd1019a81 None admin] PATH_INFO: `/v3/roles` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:12:55.618279 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665d1ee1-0c28-488b-a60c-d0abd1019a81 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:12:55.618593 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665d1ee1-0c28-488b-a60c-d0abd1019a81 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:12:55.619979 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665d1ee1-0c28-488b-a60c-d0abd1019a81 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:12:55.644528 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 77/158] 10.222.0.44 () {56 vars in 1099 bytes} [Thu Jun 16 12:12:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 356 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:12:55.646071 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d870b0-5991-40f2-93cc-eb7d806d6169 None None] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:12:55.646360 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d870b0-5991-40f2-93cc-eb7d806d6169 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:12:55.646630 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d870b0-5991-40f2-93cc-eb7d806d6169 None None] PATH_INFO: `/` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:12:55.647863 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 78/159] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 12:12:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 12:12:55.653639 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03785c72-50cc-4401-8600-0af1e46c673f None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:12:55.653923 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03785c72-50cc-4401-8600-0af1e46c673f None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:12:55.654192 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03785c72-50cc-4401-8600-0af1e46c673f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:12:55.690004 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-03785c72-50cc-4401-8600-0af1e46c673f None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:12:55.691271 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-03785c72-50cc-4401-8600-0af1e46c673f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:12:55.745147 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:12:55.746367 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d807c2-ba88-4375-8010-473386cef33a None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:12:55.837948 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 79/160] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 12:12:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 12:12:55.839242 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03785c72-50cc-4401-8600-0af1e46c673f None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:12:55.905569 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06aed88-6e86-46ec-a1c3-d44af3ce08d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:12:55.906371 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06aed88-6e86-46ec-a1c3-d44af3ce08d1 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:12:55.906653 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06aed88-6e86-46ec-a1c3-d44af3ce08d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:12:55.906933 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06aed88-6e86-46ec-a1c3-d44af3ce08d1 None admin] PATH_INFO: `/v3/projects/02e13d55192e4bfc8385150aa7249e83` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:12:55.912873 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06aed88-6e86-46ec-a1c3-d44af3ce08d1 None admin] RBAC: Authorizing `identity:get_project(project_id=02e13d55192e4bfc8385150aa7249e83)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:12:55.914942 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06aed88-6e86-46ec-a1c3-d44af3ce08d1 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:12:55.916996 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 82/161] 10.222.0.44 () {56 vars in 1186 bytes} [Thu Jun 16 12:12:55 2022] GET /identity/v3/projects/02e13d55192e4bfc8385150aa7249e83 => generated 298 bytes in 559 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 12:12:55.920413 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06aed88-6e86-46ec-a1c3-d44af3ce08d1 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:12:55.984630 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:12:56.091307 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03785c72-50cc-4401-8600-0af1e46c673f None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:12:56.165718 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6d0a52-e9df-4d7d-bf8f-2e2d9df26e60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:12:56.167034 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6d0a52-e9df-4d7d-bf8f-2e2d9df26e60 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:12:56.167547 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6d0a52-e9df-4d7d-bf8f-2e2d9df26e60 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:12:56.168018 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6d0a52-e9df-4d7d-bf8f-2e2d9df26e60 None admin] PATH_INFO: `/v3/users/63ec8f96a497486a9d373a6514f7d0be` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:12:56.173772 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6d0a52-e9df-4d7d-bf8f-2e2d9df26e60 None admin] RBAC: Authorizing `identity:get_user(user_id=63ec8f96a497486a9d373a6514f7d0be)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:12:56.175581 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6d0a52-e9df-4d7d-bf8f-2e2d9df26e60 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:12:56.177608 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 80/162] 10.222.0.44 () {56 vars in 1177 bytes} [Thu Jun 16 12:12:55 2022] GET /identity/v3/users/63ec8f96a497486a9d373a6514f7d0be => generated 247 bytes in 339 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:12:56.178769 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6d0a52-e9df-4d7d-bf8f-2e2d9df26e60 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:12:56.199245 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06aed88-6e86-46ec-a1c3-d44af3ce08d1 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:12:56.257112 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:12:56.263111 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdc460c-1254-4187-a8b8-069ef26f012c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:12:56.263921 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdc460c-1254-4187-a8b8-069ef26f012c None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:12:56.264196 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdc460c-1254-4187-a8b8-069ef26f012c None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:12:56.264462 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdc460c-1254-4187-a8b8-069ef26f012c None admin] PATH_INFO: `/v3/roles/member` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:12:56.292245 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdc460c-1254-4187-a8b8-069ef26f012c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 12:12:56.309879 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-bcdc460c-1254-4187-a8b8-069ef26f012c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 16 12:12:56.309879 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 12:12:56.309879 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 12:12:56.309879 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 12:12:56.309879 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 12:12:56.309879 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 12:12:56.309879 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 12:12:56.309879 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 12:12:56.309879 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 12:12:56.309879 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 12:12:56.309879 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 12:12:56.309879 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 12:12:56.309879 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 12:12:56.309879 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 12:12:56.309879 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 12:12:56.309879 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 12:12:56.310798 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 12:12:56.310798 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 12:12:56.310798 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 12:12:56.310798 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 12:12:56.310798 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 12:12:56.310798 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 12:12:56.310798 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 12:12:56.310798 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 12:12:56.310798 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 12:12:56.310798 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 12:12:56.310798 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 12:12:56.310798 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jun 16 12:12:56.310798 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 12:12:56.310798 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jun 16 12:12:56.310798 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 12:12:56.310798 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 12:12:56.311563 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 12:12:56.311563 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jun 16 12:12:56.311563 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 12:12:56.311563 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jun 16 12:12:56.311563 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 12:12:56.311563 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 12:12:56.311563 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 12:12:56.311563 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 12:12:56.311563 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 12:12:56.311563 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 12:12:56.311563 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 16 12:12:56.311563 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jun 16 12:12:56.311563 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 83/163] 10.222.0.44 () {56 vars in 1099 bytes} [Thu Jun 16 12:12:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 394 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 12:12:56.312789 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdc460c-1254-4187-a8b8-069ef26f012c None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:12:56.417314 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:12:56.432740 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6d0a52-e9df-4d7d-bf8f-2e2d9df26e60 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:12:56.471471 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdc460c-1254-4187-a8b8-069ef26f012c None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:12:56.522241 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330464b7-29c0-4f4f-b0f7-afb8223ae790 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:12:56.522902 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330464b7-29c0-4f4f-b0f7-afb8223ae790 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:12:56.523184 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330464b7-29c0-4f4f-b0f7-afb8223ae790 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:12:56.523459 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330464b7-29c0-4f4f-b0f7-afb8223ae790 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:12:56.524358 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330464b7-29c0-4f4f-b0f7-afb8223ae790 None admin] RBAC: Adding query filter params (role.id=e24b3707bc514b1fa606efab092047e6, scope.project.id=02e13d55192e4bfc8385150aa7249e83, user.id=057c3bd7c27f458f8c008fb91e974956) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:12:56.524671 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330464b7-29c0-4f4f-b0f7-afb8223ae790 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:12:56.526429 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330464b7-29c0-4f4f-b0f7-afb8223ae790 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:12:56.540789 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 81/164] 10.222.0.44 () {56 vars in 1374 bytes} [Thu Jun 16 12:12:56 2022] GET /identity/v3/role_assignments?user.id=057c3bd7c27f458f8c008fb91e974956&scope.project.id=02e13d55192e4bfc8385150aa7249e83&role.id=e24b3707bc514b1fa606efab092047e6 => generated 608 bytes in 362 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:12:56.544978 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0b9970-33e7-4f7a-b596-72f5c9472dcf None None] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:12:56.545676 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0b9970-33e7-4f7a-b596-72f5c9472dcf None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:12:56.545676 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0b9970-33e7-4f7a-b596-72f5c9472dcf None None] PATH_INFO: `/` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:12:56.546764 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 82/165] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 12:12:56 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 12:12:56.559421 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0b9970-33e7-4f7a-b596-72f5c9472dcf None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:12:56.561684 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b64412e-6711-4e59-b3b4-bdaa9d5026d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:12:56.562353 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b64412e-6711-4e59-b3b4-bdaa9d5026d2 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:12:56.562634 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b64412e-6711-4e59-b3b4-bdaa9d5026d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:12:56.562908 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b64412e-6711-4e59-b3b4-bdaa9d5026d2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:12:56.744420 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b64412e-6711-4e59-b3b4-bdaa9d5026d2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:12:56.745950 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b64412e-6711-4e59-b3b4-bdaa9d5026d2 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:12:56.804676 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:12:56.814569 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0b9970-33e7-4f7a-b596-72f5c9472dcf None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:12:56.892104 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:12:56.894446 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca5570f-b9a5-4f82-9128-55c7a4b9e022 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:12:56.895530 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca5570f-b9a5-4f82-9128-55c7a4b9e022 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:12:56.896012 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca5570f-b9a5-4f82-9128-55c7a4b9e022 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:12:56.896487 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca5570f-b9a5-4f82-9128-55c7a4b9e022 None admin] PATH_INFO: `/v3/roles` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:12:56.897496 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca5570f-b9a5-4f82-9128-55c7a4b9e022 None admin] RBAC: Adding query filter params (name=member) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:12:56.898011 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca5570f-b9a5-4f82-9128-55c7a4b9e022 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:12:56.899638 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca5570f-b9a5-4f82-9128-55c7a4b9e022 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:12:56.910957 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 83/166] 10.222.0.44 () {56 vars in 1101 bytes} [Thu Jun 16 12:12:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 364 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:12:56.912550 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2839f518-a314-462a-98f9-483cb7266459 None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:12:56.913127 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2839f518-a314-462a-98f9-483cb7266459 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:12:56.913606 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2839f518-a314-462a-98f9-483cb7266459 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:12:56.933609 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-2839f518-a314-462a-98f9-483cb7266459 None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:12:56.935095 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-2839f518-a314-462a-98f9-483cb7266459 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:12:56.937477 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 84/167] 10.222.0.44 () {58 vars in 1282 bytes} [Thu Jun 16 12:12:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 625 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 12:12:56.938110 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b64412e-6711-4e59-b3b4-bdaa9d5026d2 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:12:57.018655 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 84/168] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 12:12:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 12:12:57.019829 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2839f518-a314-462a-98f9-483cb7266459 None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:12:57.069291 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b64412e-6711-4e59-b3b4-bdaa9d5026d2 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:12:57.113773 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:12:57.129483 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2839f518-a314-462a-98f9-483cb7266459 None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:12:57.146153 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64a0f96-5303-4f7c-b7c5-084073c18843 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:12:57.147051 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64a0f96-5303-4f7c-b7c5-084073c18843 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:12:57.147331 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64a0f96-5303-4f7c-b7c5-084073c18843 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:12:57.147602 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64a0f96-5303-4f7c-b7c5-084073c18843 None admin] PATH_INFO: `/v3/users/057c3bd7c27f458f8c008fb91e974956` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:12:57.153510 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64a0f96-5303-4f7c-b7c5-084073c18843 None admin] RBAC: Authorizing `identity:get_user(user_id=057c3bd7c27f458f8c008fb91e974956)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:12:57.154995 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64a0f96-5303-4f7c-b7c5-084073c18843 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:12:57.156670 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 85/169] 10.222.0.44 () {56 vars in 1177 bytes} [Thu Jun 16 12:12:56 2022] GET /identity/v3/users/057c3bd7c27f458f8c008fb91e974956 => generated 275 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:12:57.157556 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64a0f96-5303-4f7c-b7c5-084073c18843 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:12:57.170946 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39522eb-6529-4a0a-8eff-dfb983e65629 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:12:57.171823 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39522eb-6529-4a0a-8eff-dfb983e65629 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:12:57.172201 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39522eb-6529-4a0a-8eff-dfb983e65629 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:12:57.172481 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39522eb-6529-4a0a-8eff-dfb983e65629 None admin] PATH_INFO: `/v3/projects/02e13d55192e4bfc8385150aa7249e83` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:12:57.175533 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39522eb-6529-4a0a-8eff-dfb983e65629 None admin] RBAC: Authorizing `identity:get_project(project_id=02e13d55192e4bfc8385150aa7249e83)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:12:57.177133 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39522eb-6529-4a0a-8eff-dfb983e65629 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:12:57.178853 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 85/170] 10.222.0.44 () {56 vars in 1186 bytes} [Thu Jun 16 12:12:57 2022] GET /identity/v3/projects/02e13d55192e4bfc8385150aa7249e83 => generated 298 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:12:57.179807 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39522eb-6529-4a0a-8eff-dfb983e65629 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:12:57.222962 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:12:57.335574 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39522eb-6529-4a0a-8eff-dfb983e65629 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:12:57.362904 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64a0f96-5303-4f7c-b7c5-084073c18843 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:12:57.384718 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7666255-1fbf-469d-b8f9-7b8fbf63b457 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:12:57.385404 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7666255-1fbf-469d-b8f9-7b8fbf63b457 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:12:57.385684 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7666255-1fbf-469d-b8f9-7b8fbf63b457 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:12:57.385959 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7666255-1fbf-469d-b8f9-7b8fbf63b457 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:12:57.425357 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:12:57.462180 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c78a90-7409-4354-be0c-1bc04792a02a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:12:57.463007 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c78a90-7409-4354-be0c-1bc04792a02a None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:12:57.463284 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c78a90-7409-4354-be0c-1bc04792a02a None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:12:57.463559 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c78a90-7409-4354-be0c-1bc04792a02a None admin] PATH_INFO: `/v3/roles/member` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:12:57.473132 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7666255-1fbf-469d-b8f9-7b8fbf63b457 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:12:57.474650 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7666255-1fbf-469d-b8f9-7b8fbf63b457 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:12:57.497750 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c78a90-7409-4354-be0c-1bc04792a02a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 12:12:57.513679 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-37c78a90-7409-4354-be0c-1bc04792a02a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 16 12:12:57.513679 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 12:12:57.513679 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 12:12:57.513679 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 12:12:57.513679 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 12:12:57.513679 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 12:12:57.513679 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 12:12:57.513679 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 12:12:57.513679 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 12:12:57.513679 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 12:12:57.513679 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 12:12:57.513679 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 12:12:57.513679 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 12:12:57.513679 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 12:12:57.513679 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 12:12:57.513679 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 12:12:57.514576 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 12:12:57.514576 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 12:12:57.514576 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 12:12:57.514576 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 12:12:57.514576 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 12:12:57.514576 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 12:12:57.514576 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 12:12:57.514576 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 12:12:57.514576 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 12:12:57.514576 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 12:12:57.514576 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 12:12:57.514576 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jun 16 12:12:57.514576 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 12:12:57.514576 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jun 16 12:12:57.514576 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 12:12:57.514576 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 12:12:57.515419 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 12:12:57.515419 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jun 16 12:12:57.515419 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 12:12:57.515419 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jun 16 12:12:57.515419 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 12:12:57.515419 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 12:12:57.515419 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 12:12:57.515419 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 12:12:57.515419 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 12:12:57.515419 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 12:12:57.515419 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 16 12:12:57.515419 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jun 16 12:12:57.515419 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 86/171] 10.222.0.44 () {56 vars in 1099 bytes} [Thu Jun 16 12:12:57 2022] GET /identity/v3/roles/member => generated 84 bytes in 358 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 12:12:57.516047 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c78a90-7409-4354-be0c-1bc04792a02a None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:12:57.611439 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 86/172] 10.222.0.44 () {58 vars in 1282 bytes} [Thu Jun 16 12:12:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 12:12:57.613103 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7666255-1fbf-469d-b8f9-7b8fbf63b457 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:12:57.675213 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c78a90-7409-4354-be0c-1bc04792a02a None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:12:57.686931 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:12:57.718475 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3faea007-bd69-47dd-8164-9c5df651e7c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:12:57.720233 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3faea007-bd69-47dd-8164-9c5df651e7c9 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:12:57.721083 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3faea007-bd69-47dd-8164-9c5df651e7c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:12:57.721943 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3faea007-bd69-47dd-8164-9c5df651e7c9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:12:57.723865 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3faea007-bd69-47dd-8164-9c5df651e7c9 None admin] RBAC: Adding query filter params (role.id=0688968254744e3f9913653cafea3091, scope.project.id=02e13d55192e4bfc8385150aa7249e83, user.id=63ec8f96a497486a9d373a6514f7d0be) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:12:57.724727 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3faea007-bd69-47dd-8164-9c5df651e7c9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:12:57.728035 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3faea007-bd69-47dd-8164-9c5df651e7c9 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:12:57.739296 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 87/173] 10.222.0.44 () {56 vars in 1374 bytes} [Thu Jun 16 12:12:57 2022] GET /identity/v3/role_assignments?user.id=63ec8f96a497486a9d373a6514f7d0be&scope.project.id=02e13d55192e4bfc8385150aa7249e83&role.id=0688968254744e3f9913653cafea3091 => generated 608 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:12:57.742414 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae2a2fd-35d4-4a7d-b74e-926def775eab None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:12:57.743475 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae2a2fd-35d4-4a7d-b74e-926def775eab None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:12:57.744265 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae2a2fd-35d4-4a7d-b74e-926def775eab None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:12:57.746563 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 88/174] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 12:12:57 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 12:12:57.748130 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae2a2fd-35d4-4a7d-b74e-926def775eab None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:12:57.765148 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:12:57.880451 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae2a2fd-35d4-4a7d-b74e-926def775eab None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:12:57.910980 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7666255-1fbf-469d-b8f9-7b8fbf63b457 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:12:57.924952 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1963f835-bef7-4d98-96a9-c74171ad5422 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:12:57.925936 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1963f835-bef7-4d98-96a9-c74171ad5422 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:12:57.926342 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1963f835-bef7-4d98-96a9-c74171ad5422 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:12:57.926718 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1963f835-bef7-4d98-96a9-c74171ad5422 None admin] PATH_INFO: `/v3/projects/02e13d55192e4bfc8385150aa7249e83` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:12:57.928038 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1963f835-bef7-4d98-96a9-c74171ad5422 None admin] RBAC: Authorizing `identity:get_project(project_id=02e13d55192e4bfc8385150aa7249e83)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:12:57.931407 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1963f835-bef7-4d98-96a9-c74171ad5422 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:12:57.932867 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 89/175] 10.222.0.44 () {56 vars in 1186 bytes} [Thu Jun 16 12:12:57 2022] GET /identity/v3/projects/02e13d55192e4bfc8385150aa7249e83 => generated 298 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:12:57.934874 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b88753e-2880-4dfa-aa80-6f6ece5e14aa None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:12:57.934874 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b88753e-2880-4dfa-aa80-6f6ece5e14aa None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:12:57.934874 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b88753e-2880-4dfa-aa80-6f6ece5e14aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:12:57.954433 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-2b88753e-2880-4dfa-aa80-6f6ece5e14aa None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:12:57.956255 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-2b88753e-2880-4dfa-aa80-6f6ece5e14aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:12:57.997737 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12688b57-6ede-45f2-b03e-2c9ceaa2d8ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:12:57.998765 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12688b57-6ede-45f2-b03e-2c9ceaa2d8ea None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:12:57.999195 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12688b57-6ede-45f2-b03e-2c9ceaa2d8ea None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:12:57.999631 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12688b57-6ede-45f2-b03e-2c9ceaa2d8ea None admin] PATH_INFO: `/v3/roles` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:12:58.000590 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12688b57-6ede-45f2-b03e-2c9ceaa2d8ea None admin] RBAC: Adding query filter params (name=member) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:12:58.001150 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12688b57-6ede-45f2-b03e-2c9ceaa2d8ea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:12:58.001673 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:12:58.004412 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12688b57-6ede-45f2-b03e-2c9ceaa2d8ea None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:12:58.027589 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 87/176] 10.222.0.44 () {56 vars in 1101 bytes} [Thu Jun 16 12:12:57 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 410 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:12:58.027589 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12688b57-6ede-45f2-b03e-2c9ceaa2d8ea None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:12:58.070944 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 90/177] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 12:12:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 12:12:58.072118 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50963bb0-1034-4293-bc37-13bbe346124f None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:12:58.072406 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50963bb0-1034-4293-bc37-13bbe346124f None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:12:58.077191 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50963bb0-1034-4293-bc37-13bbe346124f None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:12:58.078554 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 91/178] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 12:12:58 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 12:12:58.082059 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50963bb0-1034-4293-bc37-13bbe346124f None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:12:58.173792 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12688b57-6ede-45f2-b03e-2c9ceaa2d8ea None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:12:58.199684 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:12:58.214991 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b40a13a-e69c-469c-af76-81bddd0a6422 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:12:58.215646 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b40a13a-e69c-469c-af76-81bddd0a6422 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:12:58.215925 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b40a13a-e69c-469c-af76-81bddd0a6422 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:12:58.216199 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b40a13a-e69c-469c-af76-81bddd0a6422 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:12:58.217066 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b40a13a-e69c-469c-af76-81bddd0a6422 None admin] RBAC: Adding query filter params (role.id=c39882b202e942479a7cdac2fc6da72c, scope.project.id=02e13d55192e4bfc8385150aa7249e83, user.id=057c3bd7c27f458f8c008fb91e974956) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:12:58.217434 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b40a13a-e69c-469c-af76-81bddd0a6422 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:12:58.218821 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b40a13a-e69c-469c-af76-81bddd0a6422 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:12:58.218933 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50963bb0-1034-4293-bc37-13bbe346124f None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:12:58.224672 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 88/179] 10.222.0.44 () {56 vars in 1374 bytes} [Thu Jun 16 12:12:58 2022] GET /identity/v3/role_assignments?user.id=057c3bd7c27f458f8c008fb91e974956&scope.project.id=02e13d55192e4bfc8385150aa7249e83&role.id=c39882b202e942479a7cdac2fc6da72c => generated 608 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:12:58.228077 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca519c7d-e23f-456c-849c-bd1b0ac9e3d8 None None] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:12:58.228371 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca519c7d-e23f-456c-849c-bd1b0ac9e3d8 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:12:58.228653 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca519c7d-e23f-456c-849c-bd1b0ac9e3d8 None None] PATH_INFO: `/` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:12:58.231007 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 89/180] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 12:12:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 12:12:58.232474 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe50464-37d6-4781-839c-86c1b2c6816a None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:12:58.232779 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe50464-37d6-4781-839c-86c1b2c6816a None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:12:58.233227 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe50464-37d6-4781-839c-86c1b2c6816a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:12:58.255012 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ebd432-d36e-4c76-8af6-13a0ad40a68d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:12:58.255271 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-cfe50464-37d6-4781-839c-86c1b2c6816a None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:12:58.255923 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ebd432-d36e-4c76-8af6-13a0ad40a68d None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:12:58.256204 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ebd432-d36e-4c76-8af6-13a0ad40a68d None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:12:58.256477 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ebd432-d36e-4c76-8af6-13a0ad40a68d None admin] PATH_INFO: `/v3/users/057c3bd7c27f458f8c008fb91e974956` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:12:58.256570 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-cfe50464-37d6-4781-839c-86c1b2c6816a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:12:58.257839 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ebd432-d36e-4c76-8af6-13a0ad40a68d None admin] RBAC: Authorizing `identity:get_user(user_id=057c3bd7c27f458f8c008fb91e974956)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:12:58.259373 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ebd432-d36e-4c76-8af6-13a0ad40a68d None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:12:58.265600 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 92/181] 10.222.0.44 () {56 vars in 1177 bytes} [Thu Jun 16 12:12:58 2022] GET /identity/v3/users/057c3bd7c27f458f8c008fb91e974956 => generated 275 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:12:58.265600 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ebd432-d36e-4c76-8af6-13a0ad40a68d None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:12:58.311385 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:12:58.339871 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 90/182] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 12:12:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 12:12:58.341610 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac7285d-f2f4-4286-b4f4-a9c8fb6df91a None None] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:12:58.341905 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac7285d-f2f4-4286-b4f4-a9c8fb6df91a None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:12:58.342181 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac7285d-f2f4-4286-b4f4-a9c8fb6df91a None None] PATH_INFO: `/` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:12:58.343502 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 91/183] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 12:12:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 12:12:58.344869 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca44a74-16ab-4826-91fc-c8b4fb1ce454 None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:12:58.345373 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca44a74-16ab-4826-91fc-c8b4fb1ce454 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:12:58.345853 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca44a74-16ab-4826-91fc-c8b4fb1ce454 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:12:58.374617 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-4ca44a74-16ab-4826-91fc-c8b4fb1ce454 None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:12:58.377160 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-4ca44a74-16ab-4826-91fc-c8b4fb1ce454 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:12:58.388132 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ebd432-d36e-4c76-8af6-13a0ad40a68d None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:12:58.433026 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c35563e-5dc2-4526-adf0-df0eba0cbb5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:12:58.433026 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c35563e-5dc2-4526-adf0-df0eba0cbb5a None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:12:58.433418 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c35563e-5dc2-4526-adf0-df0eba0cbb5a None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:12:58.433573 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c35563e-5dc2-4526-adf0-df0eba0cbb5a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:12:58.447916 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c35563e-5dc2-4526-adf0-df0eba0cbb5a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 12:12:58.455711 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-9c35563e-5dc2-4526-adf0-df0eba0cbb5a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 12:12:58.455711 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 12:12:58.455711 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 12:12:58.455711 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 12:12:58.455711 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 12:12:58.455711 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 12:12:58.455711 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 12:12:58.455711 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 12:12:58.455711 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 12:12:58.455711 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 12:12:58.455711 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 12:12:58.455711 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 12:12:58.455711 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 12:12:58.455711 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 12:12:58.455711 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 12:12:58.455711 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 12:12:58.456592 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 12:12:58.456592 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 12:12:58.456592 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 12:12:58.456592 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 12:12:58.456592 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 12:12:58.456592 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 12:12:58.456592 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 12:12:58.456592 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 12:12:58.456592 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 12:12:58.456592 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 12:12:58.456592 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 12:12:58.456592 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jun 16 12:12:58.456592 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 12:12:58.456592 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jun 16 12:12:58.456592 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 12:12:58.456592 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 12:12:58.457416 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 12:12:58.457416 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jun 16 12:12:58.457416 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 12:12:58.457416 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jun 16 12:12:58.457416 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 12:12:58.457416 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 12:12:58.457416 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 12:12:58.457416 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 12:12:58.457416 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 12:12:58.457416 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 12:12:58.457416 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 12:12:58.457416 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jun 16 12:12:58.457416 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 93/184] 10.222.0.44 () {56 vars in 1096 bytes} [Thu Jun 16 12:12:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 12:12:58.458045 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c35563e-5dc2-4526-adf0-df0eba0cbb5a None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:12:58.466990 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 92/185] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 12:12:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 12:12:58.469067 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca1a810-57cf-4e53-800d-b2ac43a71d92 None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:12:58.469361 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca1a810-57cf-4e53-800d-b2ac43a71d92 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:12:58.470019 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca1a810-57cf-4e53-800d-b2ac43a71d92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:12:58.487691 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-fca1a810-57cf-4e53-800d-b2ac43a71d92 None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:12:58.488921 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-fca1a810-57cf-4e53-800d-b2ac43a71d92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:12:58.528692 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:12:58.554286 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 93/186] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 12:12:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 12:12:58.555635 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca1a810-57cf-4e53-800d-b2ac43a71d92 None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:12:58.556637 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:12:58.561167 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c35563e-5dc2-4526-adf0-df0eba0cbb5a None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:12:58.597406 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddd8fdb-b6fa-4c9d-94af-19e3ab8335de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:12:58.598053 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddd8fdb-b6fa-4c9d-94af-19e3ab8335de None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:12:58.598333 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddd8fdb-b6fa-4c9d-94af-19e3ab8335de None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:12:58.598607 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddd8fdb-b6fa-4c9d-94af-19e3ab8335de None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:12:58.651892 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca1a810-57cf-4e53-800d-b2ac43a71d92 None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:12:58.665725 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dddd8fdb-b6fa-4c9d-94af-19e3ab8335de None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:12:58.667215 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dddd8fdb-b6fa-4c9d-94af-19e3ab8335de None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:12:58.685109 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067b0cb7-1246-488e-8fb3-437db1708951 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:12:58.686042 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067b0cb7-1246-488e-8fb3-437db1708951 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:12:58.686324 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067b0cb7-1246-488e-8fb3-437db1708951 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:12:58.686596 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067b0cb7-1246-488e-8fb3-437db1708951 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:12:58.697254 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067b0cb7-1246-488e-8fb3-437db1708951 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 12:12:58.704973 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application [None req-067b0cb7-1246-488e-8fb3-437db1708951 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 16 12:12:58.704973 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 12:12:58.704973 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 12:12:58.704973 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 12:12:58.704973 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 12:12:58.704973 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 12:12:58.704973 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 12:12:58.704973 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 12:12:58.704973 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 12:12:58.704973 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 12:12:58.704973 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 12:12:58.704973 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 12:12:58.704973 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 12:12:58.704973 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 12:12:58.704973 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 12:12:58.704973 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 12:12:58.706042 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 12:12:58.706042 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 12:12:58.706042 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 12:12:58.706042 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 12:12:58.706042 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 12:12:58.706042 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 12:12:58.706042 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 12:12:58.706042 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 12:12:58.706042 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 12:12:58.706042 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 12:12:58.706042 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 12:12:58.706042 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application with Lock( Jun 16 12:12:58.706042 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 12:12:58.706042 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._enter() Jun 16 12:12:58.706042 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 12:12:58.706042 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 12:12:58.706931 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 12:12:58.706931 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.creator() Jun 16 12:12:58.706931 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 12:12:58.706931 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application created_value = creator( Jun 16 12:12:58.706931 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 12:12:58.706931 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 12:12:58.706931 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 12:12:58.706931 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 12:12:58.706931 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 12:12:58.706931 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 12:12:58.706931 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 16 12:12:58.706931 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application Jun 16 12:12:58.706931 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 94/187] 10.222.0.44 () {56 vars in 1099 bytes} [Thu Jun 16 12:12:58 2022] GET /identity/v3/roles/reader => generated 84 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 12:12:58.706931 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067b0cb7-1246-488e-8fb3-437db1708951 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:12:58.740794 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:12:58.764323 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:12:58.769028 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 94/188] 10.222.0.44 () {58 vars in 1282 bytes} [Thu Jun 16 12:12:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 12:12:58.769941 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddd8fdb-b6fa-4c9d-94af-19e3ab8335de None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:12:58.811992 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067b0cb7-1246-488e-8fb3-437db1708951 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:12:58.845154 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933119b4-c9ae-4e79-a97c-78c089bbd348 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:12:58.845816 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933119b4-c9ae-4e79-a97c-78c089bbd348 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:12:58.846099 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933119b4-c9ae-4e79-a97c-78c089bbd348 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:12:58.846371 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933119b4-c9ae-4e79-a97c-78c089bbd348 None admin] PATH_INFO: `/v3/roles` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:12:58.847111 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933119b4-c9ae-4e79-a97c-78c089bbd348 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:12:58.847417 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933119b4-c9ae-4e79-a97c-78c089bbd348 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:12:58.848860 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933119b4-c9ae-4e79-a97c-78c089bbd348 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:12:58.857132 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 95/189] 10.222.0.44 () {56 vars in 1099 bytes} [Thu Jun 16 12:12:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:12:58.857132 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933119b4-c9ae-4e79-a97c-78c089bbd348 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:12:58.869713 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddd8fdb-b6fa-4c9d-94af-19e3ab8335de None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:12:58.903385 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3edfee-3217-4d74-ae0b-b2354a16d9e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:12:58.904171 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3edfee-3217-4d74-ae0b-b2354a16d9e6 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:12:58.904453 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3edfee-3217-4d74-ae0b-b2354a16d9e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:12:58.904724 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3edfee-3217-4d74-ae0b-b2354a16d9e6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:12:58.905931 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3edfee-3217-4d74-ae0b-b2354a16d9e6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:12:58.907371 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3edfee-3217-4d74-ae0b-b2354a16d9e6 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:12:58.909007 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 95/190] 10.222.0.44 () {56 vars in 1108 bytes} [Thu Jun 16 12:12:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:12:58.909756 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3edfee-3217-4d74-ae0b-b2354a16d9e6 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:12:58.959509 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:12:58.966281 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933119b4-c9ae-4e79-a97c-78c089bbd348 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:12:58.978142 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:12:58.999832 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eaba747-e35f-463c-9082-5d506fcf396b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:12:59.000648 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaba747-e35f-463c-9082-5d506fcf396b None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:12:59.000943 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaba747-e35f-463c-9082-5d506fcf396b None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:12:59.001218 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaba747-e35f-463c-9082-5d506fcf396b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:12:59.012605 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eaba747-e35f-463c-9082-5d506fcf396b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 12:12:59.013538 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3edfee-3217-4d74-ae0b-b2354a16d9e6 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:12:59.021094 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application [None req-9eaba747-e35f-463c-9082-5d506fcf396b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 12:12:59.021094 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 12:12:59.021094 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 12:12:59.021094 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 12:12:59.021094 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 12:12:59.021094 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 12:12:59.021094 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 12:12:59.021094 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 12:12:59.021094 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 12:12:59.021094 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 12:12:59.021094 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 12:12:59.021094 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 12:12:59.021094 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 12:12:59.021094 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 12:12:59.021094 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 12:12:59.021094 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 12:12:59.021954 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 12:12:59.021954 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 12:12:59.021954 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 12:12:59.021954 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 12:12:59.021954 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 12:12:59.021954 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 12:12:59.021954 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 12:12:59.021954 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 12:12:59.021954 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 12:12:59.021954 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 12:12:59.021954 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 12:12:59.021954 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application with Lock( Jun 16 12:12:59.021954 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 12:12:59.021954 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._enter() Jun 16 12:12:59.021954 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 12:12:59.021954 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 12:12:59.022751 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 12:12:59.022751 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.creator() Jun 16 12:12:59.022751 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 12:12:59.022751 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application created_value = creator( Jun 16 12:12:59.022751 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 12:12:59.022751 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 12:12:59.022751 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 12:12:59.022751 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 12:12:59.022751 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 12:12:59.022751 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 12:12:59.022751 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 12:12:59.022751 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application Jun 16 12:12:59.022751 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 96/191] 10.222.0.44 () {56 vars in 1114 bytes} [Thu Jun 16 12:12:58 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 12:12:59.023398 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eaba747-e35f-463c-9082-5d506fcf396b None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:12:59.052324 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2496fe9-bd80-4b76-9955-bd20a94afe91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:12:59.053016 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2496fe9-bd80-4b76-9955-bd20a94afe91 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:12:59.053306 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2496fe9-bd80-4b76-9955-bd20a94afe91 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:12:59.053593 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2496fe9-bd80-4b76-9955-bd20a94afe91 None admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:12:59.054323 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2496fe9-bd80-4b76-9955-bd20a94afe91 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:12:59.054626 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2496fe9-bd80-4b76-9955-bd20a94afe91 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:12:59.056527 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2496fe9-bd80-4b76-9955-bd20a94afe91 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:12:59.064444 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 96/192] 10.222.0.44 () {56 vars in 1101 bytes} [Thu Jun 16 12:12:58 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:12:59.065249 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2496fe9-bd80-4b76-9955-bd20a94afe91 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:12:59.121911 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eaba747-e35f-463c-9082-5d506fcf396b None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:12:59.154897 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b7466f-f378-4026-ad77-0227b2c0939e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:12:59.155751 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b7466f-f378-4026-ad77-0227b2c0939e None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:12:59.156034 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b7466f-f378-4026-ad77-0227b2c0939e None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:12:59.156308 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b7466f-f378-4026-ad77-0227b2c0939e None admin] PATH_INFO: `/v3/projects/05880ea4c4f744d2ae0ed40a19c054e7` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:12:59.157512 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b7466f-f378-4026-ad77-0227b2c0939e None admin] RBAC: Authorizing `identity:get_project(project_id=05880ea4c4f744d2ae0ed40a19c054e7)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:12:59.158963 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b7466f-f378-4026-ad77-0227b2c0939e None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:12:59.160639 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 97/193] 10.222.0.44 () {56 vars in 1186 bytes} [Thu Jun 16 12:12:59 2022] GET /identity/v3/projects/05880ea4c4f744d2ae0ed40a19c054e7 => generated 312 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:12:59.165819 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b7466f-f378-4026-ad77-0227b2c0939e None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:12:59.165931 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2496fe9-bd80-4b76-9955-bd20a94afe91 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:12:59.189317 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:12:59.192037 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:12:59.198402 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c804287f-4757-4d7d-9488-a2c0493069fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:12:59.199300 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c804287f-4757-4d7d-9488-a2c0493069fd None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:12:59.199585 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c804287f-4757-4d7d-9488-a2c0493069fd None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:12:59.199854 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c804287f-4757-4d7d-9488-a2c0493069fd None admin] PATH_INFO: `/v3/users/2eccf507000a493bb51415d6a8dcb709` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:12:59.213969 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c804287f-4757-4d7d-9488-a2c0493069fd None admin] RBAC: Authorizing `identity:get_user(user_id=2eccf507000a493bb51415d6a8dcb709)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:12:59.215621 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c804287f-4757-4d7d-9488-a2c0493069fd None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:12:59.217316 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 97/194] 10.222.0.44 () {56 vars in 1177 bytes} [Thu Jun 16 12:12:59 2022] GET /identity/v3/users/2eccf507000a493bb51415d6a8dcb709 => generated 283 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:12:59.220926 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c804287f-4757-4d7d-9488-a2c0493069fd None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:12:59.270259 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b7466f-f378-4026-ad77-0227b2c0939e None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:12:59.302973 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41c4b44-7a83-4e98-84b1-a06080970b57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:12:59.303639 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41c4b44-7a83-4e98-84b1-a06080970b57 None admin] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:12:59.303934 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41c4b44-7a83-4e98-84b1-a06080970b57 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:12:59.304203 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41c4b44-7a83-4e98-84b1-a06080970b57 None admin] PATH_INFO: `/v3/users` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:12:59.305462 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41c4b44-7a83-4e98-84b1-a06080970b57 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:12:59.306894 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41c4b44-7a83-4e98-84b1-a06080970b57 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:12:59.316354 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c804287f-4757-4d7d-9488-a2c0493069fd None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:12:59.333915 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 98/195] 10.222.0.44 () {60 vars in 1132 bytes} [Thu Jun 16 12:12:59 2022] POST /identity/v3/users => generated 297 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 12:12:59.334741 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41c4b44-7a83-4e98-84b1-a06080970b57 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:12:59.356636 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f75aa98-e433-431d-a869-1e3da8009a00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:12:59.357461 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f75aa98-e433-431d-a869-1e3da8009a00 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:12:59.357743 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f75aa98-e433-431d-a869-1e3da8009a00 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:12:59.358016 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f75aa98-e433-431d-a869-1e3da8009a00 None admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:12:59.359391 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f75aa98-e433-431d-a869-1e3da8009a00 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:12:59.359873 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f75aa98-e433-431d-a869-1e3da8009a00 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:12:59.361359 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f75aa98-e433-431d-a869-1e3da8009a00 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:12:59.372080 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 98/196] 10.222.0.44 () {56 vars in 1111 bytes} [Thu Jun 16 12:12:59 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:12:59.372691 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f75aa98-e433-431d-a869-1e3da8009a00 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:12:59.424565 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:12:59.429373 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:12:59.449070 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41c4b44-7a83-4e98-84b1-a06080970b57 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:12:59.487485 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f12d5d8-e1a0-47e7-b3d4-62a59ca80746 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:12:59.488293 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f12d5d8-e1a0-47e7-b3d4-62a59ca80746 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:12:59.488582 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f12d5d8-e1a0-47e7-b3d4-62a59ca80746 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:12:59.488885 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f12d5d8-e1a0-47e7-b3d4-62a59ca80746 None admin] PATH_INFO: `/v3/users/777678ad7bdb4716ad6ad7c9c3d3d0fe` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:12:59.489193 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f75aa98-e433-431d-a869-1e3da8009a00 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:12:59.490152 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f12d5d8-e1a0-47e7-b3d4-62a59ca80746 None admin] RBAC: Authorizing `identity:get_user(user_id=777678ad7bdb4716ad6ad7c9c3d3d0fe)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:12:59.491690 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f12d5d8-e1a0-47e7-b3d4-62a59ca80746 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:12:59.493941 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 99/197] 10.222.0.44 () {56 vars in 1177 bytes} [Thu Jun 16 12:12:59 2022] GET /identity/v3/users/777678ad7bdb4716ad6ad7c9c3d3d0fe => generated 289 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:12:59.498833 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f12d5d8-e1a0-47e7-b3d4-62a59ca80746 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:12:59.532167 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab83b39-3e5a-4dad-b9db-aac767cd4009 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:12:59.532859 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab83b39-3e5a-4dad-b9db-aac767cd4009 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:12:59.533141 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab83b39-3e5a-4dad-b9db-aac767cd4009 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:12:59.533417 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab83b39-3e5a-4dad-b9db-aac767cd4009 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:12:59.534252 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab83b39-3e5a-4dad-b9db-aac767cd4009 None admin] RBAC: Adding query filter params (role.id=c39882b202e942479a7cdac2fc6da72c, scope.project.id=05880ea4c4f744d2ae0ed40a19c054e7, user.id=057c3bd7c27f458f8c008fb91e974956) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:12:59.535141 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab83b39-3e5a-4dad-b9db-aac767cd4009 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:12:59.535998 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab83b39-3e5a-4dad-b9db-aac767cd4009 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:12:59.542526 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 99/198] 10.222.0.44 () {56 vars in 1374 bytes} [Thu Jun 16 12:12:59 2022] GET /identity/v3/role_assignments?user.id=057c3bd7c27f458f8c008fb91e974956&scope.project.id=05880ea4c4f744d2ae0ed40a19c054e7&role.id=c39882b202e942479a7cdac2fc6da72c => generated 608 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:12:59.543322 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab83b39-3e5a-4dad-b9db-aac767cd4009 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:12:59.638875 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f12d5d8-e1a0-47e7-b3d4-62a59ca80746 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:12:59.679052 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab83b39-3e5a-4dad-b9db-aac767cd4009 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:12:59.698810 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:12:59.699150 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f800eb8-d939-403e-b3f8-746bed39dad0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:12:59.700002 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f800eb8-d939-403e-b3f8-746bed39dad0 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:12:59.700414 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f800eb8-d939-403e-b3f8-746bed39dad0 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:12:59.700694 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f800eb8-d939-403e-b3f8-746bed39dad0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:12:59.727458 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:12:59.729432 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3116ea-0169-4a76-a6b8-fb2e5465f845 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:12:59.730323 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3116ea-0169-4a76-a6b8-fb2e5465f845 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:12:59.733693 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3116ea-0169-4a76-a6b8-fb2e5465f845 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:12:59.733838 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3116ea-0169-4a76-a6b8-fb2e5465f845 None admin] PATH_INFO: `/v3/users/2eccf507000a493bb51415d6a8dcb709` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:12:59.736173 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3116ea-0169-4a76-a6b8-fb2e5465f845 None admin] RBAC: Authorizing `identity:get_user(user_id=2eccf507000a493bb51415d6a8dcb709)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:12:59.737896 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3116ea-0169-4a76-a6b8-fb2e5465f845 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:12:59.739536 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 100/199] 10.222.0.44 () {56 vars in 1177 bytes} [Thu Jun 16 12:12:59 2022] GET /identity/v3/users/2eccf507000a493bb51415d6a8dcb709 => generated 283 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:12:59.740406 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3116ea-0169-4a76-a6b8-fb2e5465f845 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:12:59.805657 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f800eb8-d939-403e-b3f8-746bed39dad0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:12:59.807605 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f800eb8-d939-403e-b3f8-746bed39dad0 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:12:59.859578 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3116ea-0169-4a76-a6b8-fb2e5465f845 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:12:59.894687 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a00df7-7c2a-400b-af5f-37d6ddd5ecfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:12:59.895562 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a00df7-7c2a-400b-af5f-37d6ddd5ecfb None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:12:59.895683 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a00df7-7c2a-400b-af5f-37d6ddd5ecfb None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:12:59.895881 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a00df7-7c2a-400b-af5f-37d6ddd5ecfb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:12:59.928474 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 100/200] 10.222.0.44 () {58 vars in 1282 bytes} [Thu Jun 16 12:12:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 12:12:59.930602 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f800eb8-d939-403e-b3f8-746bed39dad0 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:12:59.949714 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:12:59.972424 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a00df7-7c2a-400b-af5f-37d6ddd5ecfb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:12:59.973989 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a00df7-7c2a-400b-af5f-37d6ddd5ecfb None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:12:59.987400 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:13:00.046494 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f800eb8-d939-403e-b3f8-746bed39dad0 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:00.081815 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 101/201] 10.222.0.44 () {58 vars in 1282 bytes} [Thu Jun 16 12:12:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 12:13:00.084802 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f1322c-44f8-4838-98f7-3afef973a5ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:00.085654 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a00df7-7c2a-400b-af5f-37d6ddd5ecfb None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:00.086033 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f1322c-44f8-4838-98f7-3afef973a5ad None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:00.087059 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f1322c-44f8-4838-98f7-3afef973a5ad None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:00.087531 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f1322c-44f8-4838-98f7-3afef973a5ad None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:00.168378 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f1322c-44f8-4838-98f7-3afef973a5ad None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:13:00.170499 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f1322c-44f8-4838-98f7-3afef973a5ad None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:13:00.179357 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:13:00.209338 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a00df7-7c2a-400b-af5f-37d6ddd5ecfb None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:00.230882 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:13:00.255638 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d195a7ab-2d00-4605-bc00-14e2b7375506 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:00.256492 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d195a7ab-2d00-4605-bc00-14e2b7375506 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:00.257035 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d195a7ab-2d00-4605-bc00-14e2b7375506 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:00.257317 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d195a7ab-2d00-4605-bc00-14e2b7375506 None admin] PATH_INFO: `/v3/projects/1adc255cfb4744c1b467603311c319e7` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:00.260170 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d195a7ab-2d00-4605-bc00-14e2b7375506 None admin] RBAC: Authorizing `identity:get_project(project_id=1adc255cfb4744c1b467603311c319e7)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:13:00.261669 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d195a7ab-2d00-4605-bc00-14e2b7375506 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:13:00.263374 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 102/202] 10.222.0.44 () {56 vars in 1186 bytes} [Thu Jun 16 12:13:00 2022] GET /identity/v3/projects/1adc255cfb4744c1b467603311c319e7 => generated 302 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:13:00.264211 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d195a7ab-2d00-4605-bc00-14e2b7375506 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:00.302622 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 101/203] 10.222.0.44 () {58 vars in 1282 bytes} [Thu Jun 16 12:12:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 12:13:00.302622 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f1322c-44f8-4838-98f7-3afef973a5ad None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:00.392346 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d195a7ab-2d00-4605-bc00-14e2b7375506 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:00.404914 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f1322c-44f8-4838-98f7-3afef973a5ad None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:00.431740 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0da65a-0cd3-4e82-9001-c879f0ac6071 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:00.432961 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0da65a-0cd3-4e82-9001-c879f0ac6071 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:00.433482 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0da65a-0cd3-4e82-9001-c879f0ac6071 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:00.433895 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0da65a-0cd3-4e82-9001-c879f0ac6071 None admin] PATH_INFO: `/v3/projects/02e13d55192e4bfc8385150aa7249e83` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:00.435257 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0da65a-0cd3-4e82-9001-c879f0ac6071 None admin] RBAC: Authorizing `identity:get_project(project_id=02e13d55192e4bfc8385150aa7249e83)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:13:00.437095 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0da65a-0cd3-4e82-9001-c879f0ac6071 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:13:00.439456 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 103/204] 10.222.0.44 () {56 vars in 1186 bytes} [Thu Jun 16 12:13:00 2022] GET /identity/v3/projects/02e13d55192e4bfc8385150aa7249e83 => generated 298 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:13:00.440530 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0da65a-0cd3-4e82-9001-c879f0ac6071 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:00.451827 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63eacaf9-a553-43db-876d-5a2d39fc1688 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:00.452743 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63eacaf9-a553-43db-876d-5a2d39fc1688 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:00.453557 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63eacaf9-a553-43db-876d-5a2d39fc1688 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:00.454148 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63eacaf9-a553-43db-876d-5a2d39fc1688 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:00.455240 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63eacaf9-a553-43db-876d-5a2d39fc1688 None admin] RBAC: Adding query filter params (role.id=0688968254744e3f9913653cafea3091, scope.project.id=1adc255cfb4744c1b467603311c319e7, user.id=2eccf507000a493bb51415d6a8dcb709) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:13:00.455976 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63eacaf9-a553-43db-876d-5a2d39fc1688 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:13:00.458309 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63eacaf9-a553-43db-876d-5a2d39fc1688 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:13:00.459625 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:13:00.467322 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 102/205] 10.222.0.44 () {56 vars in 1374 bytes} [Thu Jun 16 12:13:00 2022] GET /identity/v3/role_assignments?user.id=2eccf507000a493bb51415d6a8dcb709&scope.project.id=1adc255cfb4744c1b467603311c319e7&role.id=0688968254744e3f9913653cafea3091 => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:13:00.468291 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63eacaf9-a553-43db-876d-5a2d39fc1688 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:00.500030 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:13:00.614490 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0da65a-0cd3-4e82-9001-c879f0ac6071 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:00.644411 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63eacaf9-a553-43db-876d-5a2d39fc1688 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:00.662841 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3a7953-fcde-463e-b0e0-bf1574dabb2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:00.663956 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3a7953-fcde-463e-b0e0-bf1574dabb2e None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:00.665004 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3a7953-fcde-463e-b0e0-bf1574dabb2e None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:00.665439 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3a7953-fcde-463e-b0e0-bf1574dabb2e None admin] PATH_INFO: `/v3/projects/1adc255cfb4744c1b467603311c319e7` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:00.669797 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3a7953-fcde-463e-b0e0-bf1574dabb2e None admin] RBAC: Authorizing `identity:get_project(project_id=1adc255cfb4744c1b467603311c319e7)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:13:00.671452 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3a7953-fcde-463e-b0e0-bf1574dabb2e None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:13:00.677459 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 104/206] 10.222.0.44 () {56 vars in 1186 bytes} [Thu Jun 16 12:13:00 2022] GET /identity/v3/projects/1adc255cfb4744c1b467603311c319e7 => generated 302 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:13:00.682866 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b22ddd8-05ad-46b3-8a68-51f5d1cf1624 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:00.683712 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b22ddd8-05ad-46b3-8a68-51f5d1cf1624 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:00.684086 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b22ddd8-05ad-46b3-8a68-51f5d1cf1624 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:00.684671 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b22ddd8-05ad-46b3-8a68-51f5d1cf1624 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:00.684835 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3a7953-fcde-463e-b0e0-bf1574dabb2e None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:00.685732 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b22ddd8-05ad-46b3-8a68-51f5d1cf1624 None admin] RBAC: Adding query filter params (role.id=8b8940c737364011a624755f642bf504, scope.project.id=02e13d55192e4bfc8385150aa7249e83, user.id=777678ad7bdb4716ad6ad7c9c3d3d0fe) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:13:00.686360 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b22ddd8-05ad-46b3-8a68-51f5d1cf1624 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:13:00.688174 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b22ddd8-05ad-46b3-8a68-51f5d1cf1624 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:13:00.704797 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 103/207] 10.222.0.44 () {56 vars in 1374 bytes} [Thu Jun 16 12:13:00 2022] GET /identity/v3/role_assignments?user.id=777678ad7bdb4716ad6ad7c9c3d3d0fe&scope.project.id=02e13d55192e4bfc8385150aa7249e83&role.id=8b8940c737364011a624755f642bf504 => generated 608 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:13:00.799277 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:13:00.817837 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3a7953-fcde-463e-b0e0-bf1574dabb2e None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:00.857748 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a202468b-f478-4182-abf8-07a6cb77e76a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:00.858665 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a202468b-f478-4182-abf8-07a6cb77e76a None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:00.859114 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a202468b-f478-4182-abf8-07a6cb77e76a None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:00.859538 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a202468b-f478-4182-abf8-07a6cb77e76a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:00.860556 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a202468b-f478-4182-abf8-07a6cb77e76a None admin] RBAC: Adding query filter params (role.id=e24b3707bc514b1fa606efab092047e6, scope.project.id=1adc255cfb4744c1b467603311c319e7, user.id=2eccf507000a493bb51415d6a8dcb709) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:13:00.861060 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a202468b-f478-4182-abf8-07a6cb77e76a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:13:00.862694 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a202468b-f478-4182-abf8-07a6cb77e76a None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:13:00.869603 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 105/208] 10.222.0.44 () {56 vars in 1374 bytes} [Thu Jun 16 12:13:00 2022] GET /identity/v3/role_assignments?user.id=2eccf507000a493bb51415d6a8dcb709&scope.project.id=1adc255cfb4744c1b467603311c319e7&role.id=e24b3707bc514b1fa606efab092047e6 => generated 259 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 12:13:01.783609 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6340206e-3f1c-4f44-a76d-f06be7ae3397 None None] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:01.784176 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6340206e-3f1c-4f44-a76d-f06be7ae3397 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:01.784437 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6340206e-3f1c-4f44-a76d-f06be7ae3397 None None] PATH_INFO: `/` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:01.786056 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 104/209] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 12:13:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 12:13:01.792491 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc42ac6-c33a-46c3-a09b-488b57014c6f None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:01.793395 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc42ac6-c33a-46c3-a09b-488b57014c6f None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:01.793891 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc42ac6-c33a-46c3-a09b-488b57014c6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:01.813102 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-5fc42ac6-c33a-46c3-a09b-488b57014c6f None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:13:01.814719 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-5fc42ac6-c33a-46c3-a09b-488b57014c6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:13:01.883002 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a224ce-224e-4e0b-943c-e16cf744f742 None None] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:01.883618 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a224ce-224e-4e0b-943c-e16cf744f742 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:01.884121 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a224ce-224e-4e0b-943c-e16cf744f742 None None] PATH_INFO: `/` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:01.886082 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 105/210] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 12:13:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 12:13:01.887748 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 106/211] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 12:13:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 12:13:01.893762 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731e8293-7fc4-438d-b7ad-f07964f52917 None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:01.894056 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731e8293-7fc4-438d-b7ad-f07964f52917 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:01.894333 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731e8293-7fc4-438d-b7ad-f07964f52917 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:01.915368 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-731e8293-7fc4-438d-b7ad-f07964f52917 None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:13:01.916556 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-731e8293-7fc4-438d-b7ad-f07964f52917 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:13:01.918689 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc42ac6-c33a-46c3-a09b-488b57014c6f None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:02.012370 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 106/212] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 12:13:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 12:13:02.020537 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:13:02.044069 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731e8293-7fc4-438d-b7ad-f07964f52917 None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:02.046826 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc42ac6-c33a-46c3-a09b-488b57014c6f None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:02.052615 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:13:02.083170 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50b8926-f423-4adc-bb03-23b078348a47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:02.083971 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50b8926-f423-4adc-bb03-23b078348a47 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:02.084250 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50b8926-f423-4adc-bb03-23b078348a47 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:02.084521 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50b8926-f423-4adc-bb03-23b078348a47 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:02.095792 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50b8926-f423-4adc-bb03-23b078348a47 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 12:13:02.104229 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-c50b8926-f423-4adc-bb03-23b078348a47 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 16 12:13:02.104229 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 12:13:02.104229 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 12:13:02.104229 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 12:13:02.104229 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 12:13:02.104229 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 12:13:02.104229 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 12:13:02.104229 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 12:13:02.104229 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 12:13:02.104229 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 12:13:02.104229 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 12:13:02.104229 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 12:13:02.104229 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 12:13:02.104229 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 12:13:02.104229 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 12:13:02.104229 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 12:13:02.105140 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 12:13:02.105140 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 12:13:02.105140 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 12:13:02.105140 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 12:13:02.105140 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 12:13:02.105140 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 12:13:02.105140 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 12:13:02.105140 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 12:13:02.105140 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 12:13:02.105140 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 12:13:02.105140 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 12:13:02.105140 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jun 16 12:13:02.105140 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 12:13:02.105140 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jun 16 12:13:02.105140 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 12:13:02.105140 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 12:13:02.106099 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 12:13:02.106099 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jun 16 12:13:02.106099 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 12:13:02.106099 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jun 16 12:13:02.106099 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 12:13:02.106099 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 12:13:02.106099 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 12:13:02.106099 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 12:13:02.106099 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 12:13:02.106099 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 12:13:02.106099 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 16 12:13:02.106099 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jun 16 12:13:02.106099 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 107/213] 10.222.0.44 () {56 vars in 1099 bytes} [Thu Jun 16 12:13:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 12:13:02.112521 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50b8926-f423-4adc-bb03-23b078348a47 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:02.148397 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731e8293-7fc4-438d-b7ad-f07964f52917 None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:02.190210 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36455a51-c857-465d-b6ec-5c7a8cf3fcb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:02.190997 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36455a51-c857-465d-b6ec-5c7a8cf3fcb9 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:02.191279 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36455a51-c857-465d-b6ec-5c7a8cf3fcb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:02.191550 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36455a51-c857-465d-b6ec-5c7a8cf3fcb9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:02.192847 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36455a51-c857-465d-b6ec-5c7a8cf3fcb9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:13:02.194287 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36455a51-c857-465d-b6ec-5c7a8cf3fcb9 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:13:02.196137 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 107/214] 10.222.0.44 () {56 vars in 1108 bytes} [Thu Jun 16 12:13:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 12:13:02.201486 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36455a51-c857-465d-b6ec-5c7a8cf3fcb9 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:02.237025 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50b8926-f423-4adc-bb03-23b078348a47 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:02.271026 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad409b15-fad6-46bd-a47c-e1bd440e0f20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:02.271705 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad409b15-fad6-46bd-a47c-e1bd440e0f20 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:02.271981 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad409b15-fad6-46bd-a47c-e1bd440e0f20 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:02.272256 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad409b15-fad6-46bd-a47c-e1bd440e0f20 None admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:02.273030 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad409b15-fad6-46bd-a47c-e1bd440e0f20 None admin] RBAC: Adding query filter params (name=member) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:13:02.273335 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad409b15-fad6-46bd-a47c-e1bd440e0f20 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:13:02.275251 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad409b15-fad6-46bd-a47c-e1bd440e0f20 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:13:02.280376 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:13:02.284278 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 108/215] 10.222.0.44 () {56 vars in 1101 bytes} [Thu Jun 16 12:13:02 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 12:13:02.290214 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad409b15-fad6-46bd-a47c-e1bd440e0f20 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:02.301198 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:13:02.313554 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36455a51-c857-465d-b6ec-5c7a8cf3fcb9 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:02.352245 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfa0826-5da3-45f2-b3bd-9cabc56be872 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:02.353085 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfa0826-5da3-45f2-b3bd-9cabc56be872 None admin] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:02.353467 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfa0826-5da3-45f2-b3bd-9cabc56be872 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:02.353845 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfa0826-5da3-45f2-b3bd-9cabc56be872 None admin] PATH_INFO: `/v3/users` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:02.354863 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfa0826-5da3-45f2-b3bd-9cabc56be872 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:13:02.356499 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfa0826-5da3-45f2-b3bd-9cabc56be872 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:13:02.385230 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 108/216] 10.222.0.44 () {60 vars in 1132 bytes} [Thu Jun 16 12:13:02 2022] POST /identity/v3/users => generated 297 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 12:13:02.394514 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad409b15-fad6-46bd-a47c-e1bd440e0f20 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:02.433769 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa04ff2a-7ad1-45f8-a79b-208d9727ade4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:02.434665 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa04ff2a-7ad1-45f8-a79b-208d9727ade4 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:02.434948 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa04ff2a-7ad1-45f8-a79b-208d9727ade4 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:02.435221 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa04ff2a-7ad1-45f8-a79b-208d9727ade4 None admin] PATH_INFO: `/v3/users/d8992e1259da4db2b5acf4a426b1708a` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:02.451748 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa04ff2a-7ad1-45f8-a79b-208d9727ade4 None admin] RBAC: Authorizing `identity:get_user(user_id=d8992e1259da4db2b5acf4a426b1708a)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:13:02.453281 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa04ff2a-7ad1-45f8-a79b-208d9727ade4 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:13:02.455306 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 109/217] 10.222.0.44 () {56 vars in 1177 bytes} [Thu Jun 16 12:13:02 2022] GET /identity/v3/users/d8992e1259da4db2b5acf4a426b1708a => generated 297 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 12:13:02.460827 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfa0826-5da3-45f2-b3bd-9cabc56be872 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:02.583955 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfa0826-5da3-45f2-b3bd-9cabc56be872 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:02.614458 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:13:02.621774 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8bbd8e-1764-4f6c-ab21-1545f12babee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:02.622671 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8bbd8e-1764-4f6c-ab21-1545f12babee None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:02.623122 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8bbd8e-1764-4f6c-ab21-1545f12babee None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:02.623571 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8bbd8e-1764-4f6c-ab21-1545f12babee None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:02.695308 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8bbd8e-1764-4f6c-ab21-1545f12babee None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:13:02.697612 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8bbd8e-1764-4f6c-ab21-1545f12babee None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:13:02.814126 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 109/218] 10.222.0.44 () {58 vars in 1282 bytes} [Thu Jun 16 12:13:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 12:13:02.820205 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa04ff2a-7ad1-45f8-a79b-208d9727ade4 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:02.888715 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:13:02.910310 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b169846d-9f57-437c-8fd7-a61f9e1cac8a None None] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:02.910595 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b169846d-9f57-437c-8fd7-a61f9e1cac8a None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:02.910874 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b169846d-9f57-437c-8fd7-a61f9e1cac8a None None] PATH_INFO: `/` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:02.912254 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 110/219] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 12:13:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 12:13:02.923080 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a245f0f5-4bed-4aa5-890c-7d71a56f6cbf None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:02.923586 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a245f0f5-4bed-4aa5-890c-7d71a56f6cbf None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:02.924042 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a245f0f5-4bed-4aa5-890c-7d71a56f6cbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:02.941924 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa04ff2a-7ad1-45f8-a79b-208d9727ade4 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:02.947813 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-a245f0f5-4bed-4aa5-890c-7d71a56f6cbf None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:13:02.949245 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-a245f0f5-4bed-4aa5-890c-7d71a56f6cbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:13:02.983061 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46eb6e83-ef61-4c46-8537-b79904b3f166 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:02.983934 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46eb6e83-ef61-4c46-8537-b79904b3f166 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:02.984212 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46eb6e83-ef61-4c46-8537-b79904b3f166 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:02.984485 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46eb6e83-ef61-4c46-8537-b79904b3f166 None admin] PATH_INFO: `/v3/projects/1adc255cfb4744c1b467603311c319e7` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:02.985879 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46eb6e83-ef61-4c46-8537-b79904b3f166 None admin] RBAC: Authorizing `identity:get_project(project_id=1adc255cfb4744c1b467603311c319e7)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:13:02.987364 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46eb6e83-ef61-4c46-8537-b79904b3f166 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:13:02.989306 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 110/220] 10.222.0.44 () {56 vars in 1186 bytes} [Thu Jun 16 12:13:02 2022] GET /identity/v3/projects/1adc255cfb4744c1b467603311c319e7 => generated 302 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:13:02.996185 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46eb6e83-ef61-4c46-8537-b79904b3f166 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:03.013160 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:13:03.094389 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 111/221] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 12:13:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 12:13:03.096080 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c75ed2-5c70-4fd2-82ea-a5646698a75f None None] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:03.096568 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c75ed2-5c70-4fd2-82ea-a5646698a75f None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:03.097062 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c75ed2-5c70-4fd2-82ea-a5646698a75f None None] PATH_INFO: `/` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:03.103382 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 112/222] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 12:13:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 12:13:03.105201 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b4d724-f0a6-4131-8176-5bfc0886e802 None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:03.105716 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b4d724-f0a6-4131-8176-5bfc0886e802 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:03.106194 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b4d724-f0a6-4131-8176-5bfc0886e802 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:03.123504 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-59b4d724-f0a6-4131-8176-5bfc0886e802 None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:13:03.125101 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-59b4d724-f0a6-4131-8176-5bfc0886e802 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:13:03.174178 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46eb6e83-ef61-4c46-8537-b79904b3f166 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:03.197915 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 113/223] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 12:13:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 12:13:03.200798 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b4d724-f0a6-4131-8176-5bfc0886e802 None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:03.207776 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:13:03.226222 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34000d90-3cd5-47a4-8912-451f7e080c96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:03.227428 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34000d90-3cd5-47a4-8912-451f7e080c96 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:03.227874 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34000d90-3cd5-47a4-8912-451f7e080c96 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:03.228154 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34000d90-3cd5-47a4-8912-451f7e080c96 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:03.229341 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34000d90-3cd5-47a4-8912-451f7e080c96 None admin] RBAC: Adding query filter params (role.id=c39882b202e942479a7cdac2fc6da72c, scope.project.id=1adc255cfb4744c1b467603311c319e7, user.id=d8992e1259da4db2b5acf4a426b1708a) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:13:03.229656 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34000d90-3cd5-47a4-8912-451f7e080c96 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:13:03.231115 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34000d90-3cd5-47a4-8912-451f7e080c96 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:13:03.239566 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 111/224] 10.222.0.44 () {56 vars in 1374 bytes} [Thu Jun 16 12:13:02 2022] GET /identity/v3/role_assignments?user.id=d8992e1259da4db2b5acf4a426b1708a&scope.project.id=1adc255cfb4744c1b467603311c319e7&role.id=c39882b202e942479a7cdac2fc6da72c => generated 259 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 12:13:03.240453 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34000d90-3cd5-47a4-8912-451f7e080c96 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:03.362506 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:13:03.381175 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b4d724-f0a6-4131-8176-5bfc0886e802 None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:03.440131 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34000d90-3cd5-47a4-8912-451f7e080c96 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:03.447813 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c75c32d-50be-49a1-80c8-41b27b3a251a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:03.448744 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c75c32d-50be-49a1-80c8-41b27b3a251a None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:03.449171 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c75c32d-50be-49a1-80c8-41b27b3a251a None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:03.449541 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c75c32d-50be-49a1-80c8-41b27b3a251a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:03.463903 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c75c32d-50be-49a1-80c8-41b27b3a251a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 12:13:03.473957 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application [None req-7c75c32d-50be-49a1-80c8-41b27b3a251a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 12:13:03.473957 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 12:13:03.473957 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 12:13:03.473957 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 12:13:03.473957 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 12:13:03.473957 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 12:13:03.473957 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 12:13:03.473957 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 12:13:03.473957 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 12:13:03.473957 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 12:13:03.473957 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 12:13:03.473957 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 12:13:03.473957 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 12:13:03.473957 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 12:13:03.473957 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 12:13:03.473957 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 12:13:03.475052 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 12:13:03.475052 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 12:13:03.475052 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 12:13:03.475052 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 12:13:03.475052 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 12:13:03.475052 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 12:13:03.475052 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 12:13:03.475052 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 12:13:03.475052 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 12:13:03.475052 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 12:13:03.475052 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 12:13:03.475052 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application with Lock( Jun 16 12:13:03.475052 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 12:13:03.475052 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._enter() Jun 16 12:13:03.475052 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 12:13:03.475052 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 12:13:03.476029 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 12:13:03.476029 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.creator() Jun 16 12:13:03.476029 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 12:13:03.476029 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application created_value = creator( Jun 16 12:13:03.476029 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 12:13:03.476029 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 12:13:03.476029 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 12:13:03.476029 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 12:13:03.476029 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 12:13:03.476029 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 12:13:03.476029 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 12:13:03.476029 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application Jun 16 12:13:03.476029 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 114/225] 10.222.0.44 () {56 vars in 1096 bytes} [Thu Jun 16 12:13:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 12:13:03.481454 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c75c32d-50be-49a1-80c8-41b27b3a251a None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:03.482889 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5b211b-5ecd-4b98-a94c-98da7b4019da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:03.483757 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5b211b-5ecd-4b98-a94c-98da7b4019da None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:03.484039 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5b211b-5ecd-4b98-a94c-98da7b4019da None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:03.484312 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5b211b-5ecd-4b98-a94c-98da7b4019da None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:03.496317 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5b211b-5ecd-4b98-a94c-98da7b4019da None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 12:13:03.504689 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-db5b211b-5ecd-4b98-a94c-98da7b4019da None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 12:13:03.504689 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 12:13:03.504689 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 12:13:03.504689 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 12:13:03.504689 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 12:13:03.504689 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 12:13:03.504689 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 12:13:03.504689 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 12:13:03.504689 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 12:13:03.504689 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 12:13:03.504689 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 12:13:03.504689 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 12:13:03.504689 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 12:13:03.504689 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 12:13:03.504689 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 12:13:03.504689 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 12:13:03.506832 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 12:13:03.506832 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 12:13:03.506832 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 12:13:03.506832 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 12:13:03.506832 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 12:13:03.506832 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 12:13:03.506832 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 12:13:03.506832 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 12:13:03.506832 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 12:13:03.506832 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 12:13:03.506832 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 12:13:03.506832 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jun 16 12:13:03.506832 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 12:13:03.506832 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jun 16 12:13:03.506832 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 12:13:03.506832 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 12:13:03.508829 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 12:13:03.508829 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jun 16 12:13:03.508829 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 12:13:03.508829 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jun 16 12:13:03.508829 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 12:13:03.508829 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 12:13:03.508829 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 12:13:03.508829 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 12:13:03.508829 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 12:13:03.508829 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 12:13:03.508829 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 12:13:03.508829 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jun 16 12:13:03.508829 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 112/226] 10.222.0.44 () {56 vars in 1114 bytes} [Thu Jun 16 12:13:03 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 12:13:03.516085 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5b211b-5ecd-4b98-a94c-98da7b4019da None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:03.581158 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:13:03.605346 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c75c32d-50be-49a1-80c8-41b27b3a251a None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:03.642656 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f09105f-c59e-4790-a664-2ee03a29f377 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:03.643329 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f09105f-c59e-4790-a664-2ee03a29f377 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:03.643609 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f09105f-c59e-4790-a664-2ee03a29f377 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:03.644016 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f09105f-c59e-4790-a664-2ee03a29f377 None admin] PATH_INFO: `/v3/roles` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:03.644786 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f09105f-c59e-4790-a664-2ee03a29f377 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:13:03.645097 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f09105f-c59e-4790-a664-2ee03a29f377 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:13:03.646636 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f09105f-c59e-4790-a664-2ee03a29f377 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:13:03.656265 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 115/227] 10.222.0.44 () {56 vars in 1099 bytes} [Thu Jun 16 12:13:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 12:13:03.661647 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f09105f-c59e-4790-a664-2ee03a29f377 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:03.678549 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:13:03.700340 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5b211b-5ecd-4b98-a94c-98da7b4019da None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:03.769592 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731fceb5-b419-4a67-b4db-12963516c787 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:03.770404 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731fceb5-b419-4a67-b4db-12963516c787 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:03.770681 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731fceb5-b419-4a67-b4db-12963516c787 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:03.771833 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731fceb5-b419-4a67-b4db-12963516c787 None admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:03.772595 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731fceb5-b419-4a67-b4db-12963516c787 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:13:03.772926 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731fceb5-b419-4a67-b4db-12963516c787 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:13:03.774833 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731fceb5-b419-4a67-b4db-12963516c787 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:13:03.792430 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 113/228] 10.222.0.44 () {56 vars in 1111 bytes} [Thu Jun 16 12:13:03 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 12:13:03.799141 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731fceb5-b419-4a67-b4db-12963516c787 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:03.811193 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f09105f-c59e-4790-a664-2ee03a29f377 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:03.879110 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3793381a-8702-4d13-9c62-15bf934a1285 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:03.879994 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3793381a-8702-4d13-9c62-15bf934a1285 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:03.880276 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3793381a-8702-4d13-9c62-15bf934a1285 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:03.884774 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3793381a-8702-4d13-9c62-15bf934a1285 None admin] PATH_INFO: `/v3/users/2eccf507000a493bb51415d6a8dcb709` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:03.884774 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3793381a-8702-4d13-9c62-15bf934a1285 None admin] RBAC: Authorizing `identity:get_user(user_id=2eccf507000a493bb51415d6a8dcb709)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:13:03.885150 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3793381a-8702-4d13-9c62-15bf934a1285 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:13:03.887965 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 116/229] 10.222.0.44 () {56 vars in 1177 bytes} [Thu Jun 16 12:13:03 2022] GET /identity/v3/users/2eccf507000a493bb51415d6a8dcb709 => generated 283 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:13:03.895089 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3793381a-8702-4d13-9c62-15bf934a1285 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:03.987065 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731fceb5-b419-4a67-b4db-12963516c787 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:04.017061 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:13:04.023127 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:13:04.049258 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d50fac3-a4a3-4631-97d1-c33f05a83c19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:04.050419 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d50fac3-a4a3-4631-97d1-c33f05a83c19 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:04.050707 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d50fac3-a4a3-4631-97d1-c33f05a83c19 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:04.051146 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d50fac3-a4a3-4631-97d1-c33f05a83c19 None admin] PATH_INFO: `/v3/users/2eccf507000a493bb51415d6a8dcb709` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:04.052728 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d50fac3-a4a3-4631-97d1-c33f05a83c19 None admin] RBAC: Authorizing `identity:get_user(user_id=2eccf507000a493bb51415d6a8dcb709)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:13:04.054370 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d50fac3-a4a3-4631-97d1-c33f05a83c19 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:13:04.056486 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 114/230] 10.222.0.44 () {56 vars in 1177 bytes} [Thu Jun 16 12:13:03 2022] GET /identity/v3/users/2eccf507000a493bb51415d6a8dcb709 => generated 283 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:13:04.062144 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d50fac3-a4a3-4631-97d1-c33f05a83c19 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:04.066560 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3793381a-8702-4d13-9c62-15bf934a1285 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:04.173137 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d50fac3-a4a3-4631-97d1-c33f05a83c19 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:04.197447 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598861ca-65e3-49ed-b166-9cf8ef40134b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:04.198642 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598861ca-65e3-49ed-b166-9cf8ef40134b None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:04.199117 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598861ca-65e3-49ed-b166-9cf8ef40134b None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:04.199600 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598861ca-65e3-49ed-b166-9cf8ef40134b None admin] PATH_INFO: `/v3/projects/1adc255cfb4744c1b467603311c319e7` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:04.205533 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598861ca-65e3-49ed-b166-9cf8ef40134b None admin] RBAC: Authorizing `identity:get_project(project_id=1adc255cfb4744c1b467603311c319e7)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:13:04.207361 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598861ca-65e3-49ed-b166-9cf8ef40134b None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:13:04.207680 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2ad47c-b621-434e-be6a-8e284a3db164 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:04.208542 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2ad47c-b621-434e-be6a-8e284a3db164 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:04.208870 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2ad47c-b621-434e-be6a-8e284a3db164 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:04.209152 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2ad47c-b621-434e-be6a-8e284a3db164 None admin] PATH_INFO: `/v3/projects/1adc255cfb4744c1b467603311c319e7` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:04.210270 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 117/231] 10.222.0.44 () {56 vars in 1186 bytes} [Thu Jun 16 12:13:03 2022] GET /identity/v3/projects/1adc255cfb4744c1b467603311c319e7 => generated 302 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:13:04.210649 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2ad47c-b621-434e-be6a-8e284a3db164 None admin] RBAC: Authorizing `identity:get_project(project_id=1adc255cfb4744c1b467603311c319e7)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:13:04.212658 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2ad47c-b621-434e-be6a-8e284a3db164 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:13:04.214530 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 115/232] 10.222.0.44 () {56 vars in 1186 bytes} [Thu Jun 16 12:13:04 2022] GET /identity/v3/projects/1adc255cfb4744c1b467603311c319e7 => generated 302 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:13:04.216287 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598861ca-65e3-49ed-b166-9cf8ef40134b None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:04.220399 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2ad47c-b621-434e-be6a-8e284a3db164 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:04.275931 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:13:04.331322 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2ad47c-b621-434e-be6a-8e284a3db164 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:04.368194 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207a468e-9d36-465f-9d2b-1e229be08700 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:04.369434 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207a468e-9d36-465f-9d2b-1e229be08700 None admin] REQUEST_METHOD: `PUT` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:04.369828 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207a468e-9d36-465f-9d2b-1e229be08700 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:04.370206 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207a468e-9d36-465f-9d2b-1e229be08700 None admin] PATH_INFO: `/v3/projects/1adc255cfb4744c1b467603311c319e7/users/2eccf507000a493bb51415d6a8dcb709/roles/e24b3707bc514b1fa606efab092047e6` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:04.372956 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207a468e-9d36-465f-9d2b-1e229be08700 None admin] RBAC: Authorizing `identity:create_grant(project_id=1adc255cfb4744c1b467603311c319e7, user_id=2eccf507000a493bb51415d6a8dcb709, role_id=e24b3707bc514b1fa606efab092047e6)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:13:04.380773 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207a468e-9d36-465f-9d2b-1e229be08700 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:13:04.392193 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 116/233] 10.222.0.44 () {58 vars in 1439 bytes} [Thu Jun 16 12:13:04 2022] PUT /identity/v3/projects/1adc255cfb4744c1b467603311c319e7/users/2eccf507000a493bb51415d6a8dcb709/roles/e24b3707bc514b1fa606efab092047e6 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 12:13:04.480522 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598861ca-65e3-49ed-b166-9cf8ef40134b None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:04.541637 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec18366-6aa1-4f78-87f3-592bf157c257 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:04.542798 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec18366-6aa1-4f78-87f3-592bf157c257 None admin] REQUEST_METHOD: `PUT` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:04.543222 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec18366-6aa1-4f78-87f3-592bf157c257 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:04.543654 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec18366-6aa1-4f78-87f3-592bf157c257 None admin] PATH_INFO: `/v3/projects/1adc255cfb4744c1b467603311c319e7/users/2eccf507000a493bb51415d6a8dcb709/roles/0688968254744e3f9913653cafea3091` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:04.546285 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec18366-6aa1-4f78-87f3-592bf157c257 None admin] RBAC: Authorizing `identity:create_grant(project_id=1adc255cfb4744c1b467603311c319e7, user_id=2eccf507000a493bb51415d6a8dcb709, role_id=0688968254744e3f9913653cafea3091)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:13:04.547946 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec18366-6aa1-4f78-87f3-592bf157c257 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:13:04.568517 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 118/234] 10.222.0.44 () {58 vars in 1439 bytes} [Thu Jun 16 12:13:04 2022] PUT /identity/v3/projects/1adc255cfb4744c1b467603311c319e7/users/2eccf507000a493bb51415d6a8dcb709/roles/0688968254744e3f9913653cafea3091 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:13:05.055299 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee4cc69-438f-4374-a8b4-2408220d1169 None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:05.056306 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee4cc69-438f-4374-a8b4-2408220d1169 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:05.056820 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee4cc69-438f-4374-a8b4-2408220d1169 None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:05.058413 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 117/235] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 12:13:05 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 12:13:05.063791 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1a8eb2-2166-4b63-8d54-399453410dee None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:05.064616 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1a8eb2-2166-4b63-8d54-399453410dee None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:05.065129 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1a8eb2-2166-4b63-8d54-399453410dee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:05.082809 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-4f1a8eb2-2166-4b63-8d54-399453410dee None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:13:05.084312 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-4f1a8eb2-2166-4b63-8d54-399453410dee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:13:05.086673 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:13:05.160769 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 119/236] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 12:13:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 12:13:05.185792 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee4cc69-438f-4374-a8b4-2408220d1169 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:05.231439 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc08721-b87b-4329-808f-ac497694e086 None None] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:05.232208 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc08721-b87b-4329-808f-ac497694e086 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:05.232684 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc08721-b87b-4329-808f-ac497694e086 None None] PATH_INFO: `/` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:05.234359 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 120/237] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 12:13:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 12:13:05.246794 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0635128c-93dd-47f3-b572-a92b4e7006ff None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:05.247372 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0635128c-93dd-47f3-b572-a92b4e7006ff None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:05.247851 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0635128c-93dd-47f3-b572-a92b4e7006ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:05.276051 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-0635128c-93dd-47f3-b572-a92b4e7006ff None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:13:05.277742 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-0635128c-93dd-47f3-b572-a92b4e7006ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:13:05.296445 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee4cc69-438f-4374-a8b4-2408220d1169 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:05.307304 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:13:05.337961 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20972841-c818-4d72-a522-2577b05261bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:05.338770 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20972841-c818-4d72-a522-2577b05261bc None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:05.339052 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20972841-c818-4d72-a522-2577b05261bc None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:05.339329 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20972841-c818-4d72-a522-2577b05261bc None admin] PATH_INFO: `/v3/domains/default` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:05.341084 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20972841-c818-4d72-a522-2577b05261bc None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:13:05.342830 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20972841-c818-4d72-a522-2577b05261bc None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:13:05.345029 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 118/238] 10.222.0.44 () {56 vars in 1108 bytes} [Thu Jun 16 12:13:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:13:05.353472 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20972841-c818-4d72-a522-2577b05261bc None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:05.418656 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 121/239] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 12:13:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 12:13:05.441909 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0635128c-93dd-47f3-b572-a92b4e7006ff None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:05.454753 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20972841-c818-4d72-a522-2577b05261bc None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:05.489221 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cd3d73-41c9-4d5e-88ce-b332333352e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:05.489977 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cd3d73-41c9-4d5e-88ce-b332333352e8 None admin] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:05.490199 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cd3d73-41c9-4d5e-88ce-b332333352e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:05.490476 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cd3d73-41c9-4d5e-88ce-b332333352e8 None admin] PATH_INFO: `/v3/users` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:05.491196 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cd3d73-41c9-4d5e-88ce-b332333352e8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:13:05.493314 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cd3d73-41c9-4d5e-88ce-b332333352e8 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:13:05.520291 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 119/240] 10.222.0.44 () {60 vars in 1132 bytes} [Thu Jun 16 12:13:05 2022] POST /identity/v3/users => generated 293 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 12:13:05.562497 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:13:05.599711 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0635128c-93dd-47f3-b572-a92b4e7006ff None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:05.636651 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33308824-0e4a-491e-ae97-7965ab0c9fc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:05.637483 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33308824-0e4a-491e-ae97-7965ab0c9fc3 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:05.637766 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33308824-0e4a-491e-ae97-7965ab0c9fc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:05.638040 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33308824-0e4a-491e-ae97-7965ab0c9fc3 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:05.650108 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33308824-0e4a-491e-ae97-7965ab0c9fc3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 12:13:05.658278 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application [None req-33308824-0e4a-491e-ae97-7965ab0c9fc3 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 16 12:13:05.658278 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 12:13:05.658278 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 12:13:05.658278 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 12:13:05.658278 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 12:13:05.658278 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 12:13:05.658278 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 12:13:05.658278 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 12:13:05.658278 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 12:13:05.658278 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 12:13:05.658278 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 12:13:05.658278 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 12:13:05.658278 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 12:13:05.658278 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 12:13:05.658278 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 12:13:05.658278 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 12:13:05.659218 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 12:13:05.659218 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 12:13:05.659218 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 12:13:05.659218 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 12:13:05.659218 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 12:13:05.659218 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 12:13:05.659218 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 12:13:05.659218 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 12:13:05.659218 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 12:13:05.659218 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 12:13:05.659218 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 12:13:05.659218 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application with Lock( Jun 16 12:13:05.659218 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 12:13:05.659218 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._enter() Jun 16 12:13:05.659218 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 12:13:05.659218 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 12:13:05.660479 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 12:13:05.660479 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.creator() Jun 16 12:13:05.660479 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 12:13:05.660479 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application created_value = creator( Jun 16 12:13:05.660479 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 12:13:05.660479 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 12:13:05.660479 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 12:13:05.660479 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 12:13:05.660479 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 12:13:05.660479 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 12:13:05.660479 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 16 12:13:05.660479 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application Jun 16 12:13:05.660479 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 122/241] 10.222.0.44 () {56 vars in 1099 bytes} [Thu Jun 16 12:13:05 2022] GET /identity/v3/roles/reader => generated 84 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 12:13:05.665968 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cd3d73-41c9-4d5e-88ce-b332333352e8 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:05.703283 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:13:05.803025 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cd3d73-41c9-4d5e-88ce-b332333352e8 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:05.857483 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215b6ddc-9749-4e6d-a960-7fcad6caedb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:05.858173 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215b6ddc-9749-4e6d-a960-7fcad6caedb3 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:05.858459 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215b6ddc-9749-4e6d-a960-7fcad6caedb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:05.858739 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215b6ddc-9749-4e6d-a960-7fcad6caedb3 None admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:05.859589 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215b6ddc-9749-4e6d-a960-7fcad6caedb3 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:13:05.859903 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215b6ddc-9749-4e6d-a960-7fcad6caedb3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:13:05.861437 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215b6ddc-9749-4e6d-a960-7fcad6caedb3 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:13:05.871472 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 120/242] 10.222.0.44 () {56 vars in 1101 bytes} [Thu Jun 16 12:13:05 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:13:05.876960 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33308824-0e4a-491e-ae97-7965ab0c9fc3 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:05.900500 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f584a1c0-b175-4a81-bf36-a164c55c891c None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:05.900841 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f584a1c0-b175-4a81-bf36-a164c55c891c None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:05.901090 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f584a1c0-b175-4a81-bf36-a164c55c891c None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:05.902657 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 121/243] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 12:13:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 12:13:05.908001 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1221f3-37e8-4ac6-a82a-3cff28b613ba None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:05.908286 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1221f3-37e8-4ac6-a82a-3cff28b613ba None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:05.908516 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1221f3-37e8-4ac6-a82a-3cff28b613ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:05.937740 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-5f1221f3-37e8-4ac6-a82a-3cff28b613ba None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:13:05.939224 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-5f1221f3-37e8-4ac6-a82a-3cff28b613ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:13:06.004800 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33308824-0e4a-491e-ae97-7965ab0c9fc3 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:06.009323 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 122/244] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 12:13:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 12:13:06.033062 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1221f3-37e8-4ac6-a82a-3cff28b613ba None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:06.034351 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:13:06.051036 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eaa2afa-43d5-4dfa-946e-e5ba52405de6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:06.052298 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaa2afa-43d5-4dfa-946e-e5ba52405de6 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:06.052584 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaa2afa-43d5-4dfa-946e-e5ba52405de6 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:06.052888 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaa2afa-43d5-4dfa-946e-e5ba52405de6 None admin] PATH_INFO: `/v3/users/5f60f7d636814bdab7c17961adef16cf` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:06.066275 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:13:06.076361 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eaa2afa-43d5-4dfa-946e-e5ba52405de6 None admin] RBAC: Authorizing `identity:get_user(user_id=5f60f7d636814bdab7c17961adef16cf)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:13:06.077888 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eaa2afa-43d5-4dfa-946e-e5ba52405de6 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:13:06.084327 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 123/245] 10.222.0.44 () {56 vars in 1177 bytes} [Thu Jun 16 12:13:05 2022] GET /identity/v3/users/5f60f7d636814bdab7c17961adef16cf => generated 297 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:13:06.085301 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eaa2afa-43d5-4dfa-946e-e5ba52405de6 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:06.167765 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1221f3-37e8-4ac6-a82a-3cff28b613ba None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:06.223969 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9416b3f-242b-4891-b58a-63801883778b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:06.225143 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9416b3f-242b-4891-b58a-63801883778b None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:06.226278 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9416b3f-242b-4891-b58a-63801883778b None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:06.226945 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9416b3f-242b-4891-b58a-63801883778b None admin] PATH_INFO: `/v3/roles/member` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:06.234589 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eaa2afa-43d5-4dfa-946e-e5ba52405de6 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:06.241442 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9416b3f-242b-4891-b58a-63801883778b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 12:13:06.249723 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-c9416b3f-242b-4891-b58a-63801883778b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 16 12:13:06.249723 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 12:13:06.249723 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 12:13:06.249723 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 12:13:06.249723 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 12:13:06.249723 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 12:13:06.249723 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 12:13:06.249723 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 12:13:06.249723 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 12:13:06.249723 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 12:13:06.249723 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 12:13:06.249723 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 12:13:06.249723 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 12:13:06.249723 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 12:13:06.249723 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 12:13:06.249723 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 12:13:06.250628 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 12:13:06.250628 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 12:13:06.250628 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 12:13:06.250628 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 12:13:06.250628 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 12:13:06.250628 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 12:13:06.250628 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 12:13:06.250628 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 12:13:06.250628 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 12:13:06.250628 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 12:13:06.250628 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 12:13:06.250628 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jun 16 12:13:06.250628 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 12:13:06.250628 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jun 16 12:13:06.250628 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 12:13:06.250628 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 12:13:06.251502 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 12:13:06.251502 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jun 16 12:13:06.251502 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 12:13:06.251502 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jun 16 12:13:06.251502 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 12:13:06.251502 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 12:13:06.251502 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 12:13:06.251502 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 12:13:06.251502 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 12:13:06.251502 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 12:13:06.251502 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 16 12:13:06.251502 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jun 16 12:13:06.256152 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 123/246] 10.222.0.44 () {56 vars in 1099 bytes} [Thu Jun 16 12:13:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 12:13:06.262671 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9416b3f-242b-4891-b58a-63801883778b None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:06.276799 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9114bc-cb55-496b-bdd7-40a919aab3a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:06.277458 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9114bc-cb55-496b-bdd7-40a919aab3a9 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:06.277737 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9114bc-cb55-496b-bdd7-40a919aab3a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:06.278007 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9114bc-cb55-496b-bdd7-40a919aab3a9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:06.335527 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:13:06.349475 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9114bc-cb55-496b-bdd7-40a919aab3a9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:13:06.350931 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9114bc-cb55-496b-bdd7-40a919aab3a9 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:13:06.358592 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:13:06.381652 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9416b3f-242b-4891-b58a-63801883778b None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:06.420774 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878afc54-4c61-4f8b-9949-112d95408e9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:06.421851 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878afc54-4c61-4f8b-9949-112d95408e9f None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:06.422334 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878afc54-4c61-4f8b-9949-112d95408e9f None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:06.422838 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878afc54-4c61-4f8b-9949-112d95408e9f None admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:06.423789 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878afc54-4c61-4f8b-9949-112d95408e9f None admin] RBAC: Adding query filter params (name=member) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:13:06.424295 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878afc54-4c61-4f8b-9949-112d95408e9f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:13:06.425933 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878afc54-4c61-4f8b-9949-112d95408e9f None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:13:06.435896 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 124/247] 10.222.0.44 () {56 vars in 1101 bytes} [Thu Jun 16 12:13:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 12:13:06.441563 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878afc54-4c61-4f8b-9949-112d95408e9f None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:06.454714 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 124/248] 10.222.0.44 () {58 vars in 1282 bytes} [Thu Jun 16 12:13:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 12:13:06.460598 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9114bc-cb55-496b-bdd7-40a919aab3a9 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:06.555736 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878afc54-4c61-4f8b-9949-112d95408e9f None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:06.569264 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9114bc-cb55-496b-bdd7-40a919aab3a9 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:06.585141 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:13:06.596710 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582220a8-1fdd-40b9-ae97-6c6e338951fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:06.597959 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582220a8-1fdd-40b9-ae97-6c6e338951fe None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:06.598444 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582220a8-1fdd-40b9-ae97-6c6e338951fe None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:06.598920 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582220a8-1fdd-40b9-ae97-6c6e338951fe None admin] PATH_INFO: `/v3/users/d8992e1259da4db2b5acf4a426b1708a` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:06.600376 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582220a8-1fdd-40b9-ae97-6c6e338951fe None admin] RBAC: Authorizing `identity:get_user(user_id=d8992e1259da4db2b5acf4a426b1708a)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:13:06.602362 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582220a8-1fdd-40b9-ae97-6c6e338951fe None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:13:06.604842 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 125/249] 10.222.0.44 () {56 vars in 1177 bytes} [Thu Jun 16 12:13:06 2022] GET /identity/v3/users/d8992e1259da4db2b5acf4a426b1708a => generated 297 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 12:13:06.610996 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1af574-8243-497b-adf8-e89b401bc2b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:06.611677 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582220a8-1fdd-40b9-ae97-6c6e338951fe None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:06.611895 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1af574-8243-497b-adf8-e89b401bc2b1 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:06.612138 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1af574-8243-497b-adf8-e89b401bc2b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:06.612406 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1af574-8243-497b-adf8-e89b401bc2b1 None admin] PATH_INFO: `/v3/projects/1adc255cfb4744c1b467603311c319e7` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:06.613753 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1af574-8243-497b-adf8-e89b401bc2b1 None admin] RBAC: Authorizing `identity:get_project(project_id=1adc255cfb4744c1b467603311c319e7)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:13:06.615197 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1af574-8243-497b-adf8-e89b401bc2b1 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:13:06.617680 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 125/250] 10.222.0.44 () {56 vars in 1186 bytes} [Thu Jun 16 12:13:06 2022] GET /identity/v3/projects/1adc255cfb4744c1b467603311c319e7 => generated 302 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 12:13:06.623387 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1af574-8243-497b-adf8-e89b401bc2b1 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:06.634579 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:13:06.725773 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1af574-8243-497b-adf8-e89b401bc2b1 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:06.732856 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582220a8-1fdd-40b9-ae97-6c6e338951fe None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:06.760332 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23d870a-b2d4-48d3-ba4f-4effbca90084 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:06.760947 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23d870a-b2d4-48d3-ba4f-4effbca90084 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:06.761224 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23d870a-b2d4-48d3-ba4f-4effbca90084 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:06.761491 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23d870a-b2d4-48d3-ba4f-4effbca90084 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:06.762324 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23d870a-b2d4-48d3-ba4f-4effbca90084 None admin] RBAC: Adding query filter params (role.id=8b8940c737364011a624755f642bf504, scope.project.id=1adc255cfb4744c1b467603311c319e7, user.id=5f60f7d636814bdab7c17961adef16cf) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:13:06.762631 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23d870a-b2d4-48d3-ba4f-4effbca90084 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:13:06.768774 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23d870a-b2d4-48d3-ba4f-4effbca90084 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:13:06.770036 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 126/251] 10.222.0.44 () {56 vars in 1374 bytes} [Thu Jun 16 12:13:06 2022] GET /identity/v3/role_assignments?user.id=5f60f7d636814bdab7c17961adef16cf&scope.project.id=1adc255cfb4744c1b467603311c319e7&role.id=8b8940c737364011a624755f642bf504 => generated 259 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 12:13:06.803768 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bcd3ba-0899-4270-8e51-e9ec4e85bc33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:06.805603 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bcd3ba-0899-4270-8e51-e9ec4e85bc33 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:06.806222 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bcd3ba-0899-4270-8e51-e9ec4e85bc33 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:06.806723 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bcd3ba-0899-4270-8e51-e9ec4e85bc33 None admin] PATH_INFO: `/v3/projects/1adc255cfb4744c1b467603311c319e7` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:06.809961 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bcd3ba-0899-4270-8e51-e9ec4e85bc33 None admin] RBAC: Authorizing `identity:get_project(project_id=1adc255cfb4744c1b467603311c319e7)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:13:06.811938 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bcd3ba-0899-4270-8e51-e9ec4e85bc33 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:13:06.814378 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 126/252] 10.222.0.44 () {56 vars in 1186 bytes} [Thu Jun 16 12:13:06 2022] GET /identity/v3/projects/1adc255cfb4744c1b467603311c319e7 => generated 302 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:13:06.819845 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23d870a-b2d4-48d3-ba4f-4effbca90084 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:06.852353 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:13:06.943590 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23d870a-b2d4-48d3-ba4f-4effbca90084 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:06.979006 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ad14b5-5052-477e-b140-4b37f73e42c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:06.979916 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ad14b5-5052-477e-b140-4b37f73e42c8 None admin] REQUEST_METHOD: `PUT` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:06.980193 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ad14b5-5052-477e-b140-4b37f73e42c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:06.980464 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ad14b5-5052-477e-b140-4b37f73e42c8 None admin] PATH_INFO: `/v3/projects/1adc255cfb4744c1b467603311c319e7/users/d8992e1259da4db2b5acf4a426b1708a/roles/c39882b202e942479a7cdac2fc6da72c` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:06.982556 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ad14b5-5052-477e-b140-4b37f73e42c8 None admin] RBAC: Authorizing `identity:create_grant(project_id=1adc255cfb4744c1b467603311c319e7, user_id=d8992e1259da4db2b5acf4a426b1708a, role_id=c39882b202e942479a7cdac2fc6da72c)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:13:06.984023 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ad14b5-5052-477e-b140-4b37f73e42c8 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:13:06.999267 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 127/253] 10.222.0.44 () {58 vars in 1439 bytes} [Thu Jun 16 12:13:06 2022] PUT /identity/v3/projects/1adc255cfb4744c1b467603311c319e7/users/d8992e1259da4db2b5acf4a426b1708a/roles/c39882b202e942479a7cdac2fc6da72c => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:13:07.342714 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b58831a-b63a-4cf0-9a43-a71767245a7d None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:07.343219 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b58831a-b63a-4cf0-9a43-a71767245a7d None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:07.343295 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b58831a-b63a-4cf0-9a43-a71767245a7d None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:07.344793 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 127/254] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 12:13:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 12:13:07.362251 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efb2acd-f68c-4daf-9377-5eb31edeb28b None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:07.362754 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efb2acd-f68c-4daf-9377-5eb31edeb28b None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:07.362838 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efb2acd-f68c-4daf-9377-5eb31edeb28b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:07.390022 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-7efb2acd-f68c-4daf-9377-5eb31edeb28b None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:13:07.391272 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-7efb2acd-f68c-4daf-9377-5eb31edeb28b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:13:07.449749 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d40e5aa-b998-4dcf-ab4f-83d933ef1dbc None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:07.450082 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d40e5aa-b998-4dcf-ab4f-83d933ef1dbc None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:07.450307 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d40e5aa-b998-4dcf-ab4f-83d933ef1dbc None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:07.451818 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 128/255] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 12:13:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 12:13:07.457078 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d88b912-7cb6-49e0-a951-e239d03f90ef None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:07.457613 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d88b912-7cb6-49e0-a951-e239d03f90ef None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:07.458112 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d88b912-7cb6-49e0-a951-e239d03f90ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:07.477525 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-9d88b912-7cb6-49e0-a951-e239d03f90ef None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:13:07.479056 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-9d88b912-7cb6-49e0-a951-e239d03f90ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:13:07.502956 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 128/256] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 12:13:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 12:13:07.537917 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efb2acd-f68c-4daf-9377-5eb31edeb28b None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:07.555174 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 129/257] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 12:13:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 12:13:07.561108 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:13:07.586590 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d88b912-7cb6-49e0-a951-e239d03f90ef None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:07.607890 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:13:07.745991 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d88b912-7cb6-49e0-a951-e239d03f90ef None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:07.786855 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a5dd42-b232-4fe2-924e-e36651dae94b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:07.788021 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a5dd42-b232-4fe2-924e-e36651dae94b None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:07.788505 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a5dd42-b232-4fe2-924e-e36651dae94b None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:07.789053 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a5dd42-b232-4fe2-924e-e36651dae94b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:07.800036 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a5dd42-b232-4fe2-924e-e36651dae94b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 12:13:07.808013 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-63a5dd42-b232-4fe2-924e-e36651dae94b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 12:13:07.808013 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 12:13:07.808013 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 12:13:07.808013 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 12:13:07.808013 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 12:13:07.808013 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 12:13:07.808013 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 12:13:07.808013 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 12:13:07.808013 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 12:13:07.808013 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 12:13:07.808013 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 12:13:07.808013 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 12:13:07.808013 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 12:13:07.808013 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 12:13:07.808013 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 12:13:07.808013 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 12:13:07.808910 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 12:13:07.808910 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 12:13:07.808910 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 12:13:07.808910 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 12:13:07.808910 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 12:13:07.808910 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 12:13:07.808910 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 12:13:07.808910 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 12:13:07.808910 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 12:13:07.808910 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 12:13:07.808910 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 12:13:07.808910 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jun 16 12:13:07.808910 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 12:13:07.808910 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jun 16 12:13:07.808910 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 12:13:07.808910 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 12:13:07.809700 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 12:13:07.809700 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jun 16 12:13:07.809700 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 12:13:07.809700 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jun 16 12:13:07.809700 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 12:13:07.809700 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 12:13:07.809700 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 12:13:07.809700 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 12:13:07.809700 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 12:13:07.809700 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 12:13:07.809700 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 12:13:07.809700 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jun 16 12:13:07.810289 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efb2acd-f68c-4daf-9377-5eb31edeb28b None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:07.812438 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 130/258] 10.222.0.44 () {56 vars in 1096 bytes} [Thu Jun 16 12:13:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 12:13:07.818231 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a5dd42-b232-4fe2-924e-e36651dae94b None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:07.874172 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8709b59-9f16-4b5a-93cf-2180b388b0b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:07.874963 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8709b59-9f16-4b5a-93cf-2180b388b0b0 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:07.875249 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8709b59-9f16-4b5a-93cf-2180b388b0b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:07.875521 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8709b59-9f16-4b5a-93cf-2180b388b0b0 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:07.905611 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8709b59-9f16-4b5a-93cf-2180b388b0b0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 12:13:07.922538 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application [None req-a8709b59-9f16-4b5a-93cf-2180b388b0b0 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 12:13:07.922538 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 12:13:07.922538 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 12:13:07.922538 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 12:13:07.922538 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 12:13:07.922538 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 12:13:07.922538 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 12:13:07.922538 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 12:13:07.922538 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 12:13:07.922538 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 12:13:07.922538 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 12:13:07.922538 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 12:13:07.922538 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 12:13:07.922538 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 12:13:07.922538 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 12:13:07.922538 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 12:13:07.923379 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 12:13:07.923379 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 12:13:07.923379 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 12:13:07.923379 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 12:13:07.923379 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 12:13:07.923379 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 12:13:07.923379 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 12:13:07.923379 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 12:13:07.923379 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 12:13:07.923379 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 12:13:07.923379 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 12:13:07.923379 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application with Lock( Jun 16 12:13:07.923379 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 12:13:07.923379 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._enter() Jun 16 12:13:07.923379 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 12:13:07.923379 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 12:13:07.924148 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 12:13:07.924148 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.creator() Jun 16 12:13:07.924148 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 12:13:07.924148 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application created_value = creator( Jun 16 12:13:07.924148 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 12:13:07.924148 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 12:13:07.924148 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 12:13:07.924148 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 12:13:07.924148 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 12:13:07.924148 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 12:13:07.924148 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 12:13:07.924148 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application Jun 16 12:13:07.924148 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 129/259] 10.222.0.44 () {56 vars in 1114 bytes} [Thu Jun 16 12:13:07 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 386 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 12:13:07.928101 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:13:07.934356 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8709b59-9f16-4b5a-93cf-2180b388b0b0 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:07.958466 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a5dd42-b232-4fe2-924e-e36651dae94b None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:08.036133 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3058f58c-d0b0-450a-a8f8-9955432f93bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:08.036843 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3058f58c-d0b0-450a-a8f8-9955432f93bf None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:08.037129 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3058f58c-d0b0-450a-a8f8-9955432f93bf None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:08.037405 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3058f58c-d0b0-450a-a8f8-9955432f93bf None admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:08.038161 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3058f58c-d0b0-450a-a8f8-9955432f93bf None admin] RBAC: Adding query filter params (name=admin) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:13:08.038470 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3058f58c-d0b0-450a-a8f8-9955432f93bf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:13:08.039897 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3058f58c-d0b0-450a-a8f8-9955432f93bf None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:13:08.057343 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 131/260] 10.222.0.44 () {56 vars in 1099 bytes} [Thu Jun 16 12:13:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 12:13:08.061823 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3058f58c-d0b0-450a-a8f8-9955432f93bf None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:08.066832 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:13:08.156821 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8709b59-9f16-4b5a-93cf-2180b388b0b0 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:08.236869 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284d34c7-58b6-4a02-b292-c179c87a7732 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:08.237540 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284d34c7-58b6-4a02-b292-c179c87a7732 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:08.237819 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284d34c7-58b6-4a02-b292-c179c87a7732 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:08.238087 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284d34c7-58b6-4a02-b292-c179c87a7732 None admin] PATH_INFO: `/v3/roles` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:08.238841 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284d34c7-58b6-4a02-b292-c179c87a7732 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:13:08.239148 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284d34c7-58b6-4a02-b292-c179c87a7732 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:13:08.240535 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284d34c7-58b6-4a02-b292-c179c87a7732 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:13:08.256506 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 130/261] 10.222.0.44 () {56 vars in 1111 bytes} [Thu Jun 16 12:13:07 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:13:08.263474 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284d34c7-58b6-4a02-b292-c179c87a7732 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:08.306547 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3058f58c-d0b0-450a-a8f8-9955432f93bf None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:08.351314 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62a134e-5d36-4ff0-bcf9-faa8f35422ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:08.352733 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62a134e-5d36-4ff0-bcf9-faa8f35422ce None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:08.353035 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62a134e-5d36-4ff0-bcf9-faa8f35422ce None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:08.353307 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62a134e-5d36-4ff0-bcf9-faa8f35422ce None admin] PATH_INFO: `/v3/users/2eccf507000a493bb51415d6a8dcb709` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:08.358406 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62a134e-5d36-4ff0-bcf9-faa8f35422ce None admin] RBAC: Authorizing `identity:get_user(user_id=2eccf507000a493bb51415d6a8dcb709)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:13:08.360896 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62a134e-5d36-4ff0-bcf9-faa8f35422ce None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:13:08.364142 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 132/262] 10.222.0.44 () {56 vars in 1177 bytes} [Thu Jun 16 12:13:08 2022] GET /identity/v3/users/2eccf507000a493bb51415d6a8dcb709 => generated 283 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:13:08.376145 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62a134e-5d36-4ff0-bcf9-faa8f35422ce None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:08.389080 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:13:08.472525 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284d34c7-58b6-4a02-b292-c179c87a7732 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:08.534191 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:13:08.542449 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62a134e-5d36-4ff0-bcf9-faa8f35422ce None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:08.545954 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694fd8c1-63e0-487e-87c8-4d626804cc14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:08.546915 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694fd8c1-63e0-487e-87c8-4d626804cc14 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:08.547194 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694fd8c1-63e0-487e-87c8-4d626804cc14 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:08.547468 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694fd8c1-63e0-487e-87c8-4d626804cc14 None admin] PATH_INFO: `/v3/users/2eccf507000a493bb51415d6a8dcb709` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:08.548868 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694fd8c1-63e0-487e-87c8-4d626804cc14 None admin] RBAC: Authorizing `identity:get_user(user_id=2eccf507000a493bb51415d6a8dcb709)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:13:08.557463 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694fd8c1-63e0-487e-87c8-4d626804cc14 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:13:08.559652 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 131/263] 10.222.0.44 () {56 vars in 1177 bytes} [Thu Jun 16 12:13:08 2022] GET /identity/v3/users/2eccf507000a493bb51415d6a8dcb709 => generated 283 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 12:13:08.564600 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694fd8c1-63e0-487e-87c8-4d626804cc14 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:08.587413 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd33e5cd-3c8a-497b-95c2-ca7dd0d9bddc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:08.588076 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd33e5cd-3c8a-497b-95c2-ca7dd0d9bddc None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:08.588402 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd33e5cd-3c8a-497b-95c2-ca7dd0d9bddc None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:08.588688 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd33e5cd-3c8a-497b-95c2-ca7dd0d9bddc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:08.757073 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd33e5cd-3c8a-497b-95c2-ca7dd0d9bddc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:13:08.759106 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd33e5cd-3c8a-497b-95c2-ca7dd0d9bddc None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:13:08.762483 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:13:08.790724 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694fd8c1-63e0-487e-87c8-4d626804cc14 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:08.877493 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139d0cd9-bbb8-4343-82a4-d6991e59c7bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:08.878160 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139d0cd9-bbb8-4343-82a4-d6991e59c7bf None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:08.878443 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139d0cd9-bbb8-4343-82a4-d6991e59c7bf None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:08.878718 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139d0cd9-bbb8-4343-82a4-d6991e59c7bf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:08.943891 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 133/264] 10.222.0.44 () {58 vars in 1282 bytes} [Thu Jun 16 12:13:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 568 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 16 12:13:08.953804 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd33e5cd-3c8a-497b-95c2-ca7dd0d9bddc None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:08.980412 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:13:08.988171 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139d0cd9-bbb8-4343-82a4-d6991e59c7bf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:13:08.989687 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139d0cd9-bbb8-4343-82a4-d6991e59c7bf None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:13:09.103710 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd33e5cd-3c8a-497b-95c2-ca7dd0d9bddc None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:09.117714 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:13:09.163617 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 132/265] 10.222.0.44 () {58 vars in 1282 bytes} [Thu Jun 16 12:13:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 599 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 12:13:09.165079 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa248b72-1c74-4bf5-a13d-333fb18a3f04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:09.165994 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa248b72-1c74-4bf5-a13d-333fb18a3f04 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:09.166279 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa248b72-1c74-4bf5-a13d-333fb18a3f04 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:09.166553 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa248b72-1c74-4bf5-a13d-333fb18a3f04 None admin] PATH_INFO: `/v3/projects/1adc255cfb4744c1b467603311c319e7` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:09.167766 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa248b72-1c74-4bf5-a13d-333fb18a3f04 None admin] RBAC: Authorizing `identity:get_project(project_id=1adc255cfb4744c1b467603311c319e7)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:13:09.169968 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139d0cd9-bbb8-4343-82a4-d6991e59c7bf None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:09.177398 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa248b72-1c74-4bf5-a13d-333fb18a3f04 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:13:09.179242 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 134/266] 10.222.0.44 () {56 vars in 1186 bytes} [Thu Jun 16 12:13:08 2022] GET /identity/v3/projects/1adc255cfb4744c1b467603311c319e7 => generated 302 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:13:09.190898 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa248b72-1c74-4bf5-a13d-333fb18a3f04 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:09.377239 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:13:09.382742 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139d0cd9-bbb8-4343-82a4-d6991e59c7bf None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:09.388466 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa248b72-1c74-4bf5-a13d-333fb18a3f04 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:09.461980 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d32c60-4230-4317-b74d-42403f748037 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:09.462879 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d32c60-4230-4317-b74d-42403f748037 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:09.463158 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d32c60-4230-4317-b74d-42403f748037 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:09.463432 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d32c60-4230-4317-b74d-42403f748037 None admin] PATH_INFO: `/v3/projects/1adc255cfb4744c1b467603311c319e7` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:09.464789 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d32c60-4230-4317-b74d-42403f748037 None admin] RBAC: Authorizing `identity:get_project(project_id=1adc255cfb4744c1b467603311c319e7)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:13:09.466242 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ba6658-40cc-4b1b-a1f6-289d3e5c4d47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:09.466379 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d32c60-4230-4317-b74d-42403f748037 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:13:09.467259 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ba6658-40cc-4b1b-a1f6-289d3e5c4d47 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:09.467769 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ba6658-40cc-4b1b-a1f6-289d3e5c4d47 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:09.468068 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 133/267] 10.222.0.44 () {56 vars in 1186 bytes} [Thu Jun 16 12:13:09 2022] GET /identity/v3/projects/1adc255cfb4744c1b467603311c319e7 => generated 302 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:13:09.468521 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ba6658-40cc-4b1b-a1f6-289d3e5c4d47 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:09.473430 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ba6658-40cc-4b1b-a1f6-289d3e5c4d47 None admin] RBAC: Adding query filter params (role.id=0688968254744e3f9913653cafea3091, scope.project.id=1adc255cfb4744c1b467603311c319e7, user.id=2eccf507000a493bb51415d6a8dcb709) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:13:09.473999 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ba6658-40cc-4b1b-a1f6-289d3e5c4d47 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:13:09.474123 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d32c60-4230-4317-b74d-42403f748037 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:09.476940 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ba6658-40cc-4b1b-a1f6-289d3e5c4d47 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:13:09.486581 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 135/268] 10.222.0.44 () {56 vars in 1374 bytes} [Thu Jun 16 12:13:09 2022] GET /identity/v3/role_assignments?user.id=2eccf507000a493bb51415d6a8dcb709&scope.project.id=1adc255cfb4744c1b467603311c319e7&role.id=0688968254744e3f9913653cafea3091 => generated 608 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:13:09.536551 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e2ef4c-204d-4631-a04c-bd3f4d19e2d5 None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:09.537193 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e2ef4c-204d-4631-a04c-bd3f4d19e2d5 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:09.537669 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e2ef4c-204d-4631-a04c-bd3f4d19e2d5 None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:09.539906 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 136/269] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 12:13:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 12:13:09.546345 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24057ac-2677-467f-bdea-ed06a22dc997 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:09.546976 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24057ac-2677-467f-bdea-ed06a22dc997 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:09.547454 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24057ac-2677-467f-bdea-ed06a22dc997 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:09.573955 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-b24057ac-2677-467f-bdea-ed06a22dc997 None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:13:09.575563 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-b24057ac-2677-467f-bdea-ed06a22dc997 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:13:09.650181 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:13:09.680992 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d32c60-4230-4317-b74d-42403f748037 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:09.725081 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 137/270] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 12:13:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 12:13:09.727115 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c9e66d-62ef-46f7-8ba1-31f759c0d9f1 None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:09.727400 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c9e66d-62ef-46f7-8ba1-31f759c0d9f1 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:09.727670 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c9e66d-62ef-46f7-8ba1-31f759c0d9f1 None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:09.729251 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 138/271] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 12:13:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 12:13:09.733187 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a66f84-0dd5-4388-b28d-508b88ad3b31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:09.733860 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a66f84-0dd5-4388-b28d-508b88ad3b31 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:09.734144 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a66f84-0dd5-4388-b28d-508b88ad3b31 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:09.734478 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a66f84-0dd5-4388-b28d-508b88ad3b31 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:09.735075 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cf85af-b09b-4ef3-a132-a438c075243d None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:09.735376 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a66f84-0dd5-4388-b28d-508b88ad3b31 None admin] RBAC: Adding query filter params (role.id=e24b3707bc514b1fa606efab092047e6, scope.project.id=1adc255cfb4744c1b467603311c319e7, user.id=2eccf507000a493bb51415d6a8dcb709) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:13:09.735647 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cf85af-b09b-4ef3-a132-a438c075243d None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:09.735764 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a66f84-0dd5-4388-b28d-508b88ad3b31 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:13:09.736149 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cf85af-b09b-4ef3-a132-a438c075243d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:09.737219 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a66f84-0dd5-4388-b28d-508b88ad3b31 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:13:09.748219 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 134/272] 10.222.0.44 () {56 vars in 1374 bytes} [Thu Jun 16 12:13:09 2022] GET /identity/v3/role_assignments?user.id=2eccf507000a493bb51415d6a8dcb709&scope.project.id=1adc255cfb4744c1b467603311c319e7&role.id=e24b3707bc514b1fa606efab092047e6 => generated 608 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:13:09.756975 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-b1cf85af-b09b-4ef3-a132-a438c075243d None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:13:09.758502 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-b1cf85af-b09b-4ef3-a132-a438c075243d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:13:09.772180 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a66f84-0dd5-4388-b28d-508b88ad3b31 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:09.815728 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:13:09.854814 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 139/273] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 12:13:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 12:13:09.880365 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cf85af-b09b-4ef3-a132-a438c075243d None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:09.912489 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a66f84-0dd5-4388-b28d-508b88ad3b31 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:09.965340 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ff1688-4cd9-401b-a590-2b1bbde51b85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:09.967345 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ff1688-4cd9-401b-a590-2b1bbde51b85 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:09.967345 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ff1688-4cd9-401b-a590-2b1bbde51b85 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:09.967345 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ff1688-4cd9-401b-a590-2b1bbde51b85 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:09.982760 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ff1688-4cd9-401b-a590-2b1bbde51b85 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 12:13:09.993402 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application [None req-01ff1688-4cd9-401b-a590-2b1bbde51b85 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 16 12:13:09.993402 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 12:13:09.993402 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 12:13:09.993402 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 12:13:09.993402 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 12:13:09.993402 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 12:13:09.993402 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 12:13:09.993402 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 12:13:09.993402 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 12:13:09.993402 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 12:13:09.993402 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 12:13:09.993402 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 12:13:09.993402 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 12:13:09.993402 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 12:13:09.993402 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 12:13:09.993402 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 12:13:09.994332 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 12:13:09.994332 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 12:13:09.994332 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 12:13:09.994332 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 12:13:09.994332 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 12:13:09.994332 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 12:13:09.994332 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 12:13:09.994332 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 12:13:09.994332 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 12:13:09.994332 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 12:13:09.994332 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 12:13:09.994332 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application with Lock( Jun 16 12:13:09.994332 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 12:13:09.994332 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._enter() Jun 16 12:13:09.994332 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 12:13:09.994332 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 12:13:09.995106 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 12:13:09.995106 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.creator() Jun 16 12:13:09.995106 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 12:13:09.995106 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application created_value = creator( Jun 16 12:13:09.995106 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 12:13:09.995106 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 12:13:09.995106 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 12:13:09.995106 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 12:13:09.995106 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 12:13:09.995106 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 12:13:09.995106 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 16 12:13:09.995106 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application Jun 16 12:13:09.998666 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 135/274] 10.222.0.44 () {56 vars in 1099 bytes} [Thu Jun 16 12:13:09 2022] GET /identity/v3/roles/member => generated 84 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 12:13:10.000292 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20efae13-97fa-4de6-aad0-96f13ba79970 None None] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:10.000852 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20efae13-97fa-4de6-aad0-96f13ba79970 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:10.001376 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20efae13-97fa-4de6-aad0-96f13ba79970 None None] PATH_INFO: `/` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:10.003403 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 136/275] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 12:13:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 12:13:10.005674 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20efae13-97fa-4de6-aad0-96f13ba79970 None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:10.006891 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:13:10.017377 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cf85af-b09b-4ef3-a132-a438c075243d None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:10.060703 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8467db7-9121-4243-bd1b-eefb9def2a7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:10.061527 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8467db7-9121-4243-bd1b-eefb9def2a7a None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:10.061805 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8467db7-9121-4243-bd1b-eefb9def2a7a None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:10.062074 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8467db7-9121-4243-bd1b-eefb9def2a7a None admin] PATH_INFO: `/v3/domains/default` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:10.063236 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8467db7-9121-4243-bd1b-eefb9def2a7a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:13:10.065291 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8467db7-9121-4243-bd1b-eefb9def2a7a None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:13:10.067420 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 140/276] 10.222.0.44 () {56 vars in 1108 bytes} [Thu Jun 16 12:13:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 12:13:10.069670 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7455cd-e93e-4e74-b215-79925d3719c0 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:10.069670 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7455cd-e93e-4e74-b215-79925d3719c0 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:10.070621 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7455cd-e93e-4e74-b215-79925d3719c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:10.094934 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-9f7455cd-e93e-4e74-b215-79925d3719c0 None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:13:10.096292 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-9f7455cd-e93e-4e74-b215-79925d3719c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:13:10.126601 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:13:10.136741 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20efae13-97fa-4de6-aad0-96f13ba79970 None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:10.182435 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59abadd0-963e-467f-b133-023a94a44b0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:10.183046 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59abadd0-963e-467f-b133-023a94a44b0d None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:10.183323 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59abadd0-963e-467f-b133-023a94a44b0d None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:10.183588 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59abadd0-963e-467f-b133-023a94a44b0d None admin] PATH_INFO: `/v3/roles` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:10.184343 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59abadd0-963e-467f-b133-023a94a44b0d None admin] RBAC: Adding query filter params (name=member) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:13:10.184645 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59abadd0-963e-467f-b133-023a94a44b0d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:13:10.190782 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 141/277] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 12:13:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 12:13:10.190782 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7455cd-e93e-4e74-b215-79925d3719c0 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:10.190996 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59abadd0-963e-467f-b133-023a94a44b0d None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:13:10.196256 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 137/278] 10.222.0.44 () {56 vars in 1101 bytes} [Thu Jun 16 12:13:10 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:13:10.201876 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59abadd0-963e-467f-b133-023a94a44b0d None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:10.283808 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:13:10.292982 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7455cd-e93e-4e74-b215-79925d3719c0 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:10.300008 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59abadd0-963e-467f-b133-023a94a44b0d None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:10.327213 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652aff61-21f1-4d3e-ab09-d4b9b3d07b8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:10.327875 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652aff61-21f1-4d3e-ab09-d4b9b3d07b8c None admin] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:10.328159 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652aff61-21f1-4d3e-ab09-d4b9b3d07b8c None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:10.328429 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652aff61-21f1-4d3e-ab09-d4b9b3d07b8c None admin] PATH_INFO: `/v3/users` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:10.329168 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652aff61-21f1-4d3e-ab09-d4b9b3d07b8c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:13:10.330607 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652aff61-21f1-4d3e-ab09-d4b9b3d07b8c None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:13:10.333228 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f087a3e-874f-4996-9086-6dab3c030a56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:10.334095 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f087a3e-874f-4996-9086-6dab3c030a56 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:10.334374 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f087a3e-874f-4996-9086-6dab3c030a56 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:10.334645 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f087a3e-874f-4996-9086-6dab3c030a56 None admin] PATH_INFO: `/v3/users/844611af481b43d2b8d96b9e4d636756` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:10.347992 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f087a3e-874f-4996-9086-6dab3c030a56 None admin] RBAC: Authorizing `identity:get_user(user_id=844611af481b43d2b8d96b9e4d636756)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:13:10.349370 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 142/279] 10.222.0.44 () {60 vars in 1132 bytes} [Thu Jun 16 12:13:10 2022] POST /identity/v3/users => generated 293 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 12:13:10.349618 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f087a3e-874f-4996-9086-6dab3c030a56 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:13:10.351456 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 138/280] 10.222.0.44 () {56 vars in 1177 bytes} [Thu Jun 16 12:13:10 2022] GET /identity/v3/users/844611af481b43d2b8d96b9e4d636756 => generated 293 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 12:13:10.361935 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652aff61-21f1-4d3e-ab09-d4b9b3d07b8c None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:10.362447 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3a241c-1196-4452-8f45-d039804653e0 None None] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:10.362813 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3a241c-1196-4452-8f45-d039804653e0 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:10.363081 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3a241c-1196-4452-8f45-d039804653e0 None None] PATH_INFO: `/` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:10.364803 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 139/281] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 12:13:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 12:13:10.365445 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3a241c-1196-4452-8f45-d039804653e0 None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:10.383800 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:13:10.482653 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652aff61-21f1-4d3e-ab09-d4b9b3d07b8c None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:10.483660 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3a241c-1196-4452-8f45-d039804653e0 None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:10.519472 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4d41f5-4ee5-4026-adf7-be7814d71c01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:10.520282 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4d41f5-4ee5-4026-adf7-be7814d71c01 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:10.520591 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4d41f5-4ee5-4026-adf7-be7814d71c01 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:10.520907 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4d41f5-4ee5-4026-adf7-be7814d71c01 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:10.529465 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ed57b4-e597-44c8-8720-bfbbb9b425b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:10.530128 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ed57b4-e597-44c8-8720-bfbbb9b425b6 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:10.530412 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ed57b4-e597-44c8-8720-bfbbb9b425b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:10.530686 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ed57b4-e597-44c8-8720-bfbbb9b425b6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:10.531515 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ed57b4-e597-44c8-8720-bfbbb9b425b6 None admin] RBAC: Adding query filter params (role.id=c39882b202e942479a7cdac2fc6da72c, user.id=844611af481b43d2b8d96b9e4d636756, scope.system=all) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:13:10.531821 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ed57b4-e597-44c8-8720-bfbbb9b425b6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:13:10.533374 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ed57b4-e597-44c8-8720-bfbbb9b425b6 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:13:10.534458 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4d41f5-4ee5-4026-adf7-be7814d71c01 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 12:13:10.540066 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 140/282] 10.222.0.44 () {56 vars in 1308 bytes} [Thu Jun 16 12:13:10 2022] GET /identity/v3/role_assignments?user.id=844611af481b43d2b8d96b9e4d636756&scope.system=all&role.id=c39882b202e942479a7cdac2fc6da72c => generated 226 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:13:10.540924 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc5d7fb-bf9e-4719-8a03-47c886d5d408 None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:10.541211 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc5d7fb-bf9e-4719-8a03-47c886d5d408 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:10.541488 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc5d7fb-bf9e-4719-8a03-47c886d5d408 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:10.543469 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-1e4d41f5-4ee5-4026-adf7-be7814d71c01 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 16 12:13:10.543469 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 12:13:10.543469 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 12:13:10.543469 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 12:13:10.543469 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 12:13:10.543469 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 12:13:10.543469 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 12:13:10.543469 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 12:13:10.543469 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 12:13:10.543469 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 12:13:10.543469 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 12:13:10.543469 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 12:13:10.543469 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 12:13:10.543469 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 12:13:10.543469 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 12:13:10.543469 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 12:13:10.544329 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 12:13:10.544329 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 12:13:10.544329 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 12:13:10.544329 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 12:13:10.544329 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 12:13:10.544329 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 12:13:10.544329 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 12:13:10.544329 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 12:13:10.544329 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 12:13:10.544329 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 12:13:10.544329 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 12:13:10.544329 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jun 16 12:13:10.544329 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 12:13:10.544329 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jun 16 12:13:10.544329 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 12:13:10.544329 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 12:13:10.545441 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 12:13:10.545441 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jun 16 12:13:10.545441 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 12:13:10.545441 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jun 16 12:13:10.545441 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 12:13:10.545441 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 12:13:10.545441 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 12:13:10.545441 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 12:13:10.545441 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 12:13:10.545441 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 12:13:10.545441 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 16 12:13:10.545441 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jun 16 12:13:10.545441 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 143/283] 10.222.0.44 () {56 vars in 1099 bytes} [Thu Jun 16 12:13:10 2022] GET /identity/v3/roles/reader => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 12:13:10.552465 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4d41f5-4ee5-4026-adf7-be7814d71c01 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:10.565244 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:13:10.567770 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-5cc5d7fb-bf9e-4719-8a03-47c886d5d408 None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:13:10.569059 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-5cc5d7fb-bf9e-4719-8a03-47c886d5d408 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:13:10.667800 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 141/284] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 12:13:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 12:13:10.683977 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4d41f5-4ee5-4026-adf7-be7814d71c01 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:10.700057 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc5d7fb-bf9e-4719-8a03-47c886d5d408 None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:10.705959 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:13:10.731150 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b229040-8eb5-47b5-a434-01816d23bd21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:10.732115 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b229040-8eb5-47b5-a434-01816d23bd21 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:10.732396 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b229040-8eb5-47b5-a434-01816d23bd21 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:10.732727 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b229040-8eb5-47b5-a434-01816d23bd21 None admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:10.733515 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b229040-8eb5-47b5-a434-01816d23bd21 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:13:10.734417 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b229040-8eb5-47b5-a434-01816d23bd21 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:13:10.736125 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b229040-8eb5-47b5-a434-01816d23bd21 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:13:10.748585 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 144/285] 10.222.0.44 () {56 vars in 1101 bytes} [Thu Jun 16 12:13:10 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 12:13:10.753992 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b229040-8eb5-47b5-a434-01816d23bd21 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:10.827504 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc5d7fb-bf9e-4719-8a03-47c886d5d408 None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:10.844062 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:13:10.865961 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d1d62b-0331-43bd-bfef-2a6371a2deff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:10.866817 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d1d62b-0331-43bd-bfef-2a6371a2deff None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:10.867126 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d1d62b-0331-43bd-bfef-2a6371a2deff None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:10.867399 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d1d62b-0331-43bd-bfef-2a6371a2deff None admin] PATH_INFO: `/v3/roles/member` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:10.871360 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b229040-8eb5-47b5-a434-01816d23bd21 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:10.878747 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d1d62b-0331-43bd-bfef-2a6371a2deff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 12:13:10.887388 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application [None req-d4d1d62b-0331-43bd-bfef-2a6371a2deff None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 16 12:13:10.887388 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 12:13:10.887388 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 12:13:10.887388 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 12:13:10.887388 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 12:13:10.887388 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 12:13:10.887388 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 12:13:10.887388 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 12:13:10.887388 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 12:13:10.887388 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 12:13:10.887388 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 12:13:10.887388 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 12:13:10.887388 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 12:13:10.887388 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 12:13:10.887388 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 12:13:10.887388 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 12:13:10.888303 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 12:13:10.888303 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 12:13:10.888303 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 12:13:10.888303 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 12:13:10.888303 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 12:13:10.888303 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 12:13:10.888303 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 12:13:10.888303 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 12:13:10.888303 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 12:13:10.888303 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 12:13:10.888303 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 12:13:10.888303 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application with Lock( Jun 16 12:13:10.888303 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 12:13:10.888303 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._enter() Jun 16 12:13:10.888303 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 12:13:10.888303 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 12:13:10.889113 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 12:13:10.889113 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.creator() Jun 16 12:13:10.889113 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 12:13:10.889113 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application created_value = creator( Jun 16 12:13:10.889113 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 12:13:10.889113 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 12:13:10.889113 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 12:13:10.889113 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 12:13:10.889113 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 12:13:10.889113 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 12:13:10.889113 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 16 12:13:10.889113 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application Jun 16 12:13:10.889113 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 142/286] 10.222.0.44 () {56 vars in 1099 bytes} [Thu Jun 16 12:13:10 2022] GET /identity/v3/roles/member => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 12:13:10.897758 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d1d62b-0331-43bd-bfef-2a6371a2deff None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:10.930462 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac541c07-61bc-4610-8832-27ef18859a16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:10.931348 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac541c07-61bc-4610-8832-27ef18859a16 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:10.936704 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac541c07-61bc-4610-8832-27ef18859a16 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:10.937024 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac541c07-61bc-4610-8832-27ef18859a16 None admin] PATH_INFO: `/v3/users/5f60f7d636814bdab7c17961adef16cf` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:10.939269 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac541c07-61bc-4610-8832-27ef18859a16 None admin] RBAC: Authorizing `identity:get_user(user_id=5f60f7d636814bdab7c17961adef16cf)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:13:10.940762 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac541c07-61bc-4610-8832-27ef18859a16 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:13:10.942444 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 145/287] 10.222.0.44 () {56 vars in 1177 bytes} [Thu Jun 16 12:13:10 2022] GET /identity/v3/users/5f60f7d636814bdab7c17961adef16cf => generated 297 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 12:13:10.948581 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac541c07-61bc-4610-8832-27ef18859a16 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:11.027434 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:13:11.095979 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d1d62b-0331-43bd-bfef-2a6371a2deff None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:11.129026 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac541c07-61bc-4610-8832-27ef18859a16 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:11.136599 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0bbeec-9c16-4485-a503-d43fd46452e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:11.137312 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0bbeec-9c16-4485-a503-d43fd46452e1 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:11.137617 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0bbeec-9c16-4485-a503-d43fd46452e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:11.138276 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0bbeec-9c16-4485-a503-d43fd46452e1 None admin] PATH_INFO: `/v3/roles` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:11.138734 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0bbeec-9c16-4485-a503-d43fd46452e1 None admin] RBAC: Adding query filter params (name=member) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:13:11.139048 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0bbeec-9c16-4485-a503-d43fd46452e1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:13:11.140453 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0bbeec-9c16-4485-a503-d43fd46452e1 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:13:11.153013 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 143/288] 10.222.0.44 () {56 vars in 1101 bytes} [Thu Jun 16 12:13:10 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:13:11.154983 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0bbeec-9c16-4485-a503-d43fd46452e1 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:11.197462 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e87bbf-5931-4671-90c9-8d4aeacec080 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:11.198336 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e87bbf-5931-4671-90c9-8d4aeacec080 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:11.198611 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e87bbf-5931-4671-90c9-8d4aeacec080 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:11.198886 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e87bbf-5931-4671-90c9-8d4aeacec080 None admin] PATH_INFO: `/v3/projects/1adc255cfb4744c1b467603311c319e7` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:11.200841 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e87bbf-5931-4671-90c9-8d4aeacec080 None admin] RBAC: Authorizing `identity:get_project(project_id=1adc255cfb4744c1b467603311c319e7)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:13:11.202310 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e87bbf-5931-4671-90c9-8d4aeacec080 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:13:11.204319 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 146/289] 10.222.0.44 () {56 vars in 1186 bytes} [Thu Jun 16 12:13:10 2022] GET /identity/v3/projects/1adc255cfb4744c1b467603311c319e7 => generated 302 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:13:11.214741 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e87bbf-5931-4671-90c9-8d4aeacec080 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:11.233910 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:13:11.313513 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0bbeec-9c16-4485-a503-d43fd46452e1 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:11.370304 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:13:11.374466 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e87bbf-5931-4671-90c9-8d4aeacec080 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:11.397510 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e852d0a5-68c8-4c5d-92f2-7fe49f23f469 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:11.398974 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e852d0a5-68c8-4c5d-92f2-7fe49f23f469 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:11.399255 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e852d0a5-68c8-4c5d-92f2-7fe49f23f469 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:11.399528 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e852d0a5-68c8-4c5d-92f2-7fe49f23f469 None admin] PATH_INFO: `/v3/users/d8992e1259da4db2b5acf4a426b1708a` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:11.400835 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e852d0a5-68c8-4c5d-92f2-7fe49f23f469 None admin] RBAC: Authorizing `identity:get_user(user_id=d8992e1259da4db2b5acf4a426b1708a)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:13:11.402292 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e852d0a5-68c8-4c5d-92f2-7fe49f23f469 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:13:11.404250 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 144/290] 10.222.0.44 () {56 vars in 1177 bytes} [Thu Jun 16 12:13:11 2022] GET /identity/v3/users/d8992e1259da4db2b5acf4a426b1708a => generated 297 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:13:11.409504 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e852d0a5-68c8-4c5d-92f2-7fe49f23f469 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:11.417422 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcce301-e685-4472-88e9-99ec41cd747a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:11.419158 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcce301-e685-4472-88e9-99ec41cd747a None admin] REQUEST_METHOD: `PUT` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:11.419782 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcce301-e685-4472-88e9-99ec41cd747a None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:11.422037 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcce301-e685-4472-88e9-99ec41cd747a None admin] PATH_INFO: `/v3/projects/1adc255cfb4744c1b467603311c319e7/users/5f60f7d636814bdab7c17961adef16cf/roles/8b8940c737364011a624755f642bf504` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:11.427031 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bcce301-e685-4472-88e9-99ec41cd747a None admin] RBAC: Authorizing `identity:create_grant(project_id=1adc255cfb4744c1b467603311c319e7, user_id=5f60f7d636814bdab7c17961adef16cf, role_id=8b8940c737364011a624755f642bf504)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:13:11.428504 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bcce301-e685-4472-88e9-99ec41cd747a None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:13:11.451197 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 147/291] 10.222.0.44 () {58 vars in 1439 bytes} [Thu Jun 16 12:13:11 2022] PUT /identity/v3/projects/1adc255cfb4744c1b467603311c319e7/users/5f60f7d636814bdab7c17961adef16cf/roles/8b8940c737364011a624755f642bf504 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 12:13:11.582435 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e852d0a5-68c8-4c5d-92f2-7fe49f23f469 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:11.633215 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325eb743-982b-4a70-a0e4-c06d28f1567f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:11.633928 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325eb743-982b-4a70-a0e4-c06d28f1567f None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:11.634212 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325eb743-982b-4a70-a0e4-c06d28f1567f None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:11.634489 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325eb743-982b-4a70-a0e4-c06d28f1567f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:11.701450 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:13:11.710540 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325eb743-982b-4a70-a0e4-c06d28f1567f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:13:11.712560 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325eb743-982b-4a70-a0e4-c06d28f1567f None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:13:11.845624 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 145/292] 10.222.0.44 () {58 vars in 1282 bytes} [Thu Jun 16 12:13:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 12:13:11.850684 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcce301-e685-4472-88e9-99ec41cd747a None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:11.936269 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:13:11.989899 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcce301-e685-4472-88e9-99ec41cd747a None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:12.029314 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3822e9-b3aa-43b1-ba5b-bf0ffd996aad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:12.030549 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3822e9-b3aa-43b1-ba5b-bf0ffd996aad None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:12.031048 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3822e9-b3aa-43b1-ba5b-bf0ffd996aad None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:12.031526 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3822e9-b3aa-43b1-ba5b-bf0ffd996aad None admin] PATH_INFO: `/v3/projects/1adc255cfb4744c1b467603311c319e7` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:12.032961 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3822e9-b3aa-43b1-ba5b-bf0ffd996aad None admin] RBAC: Authorizing `identity:get_project(project_id=1adc255cfb4744c1b467603311c319e7)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:13:12.034611 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3822e9-b3aa-43b1-ba5b-bf0ffd996aad None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:13:12.036512 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 148/293] 10.222.0.44 () {56 vars in 1186 bytes} [Thu Jun 16 12:13:11 2022] GET /identity/v3/projects/1adc255cfb4744c1b467603311c319e7 => generated 302 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:13:12.044776 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325eb743-982b-4a70-a0e4-c06d28f1567f None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:12.190367 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:13:12.196980 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325eb743-982b-4a70-a0e4-c06d28f1567f None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:12.247696 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7626b4-c7ba-4551-b27b-ab5e362f24ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:12.248356 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7626b4-c7ba-4551-b27b-ab5e362f24ac None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:12.248640 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7626b4-c7ba-4551-b27b-ab5e362f24ac None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:12.248942 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7626b4-c7ba-4551-b27b-ab5e362f24ac None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:12.249783 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7626b4-c7ba-4551-b27b-ab5e362f24ac None admin] RBAC: Adding query filter params (role.id=c39882b202e942479a7cdac2fc6da72c, scope.project.id=1adc255cfb4744c1b467603311c319e7, user.id=d8992e1259da4db2b5acf4a426b1708a) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:13:12.250094 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7626b4-c7ba-4551-b27b-ab5e362f24ac None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:13:12.251539 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7626b4-c7ba-4551-b27b-ab5e362f24ac None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:13:12.261886 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 146/294] 10.222.0.44 () {56 vars in 1374 bytes} [Thu Jun 16 12:13:12 2022] GET /identity/v3/role_assignments?user.id=d8992e1259da4db2b5acf4a426b1708a&scope.project.id=1adc255cfb4744c1b467603311c319e7&role.id=c39882b202e942479a7cdac2fc6da72c => generated 608 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:13:12.950018 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5bf554-930a-4262-a732-02897a0c36e8 None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:12.950526 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5bf554-930a-4262-a732-02897a0c36e8 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:12.950599 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5bf554-930a-4262-a732-02897a0c36e8 None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:12.951968 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 149/295] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 12:13:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 12:13:12.957619 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6d991e-b361-4478-9ae1-9ec1530b04f9 None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:12.958097 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6d991e-b361-4478-9ae1-9ec1530b04f9 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:12.958280 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6d991e-b361-4478-9ae1-9ec1530b04f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:12.975977 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-8e6d991e-b361-4478-9ae1-9ec1530b04f9 None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:13:12.977243 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-8e6d991e-b361-4478-9ae1-9ec1530b04f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:13:13.052322 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 147/296] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 12:13:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 12:13:13.075165 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5bf554-930a-4262-a732-02897a0c36e8 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:13.102233 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a86777-0ccd-4bf4-b6b9-179169415e27 None None] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:13.102233 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a86777-0ccd-4bf4-b6b9-179169415e27 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:13.102625 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a86777-0ccd-4bf4-b6b9-179169415e27 None None] PATH_INFO: `/` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:13.104478 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 148/297] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 12:13:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 12:13:13.110188 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d0b49c-0a8a-43b1-bcac-b2c31a660591 None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:13.110606 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d0b49c-0a8a-43b1-bcac-b2c31a660591 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:13.110979 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d0b49c-0a8a-43b1-bcac-b2c31a660591 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:13.128106 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-74d0b49c-0a8a-43b1-bcac-b2c31a660591 None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:13:13.129468 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-74d0b49c-0a8a-43b1-bcac-b2c31a660591 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:13:13.192165 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5bf554-930a-4262-a732-02897a0c36e8 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:13.199067 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 149/298] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 12:13:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 12:13:13.200195 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca016fe5-2791-4a85-b890-c387fdaf1b91 None None] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:13.200539 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca016fe5-2791-4a85-b890-c387fdaf1b91 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:13.200906 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca016fe5-2791-4a85-b890-c387fdaf1b91 None None] PATH_INFO: `/` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:13.202184 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 150/299] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 12:13:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 12:13:13.207431 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca33dfc-036d-4493-a61d-5779bbed6810 None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:13.207714 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca33dfc-036d-4493-a61d-5779bbed6810 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:13.207993 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca33dfc-036d-4493-a61d-5779bbed6810 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:13.225181 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-bca33dfc-036d-4493-a61d-5779bbed6810 None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:13:13.226386 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-bca33dfc-036d-4493-a61d-5779bbed6810 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:13:13.239942 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:13:13.240201 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f12ea3-deb1-44c8-a5cb-ba2cad598fff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:13.241169 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f12ea3-deb1-44c8-a5cb-ba2cad598fff None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:13.241511 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f12ea3-deb1-44c8-a5cb-ba2cad598fff None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:13.242439 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f12ea3-deb1-44c8-a5cb-ba2cad598fff None admin] PATH_INFO: `/v3/roles/member` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:13.244330 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:13:13.253342 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f12ea3-deb1-44c8-a5cb-ba2cad598fff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 12:13:13.261722 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-66f12ea3-deb1-44c8-a5cb-ba2cad598fff None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 16 12:13:13.261722 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 12:13:13.261722 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 12:13:13.261722 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 12:13:13.261722 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 12:13:13.261722 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 12:13:13.261722 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 12:13:13.261722 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 12:13:13.261722 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 12:13:13.261722 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 12:13:13.261722 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 12:13:13.261722 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 12:13:13.261722 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 12:13:13.261722 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 12:13:13.261722 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 12:13:13.261722 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 12:13:13.262593 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 12:13:13.262593 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 12:13:13.262593 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 12:13:13.262593 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 12:13:13.262593 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 12:13:13.262593 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 12:13:13.262593 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 12:13:13.262593 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 12:13:13.262593 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 12:13:13.262593 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 12:13:13.262593 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 12:13:13.262593 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jun 16 12:13:13.262593 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 12:13:13.262593 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jun 16 12:13:13.262593 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 12:13:13.262593 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 12:13:13.264464 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 12:13:13.264464 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jun 16 12:13:13.264464 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 12:13:13.264464 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jun 16 12:13:13.264464 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 12:13:13.264464 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 12:13:13.264464 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 12:13:13.264464 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 12:13:13.264464 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 12:13:13.264464 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 12:13:13.264464 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 16 12:13:13.264464 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jun 16 12:13:13.264464 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 150/300] 10.222.0.44 () {56 vars in 1099 bytes} [Thu Jun 16 12:13:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 12:13:13.264464 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f12ea3-deb1-44c8-a5cb-ba2cad598fff None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:13.299005 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 151/301] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 12:13:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 12:13:13.300131 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca33dfc-036d-4493-a61d-5779bbed6810 None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:13.378828 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f12ea3-deb1-44c8-a5cb-ba2cad598fff None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:13.414283 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fbcede-5d37-4ee3-b41c-28e0e0bf0f79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:13.415075 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fbcede-5d37-4ee3-b41c-28e0e0bf0f79 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:13.415359 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fbcede-5d37-4ee3-b41c-28e0e0bf0f79 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:13.415640 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fbcede-5d37-4ee3-b41c-28e0e0bf0f79 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:13.416858 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fbcede-5d37-4ee3-b41c-28e0e0bf0f79 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:13:13.418308 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fbcede-5d37-4ee3-b41c-28e0e0bf0f79 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:13:13.420351 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 151/302] 10.222.0.44 () {56 vars in 1108 bytes} [Thu Jun 16 12:13:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:13:13.420976 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fbcede-5d37-4ee3-b41c-28e0e0bf0f79 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:13.423782 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca33dfc-036d-4493-a61d-5779bbed6810 None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:13.469710 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258763de-16ef-4af0-a81d-acfbee17c4d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:13.470634 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258763de-16ef-4af0-a81d-acfbee17c4d1 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:13.471351 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258763de-16ef-4af0-a81d-acfbee17c4d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:13.471645 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258763de-16ef-4af0-a81d-acfbee17c4d1 None admin] PATH_INFO: `/v3/roles` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:13.472676 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258763de-16ef-4af0-a81d-acfbee17c4d1 None admin] RBAC: Adding query filter params (name=member) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:13:13.473243 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258763de-16ef-4af0-a81d-acfbee17c4d1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:13:13.475281 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258763de-16ef-4af0-a81d-acfbee17c4d1 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:13:13.486665 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:13:13.487493 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 152/303] 10.222.0.44 () {56 vars in 1101 bytes} [Thu Jun 16 12:13:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:13:13.488965 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258763de-16ef-4af0-a81d-acfbee17c4d1 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:13.504169 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:13:13.540084 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fbcede-5d37-4ee3-b41c-28e0e0bf0f79 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:13.580254 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42b3301-e7f8-42f1-90a4-b8e082f48f2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:13.581240 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42b3301-e7f8-42f1-90a4-b8e082f48f2a None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:13.581521 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42b3301-e7f8-42f1-90a4-b8e082f48f2a None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:13.581793 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42b3301-e7f8-42f1-90a4-b8e082f48f2a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:13.592552 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42b3301-e7f8-42f1-90a4-b8e082f48f2a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 12:13:13.599804 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258763de-16ef-4af0-a81d-acfbee17c4d1 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:13.600584 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-c42b3301-e7f8-42f1-90a4-b8e082f48f2a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 16 12:13:13.600584 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 12:13:13.600584 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 12:13:13.600584 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 12:13:13.600584 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 12:13:13.600584 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 12:13:13.600584 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 12:13:13.600584 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 12:13:13.600584 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 12:13:13.600584 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 12:13:13.600584 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 12:13:13.600584 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 12:13:13.600584 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 12:13:13.600584 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 12:13:13.600584 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 12:13:13.600584 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 12:13:13.602255 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 12:13:13.602255 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 12:13:13.602255 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 12:13:13.602255 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 12:13:13.602255 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 12:13:13.602255 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 12:13:13.602255 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 12:13:13.602255 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 12:13:13.602255 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 12:13:13.602255 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 12:13:13.602255 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 12:13:13.602255 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jun 16 12:13:13.602255 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 12:13:13.602255 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jun 16 12:13:13.602255 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 12:13:13.602255 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 12:13:13.607774 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 12:13:13.607774 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jun 16 12:13:13.607774 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 12:13:13.607774 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jun 16 12:13:13.607774 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 12:13:13.607774 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 12:13:13.607774 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 12:13:13.607774 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 12:13:13.607774 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 12:13:13.607774 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 12:13:13.607774 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 16 12:13:13.607774 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jun 16 12:13:13.607774 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 152/304] 10.222.0.44 () {56 vars in 1099 bytes} [Thu Jun 16 12:13:13 2022] GET /identity/v3/roles/reader => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 12:13:13.607774 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42b3301-e7f8-42f1-90a4-b8e082f48f2a None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:13.647606 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b288e0e9-32d9-4f40-94b0-ee961e8ac952 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:13.648401 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b288e0e9-32d9-4f40-94b0-ee961e8ac952 None admin] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:13.648775 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b288e0e9-32d9-4f40-94b0-ee961e8ac952 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:13.649124 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b288e0e9-32d9-4f40-94b0-ee961e8ac952 None admin] PATH_INFO: `/v3/groups` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:13.649908 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b288e0e9-32d9-4f40-94b0-ee961e8ac952 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:13:13.651419 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b288e0e9-32d9-4f40-94b0-ee961e8ac952 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:13:13.671637 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 153/305] 10.222.0.44 () {60 vars in 1134 bytes} [Thu Jun 16 12:13:13 2022] POST /identity/v3/groups => generated 229 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 12:13:13.672588 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b288e0e9-32d9-4f40-94b0-ee961e8ac952 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:13.740162 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42b3301-e7f8-42f1-90a4-b8e082f48f2a None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:13.769163 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:13:13.772885 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:13:13.787527 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37615ab5-c384-447e-bd76-40d4d26e7087 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:13.789350 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37615ab5-c384-447e-bd76-40d4d26e7087 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:13.789840 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37615ab5-c384-447e-bd76-40d4d26e7087 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:13.790473 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37615ab5-c384-447e-bd76-40d4d26e7087 None admin] PATH_INFO: `/v3/users/844611af481b43d2b8d96b9e4d636756` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:13.792067 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37615ab5-c384-447e-bd76-40d4d26e7087 None admin] RBAC: Authorizing `identity:get_user(user_id=844611af481b43d2b8d96b9e4d636756)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:13:13.793895 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37615ab5-c384-447e-bd76-40d4d26e7087 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:13:13.796654 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 153/306] 10.222.0.44 () {56 vars in 1177 bytes} [Thu Jun 16 12:13:13 2022] GET /identity/v3/users/844611af481b43d2b8d96b9e4d636756 => generated 293 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:13:13.803305 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37615ab5-c384-447e-bd76-40d4d26e7087 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:13.823177 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b288e0e9-32d9-4f40-94b0-ee961e8ac952 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:13.876614 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4e2060-c468-4204-8fcd-f54414181f78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:13.877334 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4e2060-c468-4204-8fcd-f54414181f78 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:13.877669 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4e2060-c468-4204-8fcd-f54414181f78 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:13.877945 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4e2060-c468-4204-8fcd-f54414181f78 None admin] PATH_INFO: `/v3/roles` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:13.878698 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4e2060-c468-4204-8fcd-f54414181f78 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:13:13.879000 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4e2060-c468-4204-8fcd-f54414181f78 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:13:13.880402 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4e2060-c468-4204-8fcd-f54414181f78 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:13:13.890216 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 154/307] 10.222.0.44 () {56 vars in 1101 bytes} [Thu Jun 16 12:13:13 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:13:13.896496 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4e2060-c468-4204-8fcd-f54414181f78 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:13.944026 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37615ab5-c384-447e-bd76-40d4d26e7087 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:13.981991 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e228f154-5f53-4b06-a76e-37d60688fb70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:13.982905 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e228f154-5f53-4b06-a76e-37d60688fb70 None admin] REQUEST_METHOD: `PUT` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:13.983192 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e228f154-5f53-4b06-a76e-37d60688fb70 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:13.983478 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e228f154-5f53-4b06-a76e-37d60688fb70 None admin] PATH_INFO: `/v3/system/users/844611af481b43d2b8d96b9e4d636756/roles/c39882b202e942479a7cdac2fc6da72c` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:13.985205 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e228f154-5f53-4b06-a76e-37d60688fb70 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=844611af481b43d2b8d96b9e4d636756, role_id=c39882b202e942479a7cdac2fc6da72c)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:13:13.986663 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e228f154-5f53-4b06-a76e-37d60688fb70 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:13:13.998498 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 154/308] 10.222.0.44 () {58 vars in 1334 bytes} [Thu Jun 16 12:13:13 2022] PUT /identity/v3/system/users/844611af481b43d2b8d96b9e4d636756/roles/c39882b202e942479a7cdac2fc6da72c => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:13:14.035764 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b0139d-af10-47b8-87c3-b5baf3416b08 None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:14.036087 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b0139d-af10-47b8-87c3-b5baf3416b08 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:14.036315 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b0139d-af10-47b8-87c3-b5baf3416b08 None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:14.037861 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 155/309] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 12:13:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 12:13:14.040070 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4e2060-c468-4204-8fcd-f54414181f78 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:14.044075 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1828a7ef-50ce-464b-8c46-1d455052551b None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:14.044725 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1828a7ef-50ce-464b-8c46-1d455052551b None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:14.045120 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1828a7ef-50ce-464b-8c46-1d455052551b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:14.063126 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-1828a7ef-50ce-464b-8c46-1d455052551b None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:13:14.064556 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-1828a7ef-50ce-464b-8c46-1d455052551b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:13:14.083402 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:13:14.091883 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ff897a-e54e-4a70-8f76-ff4c68e9302d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:14.093573 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ff897a-e54e-4a70-8f76-ff4c68e9302d None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:14.094264 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ff897a-e54e-4a70-8f76-ff4c68e9302d None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:14.094686 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ff897a-e54e-4a70-8f76-ff4c68e9302d None admin] PATH_INFO: `/v3/users/6a70950669cd4b5b8e84318852629369` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:14.119096 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ff897a-e54e-4a70-8f76-ff4c68e9302d None admin] RBAC: Authorizing `identity:get_user(user_id=6a70950669cd4b5b8e84318852629369)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:13:14.121510 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ff897a-e54e-4a70-8f76-ff4c68e9302d None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:13:14.124074 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 155/310] 10.222.0.44 () {56 vars in 1177 bytes} [Thu Jun 16 12:13:13 2022] GET /identity/v3/users/6a70950669cd4b5b8e84318852629369 => generated 293 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 12:13:14.128812 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:13:14.131147 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ff897a-e54e-4a70-8f76-ff4c68e9302d None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:14.158835 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 156/311] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 12:13:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 12:13:14.177635 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1828a7ef-50ce-464b-8c46-1d455052551b None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:14.248853 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ff897a-e54e-4a70-8f76-ff4c68e9302d None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:14.285140 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619f2912-0fe5-4ba4-9730-ddcd32b7ad7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:14.286035 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619f2912-0fe5-4ba4-9730-ddcd32b7ad7d None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:14.286484 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619f2912-0fe5-4ba4-9730-ddcd32b7ad7d None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:14.286897 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619f2912-0fe5-4ba4-9730-ddcd32b7ad7d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:14.287873 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619f2912-0fe5-4ba4-9730-ddcd32b7ad7d None admin] RBAC: Adding query filter params (role.id=8b8940c737364011a624755f642bf504, user.id=6a70950669cd4b5b8e84318852629369, scope.system=all) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:13:14.288325 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619f2912-0fe5-4ba4-9730-ddcd32b7ad7d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:13:14.290608 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619f2912-0fe5-4ba4-9730-ddcd32b7ad7d None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:13:14.296800 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 156/312] 10.222.0.44 () {56 vars in 1308 bytes} [Thu Jun 16 12:13:14 2022] GET /identity/v3/role_assignments?user.id=6a70950669cd4b5b8e84318852629369&scope.system=all&role.id=8b8940c737364011a624755f642bf504 => generated 226 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:13:14.309454 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1828a7ef-50ce-464b-8c46-1d455052551b None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:14.350402 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c6142a-b888-4a45-a2af-f7ebd00485e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:14.351643 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c6142a-b888-4a45-a2af-f7ebd00485e8 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:14.352017 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c6142a-b888-4a45-a2af-f7ebd00485e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:14.352391 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c6142a-b888-4a45-a2af-f7ebd00485e8 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:14.366477 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c6142a-b888-4a45-a2af-f7ebd00485e8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 12:13:14.374724 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-f0c6142a-b888-4a45-a2af-f7ebd00485e8 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 16 12:13:14.374724 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 12:13:14.374724 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 12:13:14.374724 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 12:13:14.374724 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 12:13:14.374724 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 12:13:14.374724 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 12:13:14.374724 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 12:13:14.374724 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 12:13:14.374724 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 12:13:14.374724 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 12:13:14.374724 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 12:13:14.374724 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 12:13:14.374724 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 12:13:14.374724 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 12:13:14.374724 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 12:13:14.375676 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 12:13:14.375676 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 12:13:14.375676 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 12:13:14.375676 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 12:13:14.375676 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 12:13:14.375676 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 12:13:14.375676 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 12:13:14.375676 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 12:13:14.375676 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 12:13:14.375676 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 12:13:14.375676 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 12:13:14.375676 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jun 16 12:13:14.375676 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 12:13:14.375676 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jun 16 12:13:14.375676 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 12:13:14.375676 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 12:13:14.376484 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 12:13:14.376484 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jun 16 12:13:14.376484 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 12:13:14.376484 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jun 16 12:13:14.376484 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 12:13:14.376484 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 12:13:14.376484 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 12:13:14.376484 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 12:13:14.376484 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 12:13:14.376484 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 12:13:14.376484 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 16 12:13:14.376484 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jun 16 12:13:14.376484 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 157/313] 10.222.0.44 () {56 vars in 1099 bytes} [Thu Jun 16 12:13:14 2022] GET /identity/v3/roles/reader => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 12:13:14.383298 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619f2912-0fe5-4ba4-9730-ddcd32b7ad7d None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:14.448879 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:13:14.496424 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619f2912-0fe5-4ba4-9730-ddcd32b7ad7d None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:14.541791 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2f997a-7310-4c91-9c99-ebeb5f54fd87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:14.542376 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2f997a-7310-4c91-9c99-ebeb5f54fd87 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:14.542656 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2f997a-7310-4c91-9c99-ebeb5f54fd87 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:14.542920 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2f997a-7310-4c91-9c99-ebeb5f54fd87 None admin] PATH_INFO: `/v3/roles` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:14.543665 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2f997a-7310-4c91-9c99-ebeb5f54fd87 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:13:14.543965 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2f997a-7310-4c91-9c99-ebeb5f54fd87 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:13:14.545617 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2f997a-7310-4c91-9c99-ebeb5f54fd87 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:13:14.554717 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 157/314] 10.222.0.44 () {56 vars in 1101 bytes} [Thu Jun 16 12:13:14 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:13:14.560144 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c6142a-b888-4a45-a2af-f7ebd00485e8 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:14.609087 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:13:14.664508 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c6142a-b888-4a45-a2af-f7ebd00485e8 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:14.700764 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a5a93b-5fcd-47a3-b631-80c6cadcd352 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:14.701644 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a5a93b-5fcd-47a3-b631-80c6cadcd352 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:14.701920 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a5a93b-5fcd-47a3-b631-80c6cadcd352 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:14.702245 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a5a93b-5fcd-47a3-b631-80c6cadcd352 None admin] PATH_INFO: `/v3/users/5f60f7d636814bdab7c17961adef16cf` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:14.703449 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a5a93b-5fcd-47a3-b631-80c6cadcd352 None admin] RBAC: Authorizing `identity:get_user(user_id=5f60f7d636814bdab7c17961adef16cf)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:13:14.704932 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a5a93b-5fcd-47a3-b631-80c6cadcd352 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:13:14.706892 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 158/315] 10.222.0.44 () {56 vars in 1177 bytes} [Thu Jun 16 12:13:14 2022] GET /identity/v3/users/5f60f7d636814bdab7c17961adef16cf => generated 297 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:13:14.712832 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2f997a-7310-4c91-9c99-ebeb5f54fd87 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:14.822809 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2f997a-7310-4c91-9c99-ebeb5f54fd87 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:14.839719 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:13:14.858743 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27812ce4-85cf-409d-9f08-09c1b3acab65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:14.859719 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27812ce4-85cf-409d-9f08-09c1b3acab65 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:14.860267 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27812ce4-85cf-409d-9f08-09c1b3acab65 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:14.860731 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27812ce4-85cf-409d-9f08-09c1b3acab65 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:14.934664 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27812ce4-85cf-409d-9f08-09c1b3acab65 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:13:14.936130 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27812ce4-85cf-409d-9f08-09c1b3acab65 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:13:15.038488 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 158/316] 10.222.0.44 () {58 vars in 1282 bytes} [Thu Jun 16 12:13:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 12:13:15.044144 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a5a93b-5fcd-47a3-b631-80c6cadcd352 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:15.150009 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a5a93b-5fcd-47a3-b631-80c6cadcd352 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:15.164208 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:13:15.187814 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2721eb9-3ccb-449d-a5f0-c1c73d8576e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:15.188675 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2721eb9-3ccb-449d-a5f0-c1c73d8576e9 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:15.188979 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2721eb9-3ccb-449d-a5f0-c1c73d8576e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:15.189251 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2721eb9-3ccb-449d-a5f0-c1c73d8576e9 None admin] PATH_INFO: `/v3/projects/1adc255cfb4744c1b467603311c319e7` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:15.190458 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2721eb9-3ccb-449d-a5f0-c1c73d8576e9 None admin] RBAC: Authorizing `identity:get_project(project_id=1adc255cfb4744c1b467603311c319e7)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:13:15.191928 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2721eb9-3ccb-449d-a5f0-c1c73d8576e9 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:13:15.194027 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 159/317] 10.222.0.44 () {56 vars in 1186 bytes} [Thu Jun 16 12:13:15 2022] GET /identity/v3/projects/1adc255cfb4744c1b467603311c319e7 => generated 302 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:13:15.202022 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27812ce4-85cf-409d-9f08-09c1b3acab65 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:15.220346 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:13:15.309399 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27812ce4-85cf-409d-9f08-09c1b3acab65 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:15.347505 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405d006c-9ee5-4d37-b006-e575e4a53473 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:15.348181 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405d006c-9ee5-4d37-b006-e575e4a53473 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:15.348463 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405d006c-9ee5-4d37-b006-e575e4a53473 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:15.348741 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405d006c-9ee5-4d37-b006-e575e4a53473 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:15.349608 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405d006c-9ee5-4d37-b006-e575e4a53473 None admin] RBAC: Adding query filter params (role.id=8b8940c737364011a624755f642bf504, scope.project.id=1adc255cfb4744c1b467603311c319e7, user.id=5f60f7d636814bdab7c17961adef16cf) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:13:15.349919 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405d006c-9ee5-4d37-b006-e575e4a53473 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:13:15.351881 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405d006c-9ee5-4d37-b006-e575e4a53473 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:13:15.358144 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 159/318] 10.222.0.44 () {56 vars in 1374 bytes} [Thu Jun 16 12:13:15 2022] GET /identity/v3/role_assignments?user.id=5f60f7d636814bdab7c17961adef16cf&scope.project.id=1adc255cfb4744c1b467603311c319e7&role.id=8b8940c737364011a624755f642bf504 => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:13:15.926804 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b937b27-09b4-4e3b-a27f-e9e450208e9c None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:15.927095 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b937b27-09b4-4e3b-a27f-e9e450208e9c None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:15.927366 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b937b27-09b4-4e3b-a27f-e9e450208e9c None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:15.928803 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 160/319] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 12:13:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 12:13:15.934325 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c73344-07ad-400f-90bf-df65b7d05cc1 None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:15.934325 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c73344-07ad-400f-90bf-df65b7d05cc1 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:15.934600 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c73344-07ad-400f-90bf-df65b7d05cc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:15.951770 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-b8c73344-07ad-400f-90bf-df65b7d05cc1 None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:13:15.952995 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-b8c73344-07ad-400f-90bf-df65b7d05cc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:13:16.017764 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 160/320] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 12:13:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 12:13:16.040189 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b937b27-09b4-4e3b-a27f-e9e450208e9c None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:16.144489 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b937b27-09b4-4e3b-a27f-e9e450208e9c None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:16.179360 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd859e5-5c24-4209-8b81-ab3c269467e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:16.180093 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd859e5-5c24-4209-8b81-ab3c269467e7 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:16.180373 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd859e5-5c24-4209-8b81-ab3c269467e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:16.180648 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd859e5-5c24-4209-8b81-ab3c269467e7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:16.181951 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd859e5-5c24-4209-8b81-ab3c269467e7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:13:16.183446 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd859e5-5c24-4209-8b81-ab3c269467e7 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:13:16.185461 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 161/321] 10.222.0.44 () {56 vars in 1108 bytes} [Thu Jun 16 12:13:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:13:16.191005 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c73344-07ad-400f-90bf-df65b7d05cc1 None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:16.204169 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:13:16.239979 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5363691a-a0a4-497f-853f-a5af68b19d10 None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:16.240256 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5363691a-a0a4-497f-853f-a5af68b19d10 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:16.240525 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5363691a-a0a4-497f-853f-a5af68b19d10 None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:16.242603 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 162/322] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 12:13:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 12:13:16.247163 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d585b8-72f1-4fef-b393-52b644717014 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:16.247450 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d585b8-72f1-4fef-b393-52b644717014 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:16.247749 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d585b8-72f1-4fef-b393-52b644717014 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:16.266043 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-56d585b8-72f1-4fef-b393-52b644717014 None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:13:16.267225 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-56d585b8-72f1-4fef-b393-52b644717014 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:13:16.299702 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c73344-07ad-400f-90bf-df65b7d05cc1 None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:16.315554 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:13:16.335942 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f14fbc-65fb-4f1f-8c36-5ed3a74b0fff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:16.336618 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f14fbc-65fb-4f1f-8c36-5ed3a74b0fff None admin] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:16.336915 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f14fbc-65fb-4f1f-8c36-5ed3a74b0fff None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:16.337188 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f14fbc-65fb-4f1f-8c36-5ed3a74b0fff None admin] PATH_INFO: `/v3/groups` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:16.337873 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f14fbc-65fb-4f1f-8c36-5ed3a74b0fff None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:13:16.339306 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f14fbc-65fb-4f1f-8c36-5ed3a74b0fff None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:13:16.340105 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 163/323] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 12:13:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 12:13:16.352505 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 161/324] 10.222.0.44 () {60 vars in 1134 bytes} [Thu Jun 16 12:13:16 2022] POST /identity/v3/groups => generated 226 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 12:13:16.363206 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d585b8-72f1-4fef-b393-52b644717014 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:16.476699 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d585b8-72f1-4fef-b393-52b644717014 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:16.513818 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd24afc-eabd-4ddd-b8cc-3998fb043f0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:16.514614 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd24afc-eabd-4ddd-b8cc-3998fb043f0c None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:16.514886 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd24afc-eabd-4ddd-b8cc-3998fb043f0c None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:16.515150 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd24afc-eabd-4ddd-b8cc-3998fb043f0c None admin] PATH_INFO: `/v3/roles/member` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:16.522755 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa47499-2eea-4c29-bad4-5d0902b8d884 None None] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:16.523106 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa47499-2eea-4c29-bad4-5d0902b8d884 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:16.523377 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa47499-2eea-4c29-bad4-5d0902b8d884 None None] PATH_INFO: `/` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:16.525544 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 162/325] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 12:13:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 12:13:16.527970 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd24afc-eabd-4ddd-b8cc-3998fb043f0c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 12:13:16.530121 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cdb926-9bde-4ff5-8cc2-7bd60f7877c4 None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:16.530121 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cdb926-9bde-4ff5-8cc2-7bd60f7877c4 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:16.531058 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cdb926-9bde-4ff5-8cc2-7bd60f7877c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:16.536188 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-6dd24afc-eabd-4ddd-b8cc-3998fb043f0c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 16 12:13:16.536188 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 12:13:16.536188 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 12:13:16.536188 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 12:13:16.536188 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 12:13:16.536188 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 12:13:16.536188 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 12:13:16.536188 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 12:13:16.536188 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 12:13:16.536188 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 12:13:16.536188 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 12:13:16.536188 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 12:13:16.536188 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 12:13:16.536188 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 12:13:16.536188 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 12:13:16.536188 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 12:13:16.537127 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 12:13:16.537127 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 12:13:16.537127 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 12:13:16.537127 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 12:13:16.537127 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 12:13:16.537127 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 12:13:16.537127 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 12:13:16.537127 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 12:13:16.537127 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 12:13:16.537127 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 12:13:16.537127 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 12:13:16.537127 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jun 16 12:13:16.537127 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 12:13:16.537127 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jun 16 12:13:16.537127 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 12:13:16.537127 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 12:13:16.537906 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 12:13:16.537906 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jun 16 12:13:16.537906 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 12:13:16.537906 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jun 16 12:13:16.537906 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 12:13:16.537906 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 12:13:16.537906 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 12:13:16.537906 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 12:13:16.537906 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 12:13:16.537906 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 12:13:16.537906 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 16 12:13:16.537906 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jun 16 12:13:16.537906 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 164/326] 10.222.0.44 () {56 vars in 1099 bytes} [Thu Jun 16 12:13:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 12:13:16.544113 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd24afc-eabd-4ddd-b8cc-3998fb043f0c None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:16.551587 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-c7cdb926-9bde-4ff5-8cc2-7bd60f7877c4 None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:13:16.552790 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-c7cdb926-9bde-4ff5-8cc2-7bd60f7877c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:13:16.589419 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:13:16.640044 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:13:16.648943 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 163/327] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 12:13:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 12:13:16.666646 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd24afc-eabd-4ddd-b8cc-3998fb043f0c None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:16.670645 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cdb926-9bde-4ff5-8cc2-7bd60f7877c4 None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:16.709274 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b19d088-57d9-4cfc-8c06-4e30911d33ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:16.711539 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b19d088-57d9-4cfc-8c06-4e30911d33ad None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:16.711539 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b19d088-57d9-4cfc-8c06-4e30911d33ad None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:16.711539 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b19d088-57d9-4cfc-8c06-4e30911d33ad None admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:16.711539 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b19d088-57d9-4cfc-8c06-4e30911d33ad None admin] RBAC: Adding query filter params (name=member) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:13:16.711539 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b19d088-57d9-4cfc-8c06-4e30911d33ad None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:13:16.714202 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b19d088-57d9-4cfc-8c06-4e30911d33ad None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:13:16.724660 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 165/328] 10.222.0.44 () {56 vars in 1101 bytes} [Thu Jun 16 12:13:16 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 12:13:16.730338 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b19d088-57d9-4cfc-8c06-4e30911d33ad None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:16.800316 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cdb926-9bde-4ff5-8cc2-7bd60f7877c4 None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:16.842905 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f18497-0579-45e6-b174-dbc892ae0523 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:16.843861 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f18497-0579-45e6-b174-dbc892ae0523 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:16.844320 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f18497-0579-45e6-b174-dbc892ae0523 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:16.844693 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f18497-0579-45e6-b174-dbc892ae0523 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:16.856376 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f18497-0579-45e6-b174-dbc892ae0523 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 12:13:16.861310 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b19d088-57d9-4cfc-8c06-4e30911d33ad None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:16.865304 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application [None req-10f18497-0579-45e6-b174-dbc892ae0523 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 16 12:13:16.865304 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 12:13:16.865304 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 12:13:16.865304 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 12:13:16.865304 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 12:13:16.865304 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 12:13:16.865304 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 12:13:16.865304 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 12:13:16.865304 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 12:13:16.865304 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 12:13:16.865304 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 12:13:16.865304 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 12:13:16.865304 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 12:13:16.865304 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 12:13:16.865304 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 12:13:16.865304 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 12:13:16.866383 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 12:13:16.866383 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 12:13:16.866383 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 12:13:16.866383 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 12:13:16.866383 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 12:13:16.866383 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 12:13:16.866383 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 12:13:16.866383 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 12:13:16.866383 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 12:13:16.866383 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 12:13:16.866383 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 12:13:16.866383 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application with Lock( Jun 16 12:13:16.866383 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 12:13:16.866383 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._enter() Jun 16 12:13:16.866383 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 12:13:16.866383 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 12:13:16.867958 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 12:13:16.867958 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.creator() Jun 16 12:13:16.867958 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 12:13:16.867958 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application created_value = creator( Jun 16 12:13:16.867958 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 12:13:16.867958 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 12:13:16.867958 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 12:13:16.867958 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 12:13:16.867958 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 12:13:16.867958 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 12:13:16.867958 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 16 12:13:16.867958 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application Jun 16 12:13:16.870048 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 164/329] 10.222.0.44 () {56 vars in 1099 bytes} [Thu Jun 16 12:13:16 2022] GET /identity/v3/roles/reader => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 12:13:16.875948 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f18497-0579-45e6-b174-dbc892ae0523 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:16.881763 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:13:16.907494 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf3dc53-d012-497c-acd8-bd80b91acb42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:16.909314 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf3dc53-d012-497c-acd8-bd80b91acb42 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:16.909842 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf3dc53-d012-497c-acd8-bd80b91acb42 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:16.910291 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf3dc53-d012-497c-acd8-bd80b91acb42 None admin] PATH_INFO: `/v3/users/844611af481b43d2b8d96b9e4d636756` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:16.912402 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf3dc53-d012-497c-acd8-bd80b91acb42 None admin] RBAC: Authorizing `identity:get_user(user_id=844611af481b43d2b8d96b9e4d636756)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:13:16.914663 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf3dc53-d012-497c-acd8-bd80b91acb42 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:13:16.923286 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 166/330] 10.222.0.44 () {56 vars in 1177 bytes} [Thu Jun 16 12:13:16 2022] GET /identity/v3/users/844611af481b43d2b8d96b9e4d636756 => generated 293 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:13:16.929890 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf3dc53-d012-497c-acd8-bd80b91acb42 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:16.949185 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:13:17.010964 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f18497-0579-45e6-b174-dbc892ae0523 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:17.062529 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab47cd2-997e-46a0-b846-0bcebc5719b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:17.063061 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf3dc53-d012-497c-acd8-bd80b91acb42 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:17.063728 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab47cd2-997e-46a0-b846-0bcebc5719b8 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:17.064184 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab47cd2-997e-46a0-b846-0bcebc5719b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:17.064631 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab47cd2-997e-46a0-b846-0bcebc5719b8 None admin] PATH_INFO: `/v3/roles` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:17.067422 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab47cd2-997e-46a0-b846-0bcebc5719b8 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:13:17.067971 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab47cd2-997e-46a0-b846-0bcebc5719b8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:13:17.069560 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab47cd2-997e-46a0-b846-0bcebc5719b8 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:13:17.079070 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 165/331] 10.222.0.44 () {56 vars in 1101 bytes} [Thu Jun 16 12:13:16 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 12:13:17.084199 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab47cd2-997e-46a0-b846-0bcebc5719b8 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:17.103839 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182efabd-8017-484b-8e3b-f9c5b9210bd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:17.104500 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182efabd-8017-484b-8e3b-f9c5b9210bd4 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:17.104812 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182efabd-8017-484b-8e3b-f9c5b9210bd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:17.105096 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182efabd-8017-484b-8e3b-f9c5b9210bd4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:17.106078 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182efabd-8017-484b-8e3b-f9c5b9210bd4 None admin] RBAC: Adding query filter params (role.id=c39882b202e942479a7cdac2fc6da72c, user.id=844611af481b43d2b8d96b9e4d636756, scope.system=all) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:13:17.106258 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182efabd-8017-484b-8e3b-f9c5b9210bd4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:13:17.107710 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182efabd-8017-484b-8e3b-f9c5b9210bd4 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:13:17.119921 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 167/332] 10.222.0.44 () {56 vars in 1308 bytes} [Thu Jun 16 12:13:16 2022] GET /identity/v3/role_assignments?user.id=844611af481b43d2b8d96b9e4d636756&scope.system=all&role.id=c39882b202e942479a7cdac2fc6da72c => generated 510 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 12:13:17.208386 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab47cd2-997e-46a0-b846-0bcebc5719b8 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:17.242099 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:13:17.256932 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a27776f-743d-4f40-a8d4-a3161b11a45f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:17.257866 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a27776f-743d-4f40-a8d4-a3161b11a45f None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:17.258143 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a27776f-743d-4f40-a8d4-a3161b11a45f None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:17.258415 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a27776f-743d-4f40-a8d4-a3161b11a45f None admin] PATH_INFO: `/v3/users/6a70950669cd4b5b8e84318852629369` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:17.259648 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a27776f-743d-4f40-a8d4-a3161b11a45f None admin] RBAC: Authorizing `identity:get_user(user_id=6a70950669cd4b5b8e84318852629369)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:13:17.261212 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a27776f-743d-4f40-a8d4-a3161b11a45f None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:13:17.262807 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 166/333] 10.222.0.44 () {56 vars in 1177 bytes} [Thu Jun 16 12:13:17 2022] GET /identity/v3/users/6a70950669cd4b5b8e84318852629369 => generated 293 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:13:17.268669 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182efabd-8017-484b-8e3b-f9c5b9210bd4 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:17.309149 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:13:17.393881 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182efabd-8017-484b-8e3b-f9c5b9210bd4 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:17.436535 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bc61d5-205d-44f3-bbf5-51e832b3d097 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:17.437443 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bc61d5-205d-44f3-bbf5-51e832b3d097 None admin] REQUEST_METHOD: `PUT` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:17.437721 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bc61d5-205d-44f3-bbf5-51e832b3d097 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:17.437998 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bc61d5-205d-44f3-bbf5-51e832b3d097 None admin] PATH_INFO: `/v3/system/users/6a70950669cd4b5b8e84318852629369/roles/8b8940c737364011a624755f642bf504` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:17.439552 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bc61d5-205d-44f3-bbf5-51e832b3d097 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=6a70950669cd4b5b8e84318852629369, role_id=8b8940c737364011a624755f642bf504)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:13:17.440987 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bc61d5-205d-44f3-bbf5-51e832b3d097 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:13:17.455376 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 168/334] 10.222.0.44 () {58 vars in 1334 bytes} [Thu Jun 16 12:13:17 2022] PUT /identity/v3/system/users/6a70950669cd4b5b8e84318852629369/roles/8b8940c737364011a624755f642bf504 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:13:18.909534 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190475f4-2f38-4c5a-8bf8-fbc260056a04 None None] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:18.910040 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190475f4-2f38-4c5a-8bf8-fbc260056a04 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:18.910145 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190475f4-2f38-4c5a-8bf8-fbc260056a04 None None] PATH_INFO: `/` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:18.911737 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 167/335] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 12:13:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 12:13:18.916999 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436fb8e3-397c-4c17-9280-dc51552d7d7d None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:18.917398 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436fb8e3-397c-4c17-9280-dc51552d7d7d None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:18.917566 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436fb8e3-397c-4c17-9280-dc51552d7d7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:18.942244 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-436fb8e3-397c-4c17-9280-dc51552d7d7d None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:13:18.943479 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-436fb8e3-397c-4c17-9280-dc51552d7d7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:13:19.035403 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 169/336] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 12:13:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 12:13:19.074432 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190475f4-2f38-4c5a-8bf8-fbc260056a04 None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:19.207368 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190475f4-2f38-4c5a-8bf8-fbc260056a04 None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:19.245372 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09cc7bd-e1cf-4b31-a947-0d293811f799 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:19.246176 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09cc7bd-e1cf-4b31-a947-0d293811f799 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:19.246459 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09cc7bd-e1cf-4b31-a947-0d293811f799 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:19.246734 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09cc7bd-e1cf-4b31-a947-0d293811f799 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:19.267553 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09cc7bd-e1cf-4b31-a947-0d293811f799 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 12:13:19.275420 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application [None req-d09cc7bd-e1cf-4b31-a947-0d293811f799 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 16 12:13:19.275420 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 12:13:19.275420 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 12:13:19.275420 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 12:13:19.275420 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 12:13:19.275420 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 12:13:19.275420 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 12:13:19.275420 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 12:13:19.275420 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 12:13:19.275420 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 12:13:19.275420 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 12:13:19.275420 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 12:13:19.275420 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 12:13:19.275420 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 12:13:19.275420 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 12:13:19.275420 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 12:13:19.276255 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 12:13:19.276255 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 12:13:19.276255 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 12:13:19.276255 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 12:13:19.276255 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 12:13:19.276255 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 12:13:19.276255 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 12:13:19.276255 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 12:13:19.276255 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 12:13:19.276255 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 12:13:19.276255 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 12:13:19.276255 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application with Lock( Jun 16 12:13:19.276255 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 12:13:19.276255 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._enter() Jun 16 12:13:19.276255 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 12:13:19.276255 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 12:13:19.277069 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 12:13:19.277069 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.creator() Jun 16 12:13:19.277069 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 12:13:19.277069 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application created_value = creator( Jun 16 12:13:19.277069 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 12:13:19.277069 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 12:13:19.277069 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 12:13:19.277069 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 12:13:19.277069 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 12:13:19.277069 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 12:13:19.277069 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 16 12:13:19.277069 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application Jun 16 12:13:19.277069 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 168/337] 10.222.0.44 () {56 vars in 1099 bytes} [Thu Jun 16 12:13:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 12:13:19.283836 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436fb8e3-397c-4c17-9280-dc51552d7d7d None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:19.321508 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:13:19.428458 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436fb8e3-397c-4c17-9280-dc51552d7d7d None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:19.465193 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61265ef6-139b-4b2f-aa46-68be46c14bb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:19.466179 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61265ef6-139b-4b2f-aa46-68be46c14bb7 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:19.466653 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61265ef6-139b-4b2f-aa46-68be46c14bb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:19.467136 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61265ef6-139b-4b2f-aa46-68be46c14bb7 None admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:19.468095 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61265ef6-139b-4b2f-aa46-68be46c14bb7 None admin] RBAC: Adding query filter params (name=member) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:13:19.468593 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61265ef6-139b-4b2f-aa46-68be46c14bb7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:13:19.470217 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61265ef6-139b-4b2f-aa46-68be46c14bb7 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:13:19.484627 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 170/338] 10.222.0.44 () {56 vars in 1101 bytes} [Thu Jun 16 12:13:19 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:13:19.490398 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09cc7bd-e1cf-4b31-a947-0d293811f799 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:19.567959 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:13:19.626292 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09cc7bd-e1cf-4b31-a947-0d293811f799 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:19.664431 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bb5213-8794-4fc3-9053-07eb74b2c27f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:19.665123 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bb5213-8794-4fc3-9053-07eb74b2c27f None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:19.665404 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bb5213-8794-4fc3-9053-07eb74b2c27f None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:19.665678 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bb5213-8794-4fc3-9053-07eb74b2c27f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:19.705089 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b445fd65-2532-489b-9daf-e997134911d9 None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:19.705369 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b445fd65-2532-489b-9daf-e997134911d9 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:19.705643 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b445fd65-2532-489b-9daf-e997134911d9 None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:19.708462 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 171/339] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 12:13:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 12:13:19.714092 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecf1e60-4ea1-4fe9-aaf8-1cd7521c282a None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:19.714367 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecf1e60-4ea1-4fe9-aaf8-1cd7521c282a None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:19.714871 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecf1e60-4ea1-4fe9-aaf8-1cd7521c282a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:19.743262 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-6ecf1e60-4ea1-4fe9-aaf8-1cd7521c282a None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:13:19.744667 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-6ecf1e60-4ea1-4fe9-aaf8-1cd7521c282a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:13:19.762566 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bb5213-8794-4fc3-9053-07eb74b2c27f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:13:19.767686 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bb5213-8794-4fc3-9053-07eb74b2c27f None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:13:19.869143 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:13:19.888181 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 172/340] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 12:13:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 12:13:19.951292 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 169/341] 10.222.0.44 () {58 vars in 1282 bytes} [Thu Jun 16 12:13:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 461 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 12:13:19.957411 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecf1e60-4ea1-4fe9-aaf8-1cd7521c282a None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:19.974916 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:13:20.002328 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bb5213-8794-4fc3-9053-07eb74b2c27f None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:20.095209 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecf1e60-4ea1-4fe9-aaf8-1cd7521c282a None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:20.150590 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a282c4e3-82b3-4c34-9ec3-0423462b0ac6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:20.151125 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a282c4e3-82b3-4c34-9ec3-0423462b0ac6 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:20.151412 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a282c4e3-82b3-4c34-9ec3-0423462b0ac6 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:20.151690 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a282c4e3-82b3-4c34-9ec3-0423462b0ac6 None admin] PATH_INFO: `/v3/projects/02e13d55192e4bfc8385150aa7249e83` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:20.157795 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a282c4e3-82b3-4c34-9ec3-0423462b0ac6 None admin] RBAC: Authorizing `identity:get_project(project_id=02e13d55192e4bfc8385150aa7249e83)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:13:20.159355 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a282c4e3-82b3-4c34-9ec3-0423462b0ac6 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:13:20.161275 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 173/342] 10.222.0.44 () {56 vars in 1186 bytes} [Thu Jun 16 12:13:19 2022] GET /identity/v3/projects/02e13d55192e4bfc8385150aa7249e83 => generated 298 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:13:20.168095 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a282c4e3-82b3-4c34-9ec3-0423462b0ac6 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:20.172541 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bb5213-8794-4fc3-9053-07eb74b2c27f None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:20.210959 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846e7654-ce9b-47fb-9f23-4682fa1f43c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:20.212782 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846e7654-ce9b-47fb-9f23-4682fa1f43c2 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:20.212782 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846e7654-ce9b-47fb-9f23-4682fa1f43c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:20.212782 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846e7654-ce9b-47fb-9f23-4682fa1f43c2 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:20.223959 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846e7654-ce9b-47fb-9f23-4682fa1f43c2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 12:13:20.232814 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application [None req-846e7654-ce9b-47fb-9f23-4682fa1f43c2 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 12:13:20.232814 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 12:13:20.232814 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 12:13:20.232814 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 12:13:20.232814 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 12:13:20.232814 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 12:13:20.232814 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 12:13:20.232814 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 12:13:20.232814 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 12:13:20.232814 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 12:13:20.232814 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 12:13:20.232814 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 12:13:20.232814 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 12:13:20.232814 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 12:13:20.232814 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 12:13:20.232814 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 12:13:20.233958 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 12:13:20.233958 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 12:13:20.233958 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 12:13:20.233958 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 12:13:20.233958 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 12:13:20.233958 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 12:13:20.233958 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 12:13:20.233958 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 12:13:20.233958 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 12:13:20.233958 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 12:13:20.233958 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 12:13:20.233958 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application with Lock( Jun 16 12:13:20.233958 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 12:13:20.233958 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._enter() Jun 16 12:13:20.233958 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 12:13:20.233958 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 12:13:20.234959 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 12:13:20.234959 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.creator() Jun 16 12:13:20.234959 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 12:13:20.234959 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application created_value = creator( Jun 16 12:13:20.234959 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 12:13:20.234959 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 12:13:20.234959 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 12:13:20.234959 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 12:13:20.234959 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 12:13:20.234959 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 12:13:20.234959 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 12:13:20.234959 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application Jun 16 12:13:20.236063 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 170/343] 10.222.0.44 () {56 vars in 1114 bytes} [Thu Jun 16 12:13:20 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 12:13:20.241574 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846e7654-ce9b-47fb-9f23-4682fa1f43c2 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:20.256802 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:13:20.359024 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846e7654-ce9b-47fb-9f23-4682fa1f43c2 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:20.391595 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:13:20.400799 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44572ee-dc5e-4619-a74b-b184a528bc9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:20.400799 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44572ee-dc5e-4619-a74b-b184a528bc9c None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:20.400799 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44572ee-dc5e-4619-a74b-b184a528bc9c None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:20.400799 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44572ee-dc5e-4619-a74b-b184a528bc9c None admin] PATH_INFO: `/v3/roles` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:20.401184 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44572ee-dc5e-4619-a74b-b184a528bc9c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:13:20.401184 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44572ee-dc5e-4619-a74b-b184a528bc9c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:13:20.401184 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44572ee-dc5e-4619-a74b-b184a528bc9c None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:13:20.411055 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 171/344] 10.222.0.44 () {56 vars in 1111 bytes} [Thu Jun 16 12:13:20 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 12:13:20.412401 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fbd239-0071-49bc-8549-a5aa65488372 None None] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:20.412810 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fbd239-0071-49bc-8549-a5aa65488372 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:20.412999 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fbd239-0071-49bc-8549-a5aa65488372 None None] PATH_INFO: `/` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:20.414336 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 172/345] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 12:13:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 12:13:20.415329 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e89fc08-b601-41ce-beb9-f8137e822e08 None None] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:20.415682 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e89fc08-b601-41ce-beb9-f8137e822e08 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:20.415938 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e89fc08-b601-41ce-beb9-f8137e822e08 None None] PATH_INFO: `/` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:20.417196 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 173/346] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 12:13:20 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 12:13:20.422226 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28147b92-68be-45b2-ab9e-bcaa7f7a887c None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:20.422578 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28147b92-68be-45b2-ab9e-bcaa7f7a887c None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:20.422859 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28147b92-68be-45b2-ab9e-bcaa7f7a887c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:20.425470 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a282c4e3-82b3-4c34-9ec3-0423462b0ac6 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:20.445037 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-28147b92-68be-45b2-ab9e-bcaa7f7a887c None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:13:20.445037 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-28147b92-68be-45b2-ab9e-bcaa7f7a887c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:13:20.473039 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbef1e9-17a3-4596-a870-875db6778cb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:20.474092 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbef1e9-17a3-4596-a870-875db6778cb0 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:20.474464 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbef1e9-17a3-4596-a870-875db6778cb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:20.474852 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbef1e9-17a3-4596-a870-875db6778cb0 None admin] PATH_INFO: `/v3/groups/f52e88ae0f3e4e4c89d3258aea3be7d0` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:20.482847 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbef1e9-17a3-4596-a870-875db6778cb0 None admin] RBAC: Authorizing `identity:get_group(group_id=f52e88ae0f3e4e4c89d3258aea3be7d0)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:13:20.484324 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbef1e9-17a3-4596-a870-875db6778cb0 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:13:20.486495 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 174/347] 10.222.0.44 () {56 vars in 1180 bytes} [Thu Jun 16 12:13:20 2022] GET /identity/v3/groups/f52e88ae0f3e4e4c89d3258aea3be7d0 => generated 226 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 12:13:20.487476 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbef1e9-17a3-4596-a870-875db6778cb0 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:20.515468 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 174/348] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 12:13:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 12:13:20.516686 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4b035f-a0ad-43e9-a543-cafc7b243708 None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:20.521170 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4b035f-a0ad-43e9-a543-cafc7b243708 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:20.521463 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4b035f-a0ad-43e9-a543-cafc7b243708 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:20.532037 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:13:20.553753 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-3b4b035f-a0ad-43e9-a543-cafc7b243708 None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:13:20.554996 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-3b4b035f-a0ad-43e9-a543-cafc7b243708 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:13:20.598804 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbef1e9-17a3-4596-a870-875db6778cb0 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:20.636837 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 175/349] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 12:13:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 12:13:20.637703 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4b035f-a0ad-43e9-a543-cafc7b243708 None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:20.646080 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20466157-473d-4f97-993b-62de072640de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:20.646747 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20466157-473d-4f97-993b-62de072640de None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:20.647023 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20466157-473d-4f97-993b-62de072640de None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:20.647296 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20466157-473d-4f97-993b-62de072640de None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:20.665754 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:13:20.734336 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20466157-473d-4f97-993b-62de072640de None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:13:20.737108 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20466157-473d-4f97-993b-62de072640de None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:13:20.767453 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4b035f-a0ad-43e9-a543-cafc7b243708 None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:20.808162 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:13:20.815837 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8607f3-b4bf-44b2-ac34-0601a4abd2ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:20.816513 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8607f3-b4bf-44b2-ac34-0601a4abd2ac None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:20.816822 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8607f3-b4bf-44b2-ac34-0601a4abd2ac None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:20.817104 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8607f3-b4bf-44b2-ac34-0601a4abd2ac None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:20.818244 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8607f3-b4bf-44b2-ac34-0601a4abd2ac None admin] RBAC: Adding query filter params (group.id=f52e88ae0f3e4e4c89d3258aea3be7d0, role.id=c39882b202e942479a7cdac2fc6da72c, scope.project.id=02e13d55192e4bfc8385150aa7249e83) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:13:20.818817 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8607f3-b4bf-44b2-ac34-0601a4abd2ac None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:13:20.822493 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8607f3-b4bf-44b2-ac34-0601a4abd2ac None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:13:20.829877 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 176/350] 10.222.0.44 () {56 vars in 1376 bytes} [Thu Jun 16 12:13:20 2022] GET /identity/v3/role_assignments?group.id=f52e88ae0f3e4e4c89d3258aea3be7d0&scope.project.id=02e13d55192e4bfc8385150aa7249e83&role.id=c39882b202e942479a7cdac2fc6da72c => generated 260 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:13:20.830786 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8607f3-b4bf-44b2-ac34-0601a4abd2ac None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:20.900953 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 175/351] 10.222.0.44 () {58 vars in 1282 bytes} [Thu Jun 16 12:13:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 12:13:20.907018 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20466157-473d-4f97-993b-62de072640de None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:21.010457 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:13:21.031911 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8607f3-b4bf-44b2-ac34-0601a4abd2ac None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:21.074958 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdcb575-472a-46c8-85b5-029b0f293be3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:21.076151 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdcb575-472a-46c8-85b5-029b0f293be3 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:21.077004 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdcb575-472a-46c8-85b5-029b0f293be3 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:21.077484 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdcb575-472a-46c8-85b5-029b0f293be3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:21.095713 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdcb575-472a-46c8-85b5-029b0f293be3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 12:13:21.097071 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20466157-473d-4f97-993b-62de072640de None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:21.106197 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application [None req-bcdcb575-472a-46c8-85b5-029b0f293be3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 16 12:13:21.106197 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 12:13:21.106197 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 12:13:21.106197 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 12:13:21.106197 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 12:13:21.106197 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 12:13:21.106197 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 12:13:21.106197 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 12:13:21.106197 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 12:13:21.106197 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 12:13:21.106197 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 12:13:21.106197 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 12:13:21.106197 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 12:13:21.106197 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 12:13:21.106197 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 12:13:21.106197 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 12:13:21.107227 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 12:13:21.107227 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 12:13:21.107227 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 12:13:21.107227 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 12:13:21.107227 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 12:13:21.107227 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 12:13:21.107227 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 12:13:21.107227 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 12:13:21.107227 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 12:13:21.107227 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 12:13:21.107227 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 12:13:21.107227 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application with Lock( Jun 16 12:13:21.107227 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 12:13:21.107227 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._enter() Jun 16 12:13:21.107227 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 12:13:21.107227 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 12:13:21.108028 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 12:13:21.108028 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.creator() Jun 16 12:13:21.108028 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 12:13:21.108028 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application created_value = creator( Jun 16 12:13:21.108028 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 12:13:21.108028 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 12:13:21.108028 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 12:13:21.108028 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 12:13:21.108028 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 12:13:21.108028 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 12:13:21.108028 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 16 12:13:21.108028 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application Jun 16 12:13:21.108640 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 177/352] 10.222.0.44 () {56 vars in 1099 bytes} [Thu Jun 16 12:13:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 12:13:21.109446 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdcb575-472a-46c8-85b5-029b0f293be3 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:21.150673 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6985358e-df69-4768-9cce-dda7b45646e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:21.152488 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6985358e-df69-4768-9cce-dda7b45646e0 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:21.152979 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6985358e-df69-4768-9cce-dda7b45646e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:21.153457 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6985358e-df69-4768-9cce-dda7b45646e0 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:21.171498 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6985358e-df69-4768-9cce-dda7b45646e0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 12:13:21.181938 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:13:21.184641 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-6985358e-df69-4768-9cce-dda7b45646e0 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 12:13:21.184641 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 12:13:21.184641 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 12:13:21.184641 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 12:13:21.184641 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 12:13:21.184641 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 12:13:21.184641 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 12:13:21.184641 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 12:13:21.184641 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 12:13:21.184641 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 12:13:21.184641 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 12:13:21.184641 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 12:13:21.184641 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 12:13:21.184641 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 12:13:21.184641 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 12:13:21.184641 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 12:13:21.185650 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 12:13:21.185650 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 12:13:21.185650 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 12:13:21.185650 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 12:13:21.185650 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 12:13:21.185650 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 12:13:21.185650 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 12:13:21.185650 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 12:13:21.185650 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 12:13:21.185650 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 12:13:21.185650 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 12:13:21.185650 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jun 16 12:13:21.185650 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 12:13:21.185650 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jun 16 12:13:21.185650 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 12:13:21.185650 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 12:13:21.186481 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 12:13:21.186481 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jun 16 12:13:21.186481 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 12:13:21.186481 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jun 16 12:13:21.186481 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 12:13:21.186481 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 12:13:21.186481 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 12:13:21.186481 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 12:13:21.186481 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 12:13:21.186481 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 12:13:21.186481 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 12:13:21.186481 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jun 16 12:13:21.189808 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 176/353] 10.222.0.44 () {56 vars in 1114 bytes} [Thu Jun 16 12:13:20 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 12:13:21.191546 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d414fa5c-2075-445c-b522-08894db35fb0 None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:21.192032 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d414fa5c-2075-445c-b522-08894db35fb0 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:21.192515 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d414fa5c-2075-445c-b522-08894db35fb0 None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:21.194293 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 177/354] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 12:13:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 12:13:21.195263 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d414fa5c-2075-445c-b522-08894db35fb0 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:21.242025 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdcb575-472a-46c8-85b5-029b0f293be3 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:21.280732 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83dd0b5-ff7b-4436-8ed5-90dcb23ff093 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:21.282035 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83dd0b5-ff7b-4436-8ed5-90dcb23ff093 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:21.282530 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83dd0b5-ff7b-4436-8ed5-90dcb23ff093 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:21.283004 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83dd0b5-ff7b-4436-8ed5-90dcb23ff093 None admin] PATH_INFO: `/v3/projects/02e13d55192e4bfc8385150aa7249e83` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:21.284548 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83dd0b5-ff7b-4436-8ed5-90dcb23ff093 None admin] RBAC: Authorizing `identity:get_project(project_id=02e13d55192e4bfc8385150aa7249e83)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:13:21.286337 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83dd0b5-ff7b-4436-8ed5-90dcb23ff093 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:13:21.289220 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 178/355] 10.222.0.44 () {56 vars in 1186 bytes} [Thu Jun 16 12:13:21 2022] GET /identity/v3/projects/02e13d55192e4bfc8385150aa7249e83 => generated 298 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:13:21.290301 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83dd0b5-ff7b-4436-8ed5-90dcb23ff093 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:21.312681 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d414fa5c-2075-445c-b522-08894db35fb0 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:21.315188 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:13:21.352279 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c193430-6422-49e3-a775-e71a729a2cda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:21.353093 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c193430-6422-49e3-a775-e71a729a2cda None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:21.353397 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c193430-6422-49e3-a775-e71a729a2cda None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:21.353755 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c193430-6422-49e3-a775-e71a729a2cda None admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:21.354526 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c193430-6422-49e3-a775-e71a729a2cda None admin] RBAC: Adding query filter params (name=member) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:13:21.354831 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c193430-6422-49e3-a775-e71a729a2cda None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:13:21.356279 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c193430-6422-49e3-a775-e71a729a2cda None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:13:21.367139 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 178/356] 10.222.0.44 () {56 vars in 1101 bytes} [Thu Jun 16 12:13:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:13:21.368431 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96029ce-453c-4bcb-a14d-4260b0e6ae4e None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:21.368779 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96029ce-453c-4bcb-a14d-4260b0e6ae4e None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:21.370028 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96029ce-453c-4bcb-a14d-4260b0e6ae4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:21.387832 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-e96029ce-453c-4bcb-a14d-4260b0e6ae4e None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:13:21.389071 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-e96029ce-453c-4bcb-a14d-4260b0e6ae4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:13:21.410975 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83dd0b5-ff7b-4436-8ed5-90dcb23ff093 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:21.459896 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:13:21.474771 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b4677f-ce36-4c91-bbb4-d858f47d5816 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:21.475302 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b4677f-ce36-4c91-bbb4-d858f47d5816 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:21.475581 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b4677f-ce36-4c91-bbb4-d858f47d5816 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:21.476416 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b4677f-ce36-4c91-bbb4-d858f47d5816 None admin] PATH_INFO: `/v3/roles` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:21.477748 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b4677f-ce36-4c91-bbb4-d858f47d5816 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:13:21.477748 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b4677f-ce36-4c91-bbb4-d858f47d5816 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:13:21.478887 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b4677f-ce36-4c91-bbb4-d858f47d5816 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:13:21.480114 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 179/357] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 12:13:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 12:13:21.481608 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96029ce-453c-4bcb-a14d-4260b0e6ae4e None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:21.490759 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 179/358] 10.222.0.44 () {56 vars in 1111 bytes} [Thu Jun 16 12:13:21 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:13:21.492127 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b4677f-ce36-4c91-bbb4-d858f47d5816 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:21.602485 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:13:21.606702 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b4677f-ce36-4c91-bbb4-d858f47d5816 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:21.608799 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96029ce-453c-4bcb-a14d-4260b0e6ae4e None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:21.643632 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e8df95-db49-43fa-9d92-1d3b92ea2340 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:21.644285 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e8df95-db49-43fa-9d92-1d3b92ea2340 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:21.644562 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e8df95-db49-43fa-9d92-1d3b92ea2340 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:21.644881 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e8df95-db49-43fa-9d92-1d3b92ea2340 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:21.644988 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262a03b4-098a-41ec-a593-d28b8e3b721e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:21.645895 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262a03b4-098a-41ec-a593-d28b8e3b721e None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:21.646191 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262a03b4-098a-41ec-a593-d28b8e3b721e None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:21.646466 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262a03b4-098a-41ec-a593-d28b8e3b721e None admin] PATH_INFO: `/v3/groups/f52e88ae0f3e4e4c89d3258aea3be7d0` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:21.649379 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262a03b4-098a-41ec-a593-d28b8e3b721e None admin] RBAC: Authorizing `identity:get_group(group_id=f52e88ae0f3e4e4c89d3258aea3be7d0)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:13:21.651201 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262a03b4-098a-41ec-a593-d28b8e3b721e None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:13:21.653860 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 180/359] 10.222.0.44 () {56 vars in 1180 bytes} [Thu Jun 16 12:13:21 2022] GET /identity/v3/groups/f52e88ae0f3e4e4c89d3258aea3be7d0 => generated 226 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:13:21.656815 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a21cf8-e5c1-4e38-8433-63426b7f1fd0 None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:21.656815 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a21cf8-e5c1-4e38-8433-63426b7f1fd0 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:21.656815 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a21cf8-e5c1-4e38-8433-63426b7f1fd0 None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:21.656815 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 181/360] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 12:13:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 12:13:21.657118 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a21cf8-e5c1-4e38-8433-63426b7f1fd0 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:21.712433 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:13:21.732899 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e8df95-db49-43fa-9d92-1d3b92ea2340 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:13:21.734365 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e8df95-db49-43fa-9d92-1d3b92ea2340 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:13:21.796595 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a21cf8-e5c1-4e38-8433-63426b7f1fd0 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:21.842258 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543c1c9b-379d-4e55-b361-5fb5cd4882ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:21.843097 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543c1c9b-379d-4e55-b361-5fb5cd4882ce None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:21.843378 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543c1c9b-379d-4e55-b361-5fb5cd4882ce None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:21.843940 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543c1c9b-379d-4e55-b361-5fb5cd4882ce None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:21.863441 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 180/361] 10.222.0.44 () {58 vars in 1282 bytes} [Thu Jun 16 12:13:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 12:13:21.864271 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e8df95-db49-43fa-9d92-1d3b92ea2340 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:21.902676 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:13:21.958761 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543c1c9b-379d-4e55-b361-5fb5cd4882ce None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:13:21.961277 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543c1c9b-379d-4e55-b361-5fb5cd4882ce None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:13:21.971668 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:13:21.988114 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e8df95-db49-43fa-9d92-1d3b92ea2340 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:22.024888 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15881433-de44-4341-ae26-cb097ef3e087 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:22.025944 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15881433-de44-4341-ae26-cb097ef3e087 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:22.026423 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15881433-de44-4341-ae26-cb097ef3e087 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:22.026699 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15881433-de44-4341-ae26-cb097ef3e087 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:22.037350 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15881433-de44-4341-ae26-cb097ef3e087 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 12:13:22.045494 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application [None req-15881433-de44-4341-ae26-cb097ef3e087 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 16 12:13:22.045494 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 12:13:22.045494 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 12:13:22.045494 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 12:13:22.045494 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 12:13:22.045494 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 12:13:22.045494 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 12:13:22.045494 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 12:13:22.045494 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 12:13:22.045494 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 12:13:22.045494 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 12:13:22.045494 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 12:13:22.045494 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 12:13:22.045494 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 12:13:22.045494 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 12:13:22.045494 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 12:13:22.046382 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 12:13:22.046382 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 12:13:22.046382 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 12:13:22.046382 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 12:13:22.046382 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 12:13:22.046382 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 12:13:22.046382 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 12:13:22.046382 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 12:13:22.046382 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 12:13:22.046382 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 12:13:22.046382 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 12:13:22.046382 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application with Lock( Jun 16 12:13:22.046382 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 12:13:22.046382 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._enter() Jun 16 12:13:22.046382 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 12:13:22.046382 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 12:13:22.047176 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 12:13:22.047176 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.creator() Jun 16 12:13:22.047176 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 12:13:22.047176 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application created_value = creator( Jun 16 12:13:22.047176 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 12:13:22.047176 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 12:13:22.047176 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 12:13:22.047176 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 12:13:22.047176 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 12:13:22.047176 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 12:13:22.047176 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 16 12:13:22.047176 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application Jun 16 12:13:22.047176 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 181/362] 10.222.0.44 () {56 vars in 1099 bytes} [Thu Jun 16 12:13:21 2022] GET /identity/v3/roles/reader => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 12:13:22.048387 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15881433-de44-4341-ae26-cb097ef3e087 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:22.079615 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 182/363] 10.222.0.44 () {58 vars in 1282 bytes} [Thu Jun 16 12:13:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 12:13:22.081716 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751292e2-6eda-4a10-aaf2-482e4d5a5a1e None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:22.084230 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751292e2-6eda-4a10-aaf2-482e4d5a5a1e None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:22.084230 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751292e2-6eda-4a10-aaf2-482e4d5a5a1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:22.100427 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-751292e2-6eda-4a10-aaf2-482e4d5a5a1e None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:13:22.101785 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-751292e2-6eda-4a10-aaf2-482e4d5a5a1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:13:22.170482 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15881433-de44-4341-ae26-cb097ef3e087 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:22.178249 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:13:22.191592 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 183/364] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 12:13:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 12:13:22.191592 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751292e2-6eda-4a10-aaf2-482e4d5a5a1e None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:22.216506 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd655ce6-b5f9-45ba-a8ee-1665d679390e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:22.217536 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd655ce6-b5f9-45ba-a8ee-1665d679390e None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:22.218118 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd655ce6-b5f9-45ba-a8ee-1665d679390e None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:22.218474 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd655ce6-b5f9-45ba-a8ee-1665d679390e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:22.219867 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd655ce6-b5f9-45ba-a8ee-1665d679390e None admin] RBAC: Adding query filter params (group.id=f52e88ae0f3e4e4c89d3258aea3be7d0, role.id=e24b3707bc514b1fa606efab092047e6, scope.project.id=02e13d55192e4bfc8385150aa7249e83) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:13:22.220386 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd655ce6-b5f9-45ba-a8ee-1665d679390e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:13:22.222295 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd655ce6-b5f9-45ba-a8ee-1665d679390e None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:13:22.232831 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 182/365] 10.222.0.44 () {56 vars in 1376 bytes} [Thu Jun 16 12:13:22 2022] GET /identity/v3/role_assignments?group.id=f52e88ae0f3e4e4c89d3258aea3be7d0&scope.project.id=02e13d55192e4bfc8385150aa7249e83&role.id=e24b3707bc514b1fa606efab092047e6 => generated 260 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:13:22.233765 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd655ce6-b5f9-45ba-a8ee-1665d679390e None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:22.253825 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:13:22.322981 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751292e2-6eda-4a10-aaf2-482e4d5a5a1e None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:22.363427 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b09fc84-500b-436f-bc09-9277ff556597 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:22.364643 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b09fc84-500b-436f-bc09-9277ff556597 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:22.365133 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b09fc84-500b-436f-bc09-9277ff556597 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:22.365587 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b09fc84-500b-436f-bc09-9277ff556597 None admin] PATH_INFO: `/v3/projects/1adc255cfb4744c1b467603311c319e7` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:22.367624 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b09fc84-500b-436f-bc09-9277ff556597 None admin] RBAC: Authorizing `identity:get_project(project_id=1adc255cfb4744c1b467603311c319e7)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:13:22.369392 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b09fc84-500b-436f-bc09-9277ff556597 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:13:22.370472 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd655ce6-b5f9-45ba-a8ee-1665d679390e None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:22.371595 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 184/366] 10.222.0.44 () {56 vars in 1186 bytes} [Thu Jun 16 12:13:22 2022] GET /identity/v3/projects/1adc255cfb4744c1b467603311c319e7 => generated 302 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:13:22.372551 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b09fc84-500b-436f-bc09-9277ff556597 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:22.417748 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08793b8-847d-4d40-95d9-a7b0c1877007 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:22.418931 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08793b8-847d-4d40-95d9-a7b0c1877007 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:22.419743 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08793b8-847d-4d40-95d9-a7b0c1877007 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:22.420229 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08793b8-847d-4d40-95d9-a7b0c1877007 None admin] PATH_INFO: `/v3/roles` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:22.421836 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08793b8-847d-4d40-95d9-a7b0c1877007 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:13:22.422367 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08793b8-847d-4d40-95d9-a7b0c1877007 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:13:22.424162 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08793b8-847d-4d40-95d9-a7b0c1877007 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:13:22.436227 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 183/367] 10.222.0.44 () {56 vars in 1101 bytes} [Thu Jun 16 12:13:22 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:13:22.437584 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08793b8-847d-4d40-95d9-a7b0c1877007 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:22.509448 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b09fc84-500b-436f-bc09-9277ff556597 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:22.513075 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:13:22.533753 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:13:22.563747 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0bd860-49b6-4045-a8f2-d36ca0e2c06c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:22.564925 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0bd860-49b6-4045-a8f2-d36ca0e2c06c None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:22.565210 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0bd860-49b6-4045-a8f2-d36ca0e2c06c None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:22.565486 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0bd860-49b6-4045-a8f2-d36ca0e2c06c None admin] PATH_INFO: `/v3/projects/1adc255cfb4744c1b467603311c319e7` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:22.567537 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0bd860-49b6-4045-a8f2-d36ca0e2c06c None admin] RBAC: Authorizing `identity:get_project(project_id=1adc255cfb4744c1b467603311c319e7)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:13:22.569448 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0bd860-49b6-4045-a8f2-d36ca0e2c06c None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:13:22.572992 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 185/368] 10.222.0.44 () {56 vars in 1186 bytes} [Thu Jun 16 12:13:22 2022] GET /identity/v3/projects/1adc255cfb4744c1b467603311c319e7 => generated 302 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:13:22.574309 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0bd860-49b6-4045-a8f2-d36ca0e2c06c None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:22.580949 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08793b8-847d-4d40-95d9-a7b0c1877007 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:22.623342 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769e9cfa-8b89-41a8-9023-623d01018c38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:22.624141 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769e9cfa-8b89-41a8-9023-623d01018c38 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:22.624419 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769e9cfa-8b89-41a8-9023-623d01018c38 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:22.624688 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769e9cfa-8b89-41a8-9023-623d01018c38 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:22.640134 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769e9cfa-8b89-41a8-9023-623d01018c38 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 12:13:22.648021 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application [None req-769e9cfa-8b89-41a8-9023-623d01018c38 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 12:13:22.648021 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 12:13:22.648021 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 12:13:22.648021 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 12:13:22.648021 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 12:13:22.648021 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 12:13:22.648021 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 12:13:22.648021 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 12:13:22.648021 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 12:13:22.648021 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 12:13:22.648021 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 12:13:22.648021 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 12:13:22.648021 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 12:13:22.648021 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 12:13:22.648021 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 12:13:22.648021 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 12:13:22.648934 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 12:13:22.648934 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 12:13:22.648934 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 12:13:22.648934 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 12:13:22.648934 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 12:13:22.648934 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 12:13:22.648934 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 12:13:22.648934 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 12:13:22.648934 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 12:13:22.648934 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 12:13:22.648934 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 12:13:22.648934 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application with Lock( Jun 16 12:13:22.648934 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 12:13:22.648934 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._enter() Jun 16 12:13:22.648934 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 12:13:22.648934 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 12:13:22.649713 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 12:13:22.649713 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.creator() Jun 16 12:13:22.649713 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 12:13:22.649713 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application created_value = creator( Jun 16 12:13:22.649713 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 12:13:22.649713 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 12:13:22.649713 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 12:13:22.649713 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 12:13:22.649713 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 12:13:22.649713 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 12:13:22.649713 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 12:13:22.649713 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application Jun 16 12:13:22.650794 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 184/369] 10.222.0.44 () {56 vars in 1096 bytes} [Thu Jun 16 12:13:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 12:13:22.652008 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769e9cfa-8b89-41a8-9023-623d01018c38 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:22.700569 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0bd860-49b6-4045-a8f2-d36ca0e2c06c None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:22.731980 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:13:22.740166 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0096c236-e2f0-4986-ba4c-ede614cf1542 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:22.741446 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0096c236-e2f0-4986-ba4c-ede614cf1542 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:22.741726 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0096c236-e2f0-4986-ba4c-ede614cf1542 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:22.742261 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0096c236-e2f0-4986-ba4c-ede614cf1542 None admin] PATH_INFO: `/v3/groups/f52e88ae0f3e4e4c89d3258aea3be7d0` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:22.743931 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0096c236-e2f0-4986-ba4c-ede614cf1542 None admin] RBAC: Authorizing `identity:get_group(group_id=f52e88ae0f3e4e4c89d3258aea3be7d0)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:13:22.745590 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0096c236-e2f0-4986-ba4c-ede614cf1542 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:13:22.748817 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 186/370] 10.222.0.44 () {56 vars in 1180 bytes} [Thu Jun 16 12:13:22 2022] GET /identity/v3/groups/f52e88ae0f3e4e4c89d3258aea3be7d0 => generated 226 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:13:22.749687 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0096c236-e2f0-4986-ba4c-ede614cf1542 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:22.767831 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769e9cfa-8b89-41a8-9023-623d01018c38 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:22.805843 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:13:22.807833 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491e0bc1-91d8-478f-8926-4aa224aeccc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:22.808896 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491e0bc1-91d8-478f-8926-4aa224aeccc0 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:22.809302 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491e0bc1-91d8-478f-8926-4aa224aeccc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:22.809644 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491e0bc1-91d8-478f-8926-4aa224aeccc0 None admin] PATH_INFO: `/v3/users/6a70950669cd4b5b8e84318852629369` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:22.811122 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491e0bc1-91d8-478f-8926-4aa224aeccc0 None admin] RBAC: Authorizing `identity:get_user(user_id=6a70950669cd4b5b8e84318852629369)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:13:22.813051 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491e0bc1-91d8-478f-8926-4aa224aeccc0 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:13:22.814939 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 185/371] 10.222.0.44 () {56 vars in 1177 bytes} [Thu Jun 16 12:13:22 2022] GET /identity/v3/users/6a70950669cd4b5b8e84318852629369 => generated 293 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:13:22.815782 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491e0bc1-91d8-478f-8926-4aa224aeccc0 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:22.870292 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0096c236-e2f0-4986-ba4c-ede614cf1542 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:22.911171 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585a30b2-0aa2-413a-8ed0-a4a0573f2e8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:22.912460 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585a30b2-0aa2-413a-8ed0-a4a0573f2e8e None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:22.913468 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585a30b2-0aa2-413a-8ed0-a4a0573f2e8e None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:22.913969 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585a30b2-0aa2-413a-8ed0-a4a0573f2e8e None admin] PATH_INFO: `/v3/groups/f52e88ae0f3e4e4c89d3258aea3be7d0` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:22.915446 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585a30b2-0aa2-413a-8ed0-a4a0573f2e8e None admin] RBAC: Authorizing `identity:get_group(group_id=f52e88ae0f3e4e4c89d3258aea3be7d0)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:13:22.917204 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585a30b2-0aa2-413a-8ed0-a4a0573f2e8e None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:13:22.920668 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 187/372] 10.222.0.44 () {56 vars in 1180 bytes} [Thu Jun 16 12:13:22 2022] GET /identity/v3/groups/f52e88ae0f3e4e4c89d3258aea3be7d0 => generated 226 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:13:22.921813 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585a30b2-0aa2-413a-8ed0-a4a0573f2e8e None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:22.954673 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491e0bc1-91d8-478f-8926-4aa224aeccc0 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:22.994008 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b17058-b51f-4fcd-83a7-97aaae826736 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:22.995168 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b17058-b51f-4fcd-83a7-97aaae826736 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:22.995168 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b17058-b51f-4fcd-83a7-97aaae826736 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:22.995558 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b17058-b51f-4fcd-83a7-97aaae826736 None admin] PATH_INFO: `/v3/roles` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:22.996405 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b17058-b51f-4fcd-83a7-97aaae826736 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:13:22.996847 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b17058-b51f-4fcd-83a7-97aaae826736 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:13:22.999361 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b17058-b51f-4fcd-83a7-97aaae826736 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:13:23.009150 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 186/373] 10.222.0.44 () {56 vars in 1099 bytes} [Thu Jun 16 12:13:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:13:23.010114 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b17058-b51f-4fcd-83a7-97aaae826736 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:23.016776 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:13:23.055249 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585a30b2-0aa2-413a-8ed0-a4a0573f2e8e None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:23.087842 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:13:23.094792 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4604e222-c3f5-4baf-b075-ecc5ab306973 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:23.095538 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4604e222-c3f5-4baf-b075-ecc5ab306973 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:23.095892 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4604e222-c3f5-4baf-b075-ecc5ab306973 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:23.096236 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4604e222-c3f5-4baf-b075-ecc5ab306973 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:23.097203 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4604e222-c3f5-4baf-b075-ecc5ab306973 None admin] RBAC: Adding query filter params (group.id=f52e88ae0f3e4e4c89d3258aea3be7d0, role.id=c39882b202e942479a7cdac2fc6da72c, scope.project.id=1adc255cfb4744c1b467603311c319e7) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:13:23.097579 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4604e222-c3f5-4baf-b075-ecc5ab306973 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:13:23.099174 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4604e222-c3f5-4baf-b075-ecc5ab306973 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:13:23.105863 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 188/374] 10.222.0.44 () {56 vars in 1376 bytes} [Thu Jun 16 12:13:22 2022] GET /identity/v3/role_assignments?group.id=f52e88ae0f3e4e4c89d3258aea3be7d0&scope.project.id=1adc255cfb4744c1b467603311c319e7&role.id=c39882b202e942479a7cdac2fc6da72c => generated 260 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:13:23.106815 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4604e222-c3f5-4baf-b075-ecc5ab306973 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:23.155230 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b17058-b51f-4fcd-83a7-97aaae826736 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:23.223723 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4604e222-c3f5-4baf-b075-ecc5ab306973 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:23.234256 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31893db-a53f-4b27-b171-a613e185329e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:23.234906 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31893db-a53f-4b27-b171-a613e185329e None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:23.235184 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31893db-a53f-4b27-b171-a613e185329e None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:23.235452 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31893db-a53f-4b27-b171-a613e185329e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:23.236306 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31893db-a53f-4b27-b171-a613e185329e None admin] RBAC: Adding query filter params (role.id=8b8940c737364011a624755f642bf504, user.id=6a70950669cd4b5b8e84318852629369, scope.system=all) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:13:23.236617 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31893db-a53f-4b27-b171-a613e185329e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:13:23.238131 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31893db-a53f-4b27-b171-a613e185329e None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:13:23.264812 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948f88c9-d72c-41a6-9b1e-7f41634daea8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:23.265318 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948f88c9-d72c-41a6-9b1e-7f41634daea8 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:23.265600 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948f88c9-d72c-41a6-9b1e-7f41634daea8 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:23.265871 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948f88c9-d72c-41a6-9b1e-7f41634daea8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:23.266822 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948f88c9-d72c-41a6-9b1e-7f41634daea8 None admin] RBAC: Adding query filter params (group.id=f52e88ae0f3e4e4c89d3258aea3be7d0, role.id=e24b3707bc514b1fa606efab092047e6, scope.project.id=1adc255cfb4744c1b467603311c319e7) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:13:23.267199 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948f88c9-d72c-41a6-9b1e-7f41634daea8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:13:23.268731 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948f88c9-d72c-41a6-9b1e-7f41634daea8 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:13:23.271043 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:13:23.273615 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 187/375] 10.222.0.44 () {56 vars in 1308 bytes} [Thu Jun 16 12:13:23 2022] GET /identity/v3/role_assignments?user.id=6a70950669cd4b5b8e84318852629369&scope.system=all&role.id=8b8940c737364011a624755f642bf504 => generated 510 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:13:23.274622 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31893db-a53f-4b27-b171-a613e185329e None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:23.277265 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 189/376] 10.222.0.44 () {56 vars in 1376 bytes} [Thu Jun 16 12:13:23 2022] GET /identity/v3/role_assignments?group.id=f52e88ae0f3e4e4c89d3258aea3be7d0&scope.project.id=1adc255cfb4744c1b467603311c319e7&role.id=e24b3707bc514b1fa606efab092047e6 => generated 260 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:13:23.282518 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98c1ee9-903b-49b9-abc3-4fc979f82a67 None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:23.282804 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98c1ee9-903b-49b9-abc3-4fc979f82a67 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:23.283081 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98c1ee9-903b-49b9-abc3-4fc979f82a67 None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:23.285194 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 190/377] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 12:13:23 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 12:13:23.290588 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55529645-1038-470d-9b4e-4d9886f36f6a None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:23.290864 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55529645-1038-470d-9b4e-4d9886f36f6a None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:23.291144 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55529645-1038-470d-9b4e-4d9886f36f6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:23.321122 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-55529645-1038-470d-9b4e-4d9886f36f6a None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:13:23.322377 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-55529645-1038-470d-9b4e-4d9886f36f6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:13:23.487668 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 191/378] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 12:13:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 12:13:23.489269 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31893db-a53f-4b27-b171-a613e185329e None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:23.529378 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:13:23.554437 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa5ed6d-71be-43b3-a34c-fd4be3e04820 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:23.555099 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa5ed6d-71be-43b3-a34c-fd4be3e04820 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:23.555381 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa5ed6d-71be-43b3-a34c-fd4be3e04820 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:23.555653 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa5ed6d-71be-43b3-a34c-fd4be3e04820 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:23.571690 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55529645-1038-470d-9b4e-4d9886f36f6a None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:23.705674 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa5ed6d-71be-43b3-a34c-fd4be3e04820 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:13:23.707754 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa5ed6d-71be-43b3-a34c-fd4be3e04820 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:13:23.744181 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55529645-1038-470d-9b4e-4d9886f36f6a None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:23.776396 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:13:23.792967 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedb3044-98b5-46c4-9921-4a86fa0b2582 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:23.794569 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedb3044-98b5-46c4-9921-4a86fa0b2582 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:23.795847 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedb3044-98b5-46c4-9921-4a86fa0b2582 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:23.796342 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedb3044-98b5-46c4-9921-4a86fa0b2582 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:23.809841 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bedb3044-98b5-46c4-9921-4a86fa0b2582 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 12:13:23.820647 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-bedb3044-98b5-46c4-9921-4a86fa0b2582 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 16 12:13:23.820647 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 12:13:23.820647 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 12:13:23.820647 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 12:13:23.820647 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 12:13:23.820647 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 12:13:23.820647 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 12:13:23.820647 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 12:13:23.820647 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 12:13:23.820647 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 12:13:23.820647 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 12:13:23.820647 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 12:13:23.820647 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 12:13:23.820647 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 12:13:23.820647 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 12:13:23.820647 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 12:13:23.821577 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 12:13:23.821577 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 12:13:23.821577 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 12:13:23.821577 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 12:13:23.821577 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 12:13:23.821577 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 12:13:23.821577 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 12:13:23.821577 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 12:13:23.821577 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 12:13:23.821577 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 12:13:23.821577 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 12:13:23.821577 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jun 16 12:13:23.821577 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 12:13:23.821577 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jun 16 12:13:23.821577 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 12:13:23.821577 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 12:13:23.822368 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 12:13:23.822368 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jun 16 12:13:23.822368 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 12:13:23.822368 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jun 16 12:13:23.822368 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 12:13:23.822368 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 12:13:23.822368 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 12:13:23.822368 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 12:13:23.822368 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 12:13:23.822368 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 12:13:23.822368 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 16 12:13:23.822368 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jun 16 12:13:23.825448 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 192/379] 10.222.0.44 () {56 vars in 1099 bytes} [Thu Jun 16 12:13:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 12:13:23.830981 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedb3044-98b5-46c4-9921-4a86fa0b2582 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:23.937079 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 188/380] 10.222.0.44 () {58 vars in 1282 bytes} [Thu Jun 16 12:13:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 663 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 12:13:23.940499 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa5ed6d-71be-43b3-a34c-fd4be3e04820 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:23.987963 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:13:23.996609 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedb3044-98b5-46c4-9921-4a86fa0b2582 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:24.037068 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb84c9f-c746-4e5c-b4e8-e4b4b392194a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:24.038153 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb84c9f-c746-4e5c-b4e8-e4b4b392194a None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:24.039142 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb84c9f-c746-4e5c-b4e8-e4b4b392194a None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:24.039640 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb84c9f-c746-4e5c-b4e8-e4b4b392194a None admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:24.040594 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb84c9f-c746-4e5c-b4e8-e4b4b392194a None admin] RBAC: Adding query filter params (name=member) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:13:24.041123 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb84c9f-c746-4e5c-b4e8-e4b4b392194a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:13:24.043173 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb84c9f-c746-4e5c-b4e8-e4b4b392194a None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:13:24.053543 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 193/381] 10.222.0.44 () {56 vars in 1101 bytes} [Thu Jun 16 12:13:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:13:24.059006 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb84c9f-c746-4e5c-b4e8-e4b4b392194a None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:24.115578 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:13:24.178879 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb84c9f-c746-4e5c-b4e8-e4b4b392194a None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:24.201916 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa5ed6d-71be-43b3-a34c-fd4be3e04820 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:24.234556 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7694ea2-207d-41dd-ac4d-28400643adb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:24.235428 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7694ea2-207d-41dd-ac4d-28400643adb2 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:24.235711 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7694ea2-207d-41dd-ac4d-28400643adb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:24.235987 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7694ea2-207d-41dd-ac4d-28400643adb2 None admin] PATH_INFO: `/v3/groups/f52e88ae0f3e4e4c89d3258aea3be7d0` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:24.237226 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7694ea2-207d-41dd-ac4d-28400643adb2 None admin] RBAC: Authorizing `identity:get_group(group_id=f52e88ae0f3e4e4c89d3258aea3be7d0)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:13:24.238706 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7694ea2-207d-41dd-ac4d-28400643adb2 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:13:24.240334 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 194/382] 10.222.0.44 () {56 vars in 1180 bytes} [Thu Jun 16 12:13:24 2022] GET /identity/v3/groups/f52e88ae0f3e4e4c89d3258aea3be7d0 => generated 226 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:13:24.250641 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7694ea2-207d-41dd-ac4d-28400643adb2 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:24.274108 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcfb771-aa4b-4aac-826d-68940f57f0a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:24.274982 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcfb771-aa4b-4aac-826d-68940f57f0a4 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:24.275259 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcfb771-aa4b-4aac-826d-68940f57f0a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:24.275528 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcfb771-aa4b-4aac-826d-68940f57f0a4 None admin] PATH_INFO: `/v3/projects/487834c5a8184e199d372be1da9a9d39` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:24.276968 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcfb771-aa4b-4aac-826d-68940f57f0a4 None admin] RBAC: Authorizing `identity:get_project(project_id=487834c5a8184e199d372be1da9a9d39)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:13:24.278410 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcfb771-aa4b-4aac-826d-68940f57f0a4 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:13:24.280312 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 189/383] 10.222.0.44 () {56 vars in 1186 bytes} [Thu Jun 16 12:13:23 2022] GET /identity/v3/projects/487834c5a8184e199d372be1da9a9d39 => generated 344 bytes in 340 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 12:13:24.286303 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcfb771-aa4b-4aac-826d-68940f57f0a4 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:24.425034 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:13:24.431656 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7694ea2-207d-41dd-ac4d-28400643adb2 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:24.449887 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcfb771-aa4b-4aac-826d-68940f57f0a4 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:24.451352 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:13:24.486312 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93fc707-d419-44df-a60c-fb3375b0d017 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:24.487506 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93fc707-d419-44df-a60c-fb3375b0d017 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:24.488021 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93fc707-d419-44df-a60c-fb3375b0d017 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:24.489059 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93fc707-d419-44df-a60c-fb3375b0d017 None admin] PATH_INFO: `/v3/projects/02e13d55192e4bfc8385150aa7249e83` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:24.491661 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93fc707-d419-44df-a60c-fb3375b0d017 None admin] RBAC: Authorizing `identity:get_project(project_id=02e13d55192e4bfc8385150aa7249e83)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:13:24.493577 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93fc707-d419-44df-a60c-fb3375b0d017 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:13:24.495821 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 195/384] 10.222.0.44 () {56 vars in 1186 bytes} [Thu Jun 16 12:13:24 2022] GET /identity/v3/projects/02e13d55192e4bfc8385150aa7249e83 => generated 298 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:13:24.501482 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93fc707-d419-44df-a60c-fb3375b0d017 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:24.523503 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c5496a-7ad9-4996-a7ea-d5af363ae019 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:24.524371 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c5496a-7ad9-4996-a7ea-d5af363ae019 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:24.524653 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c5496a-7ad9-4996-a7ea-d5af363ae019 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:24.524956 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c5496a-7ad9-4996-a7ea-d5af363ae019 None admin] PATH_INFO: `/v3/groups/4c0cdedf5fe4473cb82a244e0eabb122` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:24.537168 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c5496a-7ad9-4996-a7ea-d5af363ae019 None admin] RBAC: Authorizing `identity:get_group(group_id=4c0cdedf5fe4473cb82a244e0eabb122)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:13:24.538662 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c5496a-7ad9-4996-a7ea-d5af363ae019 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:13:24.550266 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 190/385] 10.222.0.44 () {56 vars in 1180 bytes} [Thu Jun 16 12:13:24 2022] GET /identity/v3/groups/4c0cdedf5fe4473cb82a244e0eabb122 => generated 229 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:13:24.562960 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c5496a-7ad9-4996-a7ea-d5af363ae019 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:24.642855 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93fc707-d419-44df-a60c-fb3375b0d017 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:24.683919 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee798933-c02a-4ac3-9c67-02c48e768896 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:24.685090 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee798933-c02a-4ac3-9c67-02c48e768896 None admin] REQUEST_METHOD: `PUT` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:24.686484 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee798933-c02a-4ac3-9c67-02c48e768896 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:24.686932 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee798933-c02a-4ac3-9c67-02c48e768896 None admin] PATH_INFO: `/v3/projects/02e13d55192e4bfc8385150aa7249e83/groups/f52e88ae0f3e4e4c89d3258aea3be7d0/roles/c39882b202e942479a7cdac2fc6da72c` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:24.691692 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee798933-c02a-4ac3-9c67-02c48e768896 None admin] RBAC: Authorizing `identity:create_grant(project_id=02e13d55192e4bfc8385150aa7249e83, group_id=f52e88ae0f3e4e4c89d3258aea3be7d0, role_id=c39882b202e942479a7cdac2fc6da72c)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:13:24.694214 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee798933-c02a-4ac3-9c67-02c48e768896 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:13:24.716727 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 196/386] 10.222.0.44 () {58 vars in 1442 bytes} [Thu Jun 16 12:13:24 2022] PUT /identity/v3/projects/02e13d55192e4bfc8385150aa7249e83/groups/f52e88ae0f3e4e4c89d3258aea3be7d0/roles/c39882b202e942479a7cdac2fc6da72c => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:13:24.784461 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c5496a-7ad9-4996-a7ea-d5af363ae019 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:24.837680 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c77bc8-07a0-4ecd-b3d6-1bac77018c18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:24.838373 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c77bc8-07a0-4ecd-b3d6-1bac77018c18 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:24.838658 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c77bc8-07a0-4ecd-b3d6-1bac77018c18 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:24.838934 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c77bc8-07a0-4ecd-b3d6-1bac77018c18 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:24.839818 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c77bc8-07a0-4ecd-b3d6-1bac77018c18 None admin] RBAC: Adding query filter params (group.id=4c0cdedf5fe4473cb82a244e0eabb122, role.id=0688968254744e3f9913653cafea3091, scope.project.id=487834c5a8184e199d372be1da9a9d39) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:13:24.840132 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c77bc8-07a0-4ecd-b3d6-1bac77018c18 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:13:24.841767 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c77bc8-07a0-4ecd-b3d6-1bac77018c18 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:13:24.848554 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 191/387] 10.222.0.44 () {56 vars in 1376 bytes} [Thu Jun 16 12:13:24 2022] GET /identity/v3/role_assignments?group.id=4c0cdedf5fe4473cb82a244e0eabb122&scope.project.id=487834c5a8184e199d372be1da9a9d39&role.id=0688968254744e3f9913653cafea3091 => generated 260 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:13:24.912826 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c184b6a-cf9d-4724-ac96-dd49eb09c570 None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:24.912826 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c184b6a-cf9d-4724-ac96-dd49eb09c570 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:24.912826 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c184b6a-cf9d-4724-ac96-dd49eb09c570 None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:24.914053 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 197/388] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 12:13:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 12:13:24.924715 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398bb302-63eb-48cc-9332-dce46a3853f6 None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:24.925034 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398bb302-63eb-48cc-9332-dce46a3853f6 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:24.925312 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398bb302-63eb-48cc-9332-dce46a3853f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:24.951629 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-398bb302-63eb-48cc-9332-dce46a3853f6 None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:13:24.953266 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-398bb302-63eb-48cc-9332-dce46a3853f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:13:24.966900 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:13:25.042811 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 192/389] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 12:13:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 12:13:25.061558 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c184b6a-cf9d-4724-ac96-dd49eb09c570 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:25.110782 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:13:25.171241 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c184b6a-cf9d-4724-ac96-dd49eb09c570 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:25.205756 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9f5019-d6b4-43e8-9e5e-21cfab10e734 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:25.206624 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9f5019-d6b4-43e8-9e5e-21cfab10e734 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:25.206935 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9f5019-d6b4-43e8-9e5e-21cfab10e734 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:25.207209 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9f5019-d6b4-43e8-9e5e-21cfab10e734 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:25.218373 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9f5019-d6b4-43e8-9e5e-21cfab10e734 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 12:13:25.226868 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-9b9f5019-d6b4-43e8-9e5e-21cfab10e734 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 12:13:25.226868 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 12:13:25.226868 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 12:13:25.226868 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 12:13:25.226868 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 12:13:25.226868 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 12:13:25.226868 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 12:13:25.226868 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 12:13:25.226868 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 12:13:25.226868 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 12:13:25.226868 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 12:13:25.226868 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 12:13:25.226868 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 12:13:25.226868 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 12:13:25.226868 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 12:13:25.226868 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 12:13:25.227731 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 12:13:25.227731 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 12:13:25.227731 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 12:13:25.227731 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 12:13:25.227731 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 12:13:25.227731 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 12:13:25.227731 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 12:13:25.227731 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 12:13:25.227731 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 12:13:25.227731 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 12:13:25.227731 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 12:13:25.227731 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jun 16 12:13:25.227731 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 12:13:25.227731 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jun 16 12:13:25.227731 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 12:13:25.227731 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 12:13:25.228516 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 12:13:25.228516 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jun 16 12:13:25.228516 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 12:13:25.228516 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jun 16 12:13:25.228516 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 12:13:25.228516 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 12:13:25.228516 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 12:13:25.228516 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 12:13:25.228516 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 12:13:25.228516 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 12:13:25.228516 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 12:13:25.228516 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jun 16 12:13:25.232357 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 198/390] 10.222.0.44 () {56 vars in 1114 bytes} [Thu Jun 16 12:13:25 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 12:13:25.234450 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398bb302-63eb-48cc-9332-dce46a3853f6 None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:25.338866 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398bb302-63eb-48cc-9332-dce46a3853f6 None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:25.380474 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7b07de-8558-4e4d-a420-a944becfb201 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:25.381224 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7b07de-8558-4e4d-a420-a944becfb201 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:25.381503 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7b07de-8558-4e4d-a420-a944becfb201 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:25.382435 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7b07de-8558-4e4d-a420-a944becfb201 None admin] PATH_INFO: `/v3/roles` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:25.383193 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7b07de-8558-4e4d-a420-a944becfb201 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:13:25.383494 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7b07de-8558-4e4d-a420-a944becfb201 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:13:25.384980 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7b07de-8558-4e4d-a420-a944becfb201 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:13:25.398368 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 193/391] 10.222.0.44 () {56 vars in 1111 bytes} [Thu Jun 16 12:13:25 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:13:25.399803 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9f5019-d6b4-43e8-9e5e-21cfab10e734 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:25.512934 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9f5019-d6b4-43e8-9e5e-21cfab10e734 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:25.514495 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:13:25.549449 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461942c8-39e4-401a-861f-1511f3eea907 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:25.550300 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461942c8-39e4-401a-861f-1511f3eea907 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:25.550578 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461942c8-39e4-401a-861f-1511f3eea907 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:25.550905 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461942c8-39e4-401a-861f-1511f3eea907 None admin] PATH_INFO: `/v3/groups/f52e88ae0f3e4e4c89d3258aea3be7d0` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:25.552126 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461942c8-39e4-401a-861f-1511f3eea907 None admin] RBAC: Authorizing `identity:get_group(group_id=f52e88ae0f3e4e4c89d3258aea3be7d0)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:13:25.554115 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461942c8-39e4-401a-861f-1511f3eea907 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:13:25.560214 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 199/392] 10.222.0.44 () {56 vars in 1180 bytes} [Thu Jun 16 12:13:25 2022] GET /identity/v3/groups/f52e88ae0f3e4e4c89d3258aea3be7d0 => generated 226 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:13:25.561597 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7b07de-8558-4e4d-a420-a944becfb201 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:25.581126 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:13:25.670031 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7b07de-8558-4e4d-a420-a944becfb201 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:25.708270 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b443a0b7-b9e0-4c4a-80a3-eb64a30253bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:25.709523 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b443a0b7-b9e0-4c4a-80a3-eb64a30253bc None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:25.709800 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b443a0b7-b9e0-4c4a-80a3-eb64a30253bc None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:25.710096 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b443a0b7-b9e0-4c4a-80a3-eb64a30253bc None admin] PATH_INFO: `/v3/projects/02e13d55192e4bfc8385150aa7249e83` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:25.711364 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b443a0b7-b9e0-4c4a-80a3-eb64a30253bc None admin] RBAC: Authorizing `identity:get_project(project_id=02e13d55192e4bfc8385150aa7249e83)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:13:25.712815 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b443a0b7-b9e0-4c4a-80a3-eb64a30253bc None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:13:25.719196 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 194/393] 10.222.0.44 () {56 vars in 1186 bytes} [Thu Jun 16 12:13:25 2022] GET /identity/v3/projects/02e13d55192e4bfc8385150aa7249e83 => generated 298 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:13:25.720577 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461942c8-39e4-401a-861f-1511f3eea907 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:25.823888 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461942c8-39e4-401a-861f-1511f3eea907 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:25.857883 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aca926e-5f23-4c7f-b552-2b8821053fa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:25.858772 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aca926e-5f23-4c7f-b552-2b8821053fa0 None admin] REQUEST_METHOD: `PUT` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:25.859048 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aca926e-5f23-4c7f-b552-2b8821053fa0 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:25.859317 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aca926e-5f23-4c7f-b552-2b8821053fa0 None admin] PATH_INFO: `/v3/projects/02e13d55192e4bfc8385150aa7249e83/groups/f52e88ae0f3e4e4c89d3258aea3be7d0/roles/e24b3707bc514b1fa606efab092047e6` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:25.861596 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aca926e-5f23-4c7f-b552-2b8821053fa0 None admin] RBAC: Authorizing `identity:create_grant(project_id=02e13d55192e4bfc8385150aa7249e83, group_id=f52e88ae0f3e4e4c89d3258aea3be7d0, role_id=e24b3707bc514b1fa606efab092047e6)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:13:25.863193 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aca926e-5f23-4c7f-b552-2b8821053fa0 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:13:25.880708 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 200/394] 10.222.0.44 () {58 vars in 1442 bytes} [Thu Jun 16 12:13:25 2022] PUT /identity/v3/projects/02e13d55192e4bfc8385150aa7249e83/groups/f52e88ae0f3e4e4c89d3258aea3be7d0/roles/e24b3707bc514b1fa606efab092047e6 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:13:26.019172 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd7cbac-022f-4b7a-8ab7-c41d3735ed21 None None] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:26.019699 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd7cbac-022f-4b7a-8ab7-c41d3735ed21 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:26.020176 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd7cbac-022f-4b7a-8ab7-c41d3735ed21 None None] PATH_INFO: `/` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:26.022103 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 195/395] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 12:13:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 12:13:26.028443 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c48fbf-c883-4079-ae59-376facd656ad None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:26.029043 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c48fbf-c883-4079-ae59-376facd656ad None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:26.029531 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c48fbf-c883-4079-ae59-376facd656ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:26.049128 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-d7c48fbf-c883-4079-ae59-376facd656ad None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:13:26.050709 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-d7c48fbf-c883-4079-ae59-376facd656ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:13:26.077607 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:13:26.129662 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 201/396] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 12:13:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 12:13:26.152649 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd7cbac-022f-4b7a-8ab7-c41d3735ed21 None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:26.237267 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:13:26.261323 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd7cbac-022f-4b7a-8ab7-c41d3735ed21 None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:26.296410 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7567e6c6-2d9a-4423-9a96-1b290a6886c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:26.297246 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7567e6c6-2d9a-4423-9a96-1b290a6886c8 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:26.297841 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7567e6c6-2d9a-4423-9a96-1b290a6886c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:26.298116 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7567e6c6-2d9a-4423-9a96-1b290a6886c8 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:26.309061 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7567e6c6-2d9a-4423-9a96-1b290a6886c8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 12:13:26.317597 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application [None req-7567e6c6-2d9a-4423-9a96-1b290a6886c8 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 12:13:26.317597 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 12:13:26.317597 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 12:13:26.317597 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 12:13:26.317597 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 12:13:26.317597 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 12:13:26.317597 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 12:13:26.317597 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 12:13:26.317597 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 12:13:26.317597 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 12:13:26.317597 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 12:13:26.317597 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 12:13:26.317597 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 12:13:26.317597 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 12:13:26.317597 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 12:13:26.317597 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 12:13:26.318487 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 12:13:26.318487 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 12:13:26.318487 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 12:13:26.318487 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 12:13:26.318487 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 12:13:26.318487 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 12:13:26.318487 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 12:13:26.318487 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 12:13:26.318487 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 12:13:26.318487 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 12:13:26.318487 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 12:13:26.318487 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application with Lock( Jun 16 12:13:26.318487 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 12:13:26.318487 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._enter() Jun 16 12:13:26.318487 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 12:13:26.318487 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 12:13:26.319331 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 12:13:26.319331 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.creator() Jun 16 12:13:26.319331 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 12:13:26.319331 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application created_value = creator( Jun 16 12:13:26.319331 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 12:13:26.319331 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 12:13:26.319331 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 12:13:26.319331 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 12:13:26.319331 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 12:13:26.319331 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 12:13:26.319331 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 12:13:26.319331 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application Jun 16 12:13:26.322441 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 196/397] 10.222.0.44 () {56 vars in 1114 bytes} [Thu Jun 16 12:13:26 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 12:13:26.325854 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c48fbf-c883-4079-ae59-376facd656ad None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:26.408844 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d927f18-93f2-4932-be19-741480cc6fce None None] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:26.409117 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d927f18-93f2-4932-be19-741480cc6fce None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:26.409642 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d927f18-93f2-4932-be19-741480cc6fce None None] PATH_INFO: `/` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:26.411132 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 197/398] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 12:13:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 12:13:26.417132 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2faf260-ade6-4fd9-8ba7-64cc0be6c2e7 None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:26.417665 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2faf260-ade6-4fd9-8ba7-64cc0be6c2e7 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:26.418139 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2faf260-ade6-4fd9-8ba7-64cc0be6c2e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:26.454272 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c48fbf-c883-4079-ae59-376facd656ad None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:26.461749 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-e2faf260-ade6-4fd9-8ba7-64cc0be6c2e7 None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:13:26.463064 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-e2faf260-ade6-4fd9-8ba7-64cc0be6c2e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:13:26.494327 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8411a5ce-7576-4127-90c0-85c5bbb17ab3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:26.495353 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8411a5ce-7576-4127-90c0-85c5bbb17ab3 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:26.496555 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8411a5ce-7576-4127-90c0-85c5bbb17ab3 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:26.497168 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8411a5ce-7576-4127-90c0-85c5bbb17ab3 None admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:26.498908 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8411a5ce-7576-4127-90c0-85c5bbb17ab3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:13:26.499796 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8411a5ce-7576-4127-90c0-85c5bbb17ab3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:13:26.502099 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8411a5ce-7576-4127-90c0-85c5bbb17ab3 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:13:26.518644 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 202/399] 10.222.0.44 () {56 vars in 1111 bytes} [Thu Jun 16 12:13:26 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:13:26.525586 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8411a5ce-7576-4127-90c0-85c5bbb17ab3 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:26.569083 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:13:26.607280 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 198/400] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 12:13:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 12:13:26.661391 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2faf260-ade6-4fd9-8ba7-64cc0be6c2e7 None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:26.673011 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8411a5ce-7576-4127-90c0-85c5bbb17ab3 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:26.716092 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf705cf-0655-41e3-b0a2-9e1bbdbc81d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:26.717359 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf705cf-0655-41e3-b0a2-9e1bbdbc81d7 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:26.717775 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf705cf-0655-41e3-b0a2-9e1bbdbc81d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:26.718185 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf705cf-0655-41e3-b0a2-9e1bbdbc81d7 None admin] PATH_INFO: `/v3/groups/f52e88ae0f3e4e4c89d3258aea3be7d0` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:26.719525 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf705cf-0655-41e3-b0a2-9e1bbdbc81d7 None admin] RBAC: Authorizing `identity:get_group(group_id=f52e88ae0f3e4e4c89d3258aea3be7d0)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:13:26.721311 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf705cf-0655-41e3-b0a2-9e1bbdbc81d7 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:13:26.723446 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 203/401] 10.222.0.44 () {56 vars in 1180 bytes} [Thu Jun 16 12:13:26 2022] GET /identity/v3/groups/f52e88ae0f3e4e4c89d3258aea3be7d0 => generated 226 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 12:13:26.730736 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf705cf-0655-41e3-b0a2-9e1bbdbc81d7 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:26.812018 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:13:26.854996 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:13:26.867945 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf705cf-0655-41e3-b0a2-9e1bbdbc81d7 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:26.890295 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2faf260-ade6-4fd9-8ba7-64cc0be6c2e7 None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:26.907559 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a030097e-2a35-43ea-a2e1-ccf1855d0b95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:26.908729 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a030097e-2a35-43ea-a2e1-ccf1855d0b95 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:26.909248 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a030097e-2a35-43ea-a2e1-ccf1855d0b95 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:26.909735 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a030097e-2a35-43ea-a2e1-ccf1855d0b95 None admin] PATH_INFO: `/v3/projects/1adc255cfb4744c1b467603311c319e7` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:26.911133 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a030097e-2a35-43ea-a2e1-ccf1855d0b95 None admin] RBAC: Authorizing `identity:get_project(project_id=1adc255cfb4744c1b467603311c319e7)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:13:26.912808 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a030097e-2a35-43ea-a2e1-ccf1855d0b95 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:13:26.920127 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 204/402] 10.222.0.44 () {56 vars in 1186 bytes} [Thu Jun 16 12:13:26 2022] GET /identity/v3/projects/1adc255cfb4744c1b467603311c319e7 => generated 302 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:13:26.924603 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a030097e-2a35-43ea-a2e1-ccf1855d0b95 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:26.984167 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa29739-8fd9-4f28-9f24-9806d2a63a67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:26.985082 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa29739-8fd9-4f28-9f24-9806d2a63a67 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:26.985364 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa29739-8fd9-4f28-9f24-9806d2a63a67 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:26.985634 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa29739-8fd9-4f28-9f24-9806d2a63a67 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:27.005691 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa29739-8fd9-4f28-9f24-9806d2a63a67 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 12:13:27.022034 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application [None req-1aa29739-8fd9-4f28-9f24-9806d2a63a67 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 16 12:13:27.022034 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 12:13:27.022034 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 12:13:27.022034 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 12:13:27.022034 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 12:13:27.022034 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 12:13:27.022034 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 12:13:27.022034 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 12:13:27.022034 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 12:13:27.022034 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 12:13:27.022034 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 12:13:27.022034 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 12:13:27.022034 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 12:13:27.022034 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 12:13:27.022034 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 12:13:27.022034 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 12:13:27.023021 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 12:13:27.023021 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 12:13:27.023021 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 12:13:27.023021 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 12:13:27.023021 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 12:13:27.023021 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 12:13:27.023021 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 12:13:27.023021 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 12:13:27.023021 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 12:13:27.023021 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 12:13:27.023021 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 12:13:27.023021 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application with Lock( Jun 16 12:13:27.023021 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 12:13:27.023021 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._enter() Jun 16 12:13:27.023021 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 12:13:27.023021 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 12:13:27.024209 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 12:13:27.024209 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.creator() Jun 16 12:13:27.024209 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 12:13:27.024209 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application created_value = creator( Jun 16 12:13:27.024209 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 12:13:27.024209 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 12:13:27.024209 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 12:13:27.024209 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 12:13:27.024209 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 12:13:27.024209 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 12:13:27.024209 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 16 12:13:27.024209 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application Jun 16 12:13:27.024209 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 199/403] 10.222.0.44 () {56 vars in 1099 bytes} [Thu Jun 16 12:13:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 363 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 12:13:27.030463 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa29739-8fd9-4f28-9f24-9806d2a63a67 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:27.044529 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a030097e-2a35-43ea-a2e1-ccf1855d0b95 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:27.101572 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584930b3-9229-43b7-a8a4-8a16893cb81c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:27.102376 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584930b3-9229-43b7-a8a4-8a16893cb81c None admin] REQUEST_METHOD: `PUT` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:27.102653 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584930b3-9229-43b7-a8a4-8a16893cb81c None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:27.102925 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584930b3-9229-43b7-a8a4-8a16893cb81c None admin] PATH_INFO: `/v3/projects/1adc255cfb4744c1b467603311c319e7/groups/f52e88ae0f3e4e4c89d3258aea3be7d0/roles/e24b3707bc514b1fa606efab092047e6` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:27.106745 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584930b3-9229-43b7-a8a4-8a16893cb81c None admin] RBAC: Authorizing `identity:create_grant(project_id=1adc255cfb4744c1b467603311c319e7, group_id=f52e88ae0f3e4e4c89d3258aea3be7d0, role_id=e24b3707bc514b1fa606efab092047e6)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:13:27.108195 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584930b3-9229-43b7-a8a4-8a16893cb81c None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:13:27.139588 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 205/404] 10.222.0.44 () {58 vars in 1442 bytes} [Thu Jun 16 12:13:26 2022] PUT /identity/v3/projects/1adc255cfb4744c1b467603311c319e7/groups/f52e88ae0f3e4e4c89d3258aea3be7d0/roles/e24b3707bc514b1fa606efab092047e6 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 12:13:27.175966 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa29739-8fd9-4f28-9f24-9806d2a63a67 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:27.204303 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:13:27.213158 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f066442-62ea-4299-bb47-8a56818e3fb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:27.213851 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f066442-62ea-4299-bb47-8a56818e3fb7 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:27.214135 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f066442-62ea-4299-bb47-8a56818e3fb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:27.214453 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f066442-62ea-4299-bb47-8a56818e3fb7 None admin] PATH_INFO: `/v3/roles` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:27.215183 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f066442-62ea-4299-bb47-8a56818e3fb7 None admin] RBAC: Adding query filter params (name=member) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:13:27.215494 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f066442-62ea-4299-bb47-8a56818e3fb7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:13:27.216935 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f066442-62ea-4299-bb47-8a56818e3fb7 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:13:27.227344 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 200/405] 10.222.0.44 () {56 vars in 1101 bytes} [Thu Jun 16 12:13:27 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:13:27.237959 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584930b3-9229-43b7-a8a4-8a16893cb81c None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:27.270444 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:13:27.391336 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584930b3-9229-43b7-a8a4-8a16893cb81c None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:27.431816 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104a9094-865b-4d43-8b4d-3d22905aefc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:27.432681 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104a9094-865b-4d43-8b4d-3d22905aefc2 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:27.432997 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104a9094-865b-4d43-8b4d-3d22905aefc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:27.433274 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104a9094-865b-4d43-8b4d-3d22905aefc2 None admin] PATH_INFO: `/v3/groups/f52e88ae0f3e4e4c89d3258aea3be7d0` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:27.434497 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104a9094-865b-4d43-8b4d-3d22905aefc2 None admin] RBAC: Authorizing `identity:get_group(group_id=f52e88ae0f3e4e4c89d3258aea3be7d0)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:13:27.435965 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104a9094-865b-4d43-8b4d-3d22905aefc2 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:13:27.437930 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 206/406] 10.222.0.44 () {56 vars in 1180 bytes} [Thu Jun 16 12:13:27 2022] GET /identity/v3/groups/f52e88ae0f3e4e4c89d3258aea3be7d0 => generated 226 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:13:27.443026 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f066442-62ea-4299-bb47-8a56818e3fb7 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:27.459486 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9611bdfa-78c0-4673-ba29-fd4c15fb8a44 None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:27.460555 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9611bdfa-78c0-4673-ba29-fd4c15fb8a44 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:27.461067 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9611bdfa-78c0-4673-ba29-fd4c15fb8a44 None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:27.462699 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 207/407] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 12:13:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 12:13:27.469737 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da54283d-cdc0-48b2-aafc-fd58fb0c4391 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:27.470242 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da54283d-cdc0-48b2-aafc-fd58fb0c4391 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:27.470712 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da54283d-cdc0-48b2-aafc-fd58fb0c4391 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:27.495349 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-da54283d-cdc0-48b2-aafc-fd58fb0c4391 None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:13:27.496846 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-da54283d-cdc0-48b2-aafc-fd58fb0c4391 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:13:27.608332 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f066442-62ea-4299-bb47-8a56818e3fb7 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:27.638563 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 208/408] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 12:13:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 12:13:27.660350 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128e1c6a-c690-4881-bd1d-d5d5132269b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:27.661485 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128e1c6a-c690-4881-bd1d-d5d5132269b0 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:27.661969 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128e1c6a-c690-4881-bd1d-d5d5132269b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:27.662418 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128e1c6a-c690-4881-bd1d-d5d5132269b0 None admin] PATH_INFO: `/v3/projects/1adc255cfb4744c1b467603311c319e7` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:27.667646 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128e1c6a-c690-4881-bd1d-d5d5132269b0 None admin] RBAC: Authorizing `identity:get_project(project_id=1adc255cfb4744c1b467603311c319e7)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:13:27.669597 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128e1c6a-c690-4881-bd1d-d5d5132269b0 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:13:27.671861 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 201/409] 10.222.0.44 () {56 vars in 1186 bytes} [Thu Jun 16 12:13:27 2022] GET /identity/v3/projects/1adc255cfb4744c1b467603311c319e7 => generated 302 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:13:27.674901 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da54283d-cdc0-48b2-aafc-fd58fb0c4391 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:27.677939 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128e1c6a-c690-4881-bd1d-d5d5132269b0 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:27.713028 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:13:27.805789 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:13:27.812315 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da54283d-cdc0-48b2-aafc-fd58fb0c4391 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:27.854042 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b71f56-45b1-45fa-9861-27eb3dda1fa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:27.855175 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b71f56-45b1-45fa-9861-27eb3dda1fa2 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:27.855637 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b71f56-45b1-45fa-9861-27eb3dda1fa2 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:27.856090 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b71f56-45b1-45fa-9861-27eb3dda1fa2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:27.879774 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b71f56-45b1-45fa-9861-27eb3dda1fa2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 12:13:27.890088 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-05b71f56-45b1-45fa-9861-27eb3dda1fa2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 16 12:13:27.890088 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 12:13:27.890088 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 12:13:27.890088 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 12:13:27.890088 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 12:13:27.890088 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 12:13:27.890088 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 12:13:27.890088 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 12:13:27.890088 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 12:13:27.890088 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 12:13:27.890088 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 12:13:27.890088 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 12:13:27.890088 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 12:13:27.890088 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 12:13:27.890088 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 12:13:27.890088 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 12:13:27.891049 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 12:13:27.891049 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 12:13:27.891049 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 12:13:27.891049 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 12:13:27.891049 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 12:13:27.891049 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 12:13:27.891049 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 12:13:27.891049 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 12:13:27.891049 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 12:13:27.891049 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 12:13:27.891049 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 12:13:27.891049 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jun 16 12:13:27.891049 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 12:13:27.891049 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jun 16 12:13:27.891049 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 12:13:27.891049 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 12:13:27.891830 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 12:13:27.891830 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jun 16 12:13:27.891830 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 12:13:27.891830 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jun 16 12:13:27.891830 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 12:13:27.891830 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 12:13:27.891830 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 12:13:27.891830 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 12:13:27.891830 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 12:13:27.891830 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 12:13:27.891830 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 16 12:13:27.891830 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jun 16 12:13:27.894165 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 209/410] 10.222.0.44 () {56 vars in 1099 bytes} [Thu Jun 16 12:13:27 2022] GET /identity/v3/roles/member => generated 84 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 12:13:27.901305 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b71f56-45b1-45fa-9861-27eb3dda1fa2 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:27.906924 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128e1c6a-c690-4881-bd1d-d5d5132269b0 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:27.969032 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99dcbea0-c41d-4dd7-b15e-91113aced8cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:27.970098 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dcbea0-c41d-4dd7-b15e-91113aced8cc None admin] REQUEST_METHOD: `PUT` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:27.970481 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dcbea0-c41d-4dd7-b15e-91113aced8cc None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:27.970850 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dcbea0-c41d-4dd7-b15e-91113aced8cc None admin] PATH_INFO: `/v3/projects/1adc255cfb4744c1b467603311c319e7/groups/f52e88ae0f3e4e4c89d3258aea3be7d0/roles/c39882b202e942479a7cdac2fc6da72c` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:27.972944 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99dcbea0-c41d-4dd7-b15e-91113aced8cc None admin] RBAC: Authorizing `identity:create_grant(project_id=1adc255cfb4744c1b467603311c319e7, group_id=f52e88ae0f3e4e4c89d3258aea3be7d0, role_id=c39882b202e942479a7cdac2fc6da72c)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:13:27.974482 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99dcbea0-c41d-4dd7-b15e-91113aced8cc None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:13:27.991300 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 202/411] 10.222.0.44 () {58 vars in 1442 bytes} [Thu Jun 16 12:13:27 2022] PUT /identity/v3/projects/1adc255cfb4744c1b467603311c319e7/groups/f52e88ae0f3e4e4c89d3258aea3be7d0/roles/c39882b202e942479a7cdac2fc6da72c => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:13:27.992858 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baae422-743c-441b-9a57-853a49acda60 None None] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:27.993247 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baae422-743c-441b-9a57-853a49acda60 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:27.993674 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baae422-743c-441b-9a57-853a49acda60 None None] PATH_INFO: `/` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:27.995246 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 203/412] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 12:13:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 12:13:27.995629 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:13:28.001076 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a55488d-335d-41b1-a253-84d92cf6b104 None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:28.001477 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a55488d-335d-41b1-a253-84d92cf6b104 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:28.001891 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a55488d-335d-41b1-a253-84d92cf6b104 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:28.020788 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-7a55488d-335d-41b1-a253-84d92cf6b104 None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:13:28.022199 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-7a55488d-335d-41b1-a253-84d92cf6b104 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:13:28.031109 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b71f56-45b1-45fa-9861-27eb3dda1fa2 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:28.070275 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a3c85c-460c-4433-aaa2-0378a51de2b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:28.071210 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a3c85c-460c-4433-aaa2-0378a51de2b5 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:28.072013 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a3c85c-460c-4433-aaa2-0378a51de2b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:28.072470 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a3c85c-460c-4433-aaa2-0378a51de2b5 None admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:28.073757 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a3c85c-460c-4433-aaa2-0378a51de2b5 None admin] RBAC: Adding query filter params (name=member) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:13:28.074219 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a3c85c-460c-4433-aaa2-0378a51de2b5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:13:28.076298 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a3c85c-460c-4433-aaa2-0378a51de2b5 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:13:28.089261 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 210/413] 10.222.0.44 () {56 vars in 1101 bytes} [Thu Jun 16 12:13:27 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 12:13:28.094694 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a3c85c-460c-4433-aaa2-0378a51de2b5 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:28.107992 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 204/414] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 12:13:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 12:13:28.152588 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a55488d-335d-41b1-a253-84d92cf6b104 None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:28.245487 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:13:28.272298 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a3c85c-460c-4433-aaa2-0378a51de2b5 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:28.306638 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a55488d-335d-41b1-a253-84d92cf6b104 None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:28.312205 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932db905-d12a-44af-8bf4-3a9c0d8c7822 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:28.313151 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932db905-d12a-44af-8bf4-3a9c0d8c7822 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:28.313755 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932db905-d12a-44af-8bf4-3a9c0d8c7822 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:28.314270 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932db905-d12a-44af-8bf4-3a9c0d8c7822 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:28.328097 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:13:28.355180 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30008a56-e41f-4e92-833e-fb62e19818f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:28.356004 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30008a56-e41f-4e92-833e-fb62e19818f4 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:28.356288 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30008a56-e41f-4e92-833e-fb62e19818f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:28.356578 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30008a56-e41f-4e92-833e-fb62e19818f4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:28.383697 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30008a56-e41f-4e92-833e-fb62e19818f4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 12:13:28.394761 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application [None req-30008a56-e41f-4e92-833e-fb62e19818f4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 12:13:28.394761 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 12:13:28.394761 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 12:13:28.394761 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 12:13:28.394761 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 12:13:28.394761 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 12:13:28.394761 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 12:13:28.394761 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 12:13:28.394761 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 12:13:28.394761 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 12:13:28.394761 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 12:13:28.394761 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 12:13:28.394761 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 12:13:28.394761 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 12:13:28.394761 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 12:13:28.394761 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 12:13:28.395704 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 12:13:28.395704 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 12:13:28.395704 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 12:13:28.395704 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 12:13:28.395704 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 12:13:28.395704 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 12:13:28.395704 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 12:13:28.395704 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 12:13:28.395704 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 12:13:28.395704 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 12:13:28.395704 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 12:13:28.395704 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application with Lock( Jun 16 12:13:28.395704 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 12:13:28.395704 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._enter() Jun 16 12:13:28.395704 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 12:13:28.395704 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 12:13:28.396510 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 12:13:28.396510 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.creator() Jun 16 12:13:28.396510 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 12:13:28.396510 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application created_value = creator( Jun 16 12:13:28.396510 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 12:13:28.396510 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 12:13:28.396510 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 12:13:28.396510 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 12:13:28.396510 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 12:13:28.396510 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 12:13:28.396510 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 12:13:28.396510 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application Jun 16 12:13:28.400959 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 205/415] 10.222.0.44 () {56 vars in 1096 bytes} [Thu Jun 16 12:13:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 12:13:28.406883 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30008a56-e41f-4e92-833e-fb62e19818f4 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:28.441065 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932db905-d12a-44af-8bf4-3a9c0d8c7822 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:13:28.442523 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932db905-d12a-44af-8bf4-3a9c0d8c7822 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:13:28.541130 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30008a56-e41f-4e92-833e-fb62e19818f4 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:28.549103 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:13:28.566820 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 211/416] 10.222.0.44 () {58 vars in 1282 bytes} [Thu Jun 16 12:13:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 472 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 12:13:28.569131 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaa324d-909a-4fad-8542-f54d6a078a41 None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:28.570043 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaa324d-909a-4fad-8542-f54d6a078a41 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:28.570327 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaa324d-909a-4fad-8542-f54d6a078a41 None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:28.572343 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 212/417] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 12:13:28 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 12:13:28.573316 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eaa324d-909a-4fad-8542-f54d6a078a41 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:28.583766 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cdaf31-7769-4cf1-8a5d-9f641998b9ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:28.584434 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cdaf31-7769-4cf1-8a5d-9f641998b9ce None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:28.584742 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cdaf31-7769-4cf1-8a5d-9f641998b9ce None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:28.585051 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cdaf31-7769-4cf1-8a5d-9f641998b9ce None admin] PATH_INFO: `/v3/roles` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:28.585798 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cdaf31-7769-4cf1-8a5d-9f641998b9ce None admin] RBAC: Adding query filter params (name=admin) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:13:28.586101 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cdaf31-7769-4cf1-8a5d-9f641998b9ce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:13:28.587471 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cdaf31-7769-4cf1-8a5d-9f641998b9ce None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:13:28.597684 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 206/418] 10.222.0.44 () {56 vars in 1099 bytes} [Thu Jun 16 12:13:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 12:13:28.598974 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e922e6ea-eb6d-42af-a4c3-f42630da72c1 None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:28.599266 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e922e6ea-eb6d-42af-a4c3-f42630da72c1 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:28.599540 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e922e6ea-eb6d-42af-a4c3-f42630da72c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:28.617068 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-e922e6ea-eb6d-42af-a4c3-f42630da72c1 None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:13:28.618251 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-e922e6ea-eb6d-42af-a4c3-f42630da72c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:13:28.624389 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:13:28.703795 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 207/419] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 12:13:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 12:13:28.704105 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eaa324d-909a-4fad-8542-f54d6a078a41 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:28.704695 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e922e6ea-eb6d-42af-a4c3-f42630da72c1 None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:28.753103 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a23c4b7-2d38-446c-8a73-e51a2ea0ac52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:28.754319 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a23c4b7-2d38-446c-8a73-e51a2ea0ac52 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:28.754838 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a23c4b7-2d38-446c-8a73-e51a2ea0ac52 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:28.755305 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a23c4b7-2d38-446c-8a73-e51a2ea0ac52 None admin] PATH_INFO: `/v3/projects/02e13d55192e4bfc8385150aa7249e83` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:28.757388 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a23c4b7-2d38-446c-8a73-e51a2ea0ac52 None admin] RBAC: Authorizing `identity:get_project(project_id=02e13d55192e4bfc8385150aa7249e83)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:13:28.759190 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a23c4b7-2d38-446c-8a73-e51a2ea0ac52 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:13:28.761590 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 213/420] 10.222.0.44 () {56 vars in 1186 bytes} [Thu Jun 16 12:13:28 2022] GET /identity/v3/projects/02e13d55192e4bfc8385150aa7249e83 => generated 298 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:13:28.762551 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a23c4b7-2d38-446c-8a73-e51a2ea0ac52 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:28.831600 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:13:28.837035 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e922e6ea-eb6d-42af-a4c3-f42630da72c1 None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:28.871800 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a23c4b7-2d38-446c-8a73-e51a2ea0ac52 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:28.880387 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:13:28.880684 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e81248-dfa7-4983-a875-331871772ee5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:28.882336 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e81248-dfa7-4983-a875-331871772ee5 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:28.883828 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e81248-dfa7-4983-a875-331871772ee5 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:28.884952 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e81248-dfa7-4983-a875-331871772ee5 None admin] PATH_INFO: `/v3/groups/4c0cdedf5fe4473cb82a244e0eabb122` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:28.886727 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e81248-dfa7-4983-a875-331871772ee5 None admin] RBAC: Authorizing `identity:get_group(group_id=4c0cdedf5fe4473cb82a244e0eabb122)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:13:28.888559 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e81248-dfa7-4983-a875-331871772ee5 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:13:28.891335 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 208/421] 10.222.0.44 () {56 vars in 1180 bytes} [Thu Jun 16 12:13:28 2022] GET /identity/v3/groups/4c0cdedf5fe4473cb82a244e0eabb122 => generated 229 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:13:28.892321 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e81248-dfa7-4983-a875-331871772ee5 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:28.927764 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8dec6b-34e3-4c70-9ba5-042bcdbd2e77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:28.929123 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8dec6b-34e3-4c70-9ba5-042bcdbd2e77 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:28.930073 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8dec6b-34e3-4c70-9ba5-042bcdbd2e77 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:28.930815 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8dec6b-34e3-4c70-9ba5-042bcdbd2e77 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:28.948127 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8dec6b-34e3-4c70-9ba5-042bcdbd2e77 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 12:13:28.957147 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-4f8dec6b-34e3-4c70-9ba5-042bcdbd2e77 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 12:13:28.957147 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 12:13:28.957147 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 12:13:28.957147 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 12:13:28.957147 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 12:13:28.957147 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 12:13:28.957147 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 12:13:28.957147 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 12:13:28.957147 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 12:13:28.957147 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 12:13:28.957147 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 12:13:28.957147 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 12:13:28.957147 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 12:13:28.957147 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 12:13:28.957147 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 12:13:28.957147 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 12:13:28.958045 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 12:13:28.958045 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 12:13:28.958045 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 12:13:28.958045 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 12:13:28.958045 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 12:13:28.958045 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 12:13:28.958045 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 12:13:28.958045 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 12:13:28.958045 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 12:13:28.958045 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 12:13:28.958045 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 12:13:28.958045 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jun 16 12:13:28.958045 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 12:13:28.958045 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jun 16 12:13:28.958045 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 12:13:28.958045 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 12:13:28.958834 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 12:13:28.958834 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jun 16 12:13:28.958834 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 12:13:28.958834 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jun 16 12:13:28.958834 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 12:13:28.958834 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 12:13:28.958834 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 12:13:28.958834 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 12:13:28.958834 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 12:13:28.958834 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 12:13:28.958834 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 12:13:28.958834 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jun 16 12:13:28.958834 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 214/422] 10.222.0.44 () {56 vars in 1114 bytes} [Thu Jun 16 12:13:28 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 12:13:28.959484 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8dec6b-34e3-4c70-9ba5-042bcdbd2e77 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:29.023849 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e81248-dfa7-4983-a875-331871772ee5 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:29.070900 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ecaa0e-9663-4edd-a41f-6b9b2f571f73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:29.072571 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ecaa0e-9663-4edd-a41f-6b9b2f571f73 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:29.073144 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ecaa0e-9663-4edd-a41f-6b9b2f571f73 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:29.073619 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ecaa0e-9663-4edd-a41f-6b9b2f571f73 None admin] PATH_INFO: `/v3/groups/f52e88ae0f3e4e4c89d3258aea3be7d0` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:29.074774 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8dec6b-34e3-4c70-9ba5-042bcdbd2e77 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:29.075180 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ecaa0e-9663-4edd-a41f-6b9b2f571f73 None admin] RBAC: Authorizing `identity:get_group(group_id=f52e88ae0f3e4e4c89d3258aea3be7d0)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:13:29.077081 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ecaa0e-9663-4edd-a41f-6b9b2f571f73 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:13:29.079763 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 209/423] 10.222.0.44 () {56 vars in 1180 bytes} [Thu Jun 16 12:13:28 2022] GET /identity/v3/groups/f52e88ae0f3e4e4c89d3258aea3be7d0 => generated 226 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:13:29.080699 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ecaa0e-9663-4edd-a41f-6b9b2f571f73 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:29.118278 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18dc4699-eb40-4822-ad46-3b3f530fecb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:29.119371 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dc4699-eb40-4822-ad46-3b3f530fecb7 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:29.119901 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dc4699-eb40-4822-ad46-3b3f530fecb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:29.120172 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dc4699-eb40-4822-ad46-3b3f530fecb7 None admin] PATH_INFO: `/v3/projects/487834c5a8184e199d372be1da9a9d39` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:29.121473 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18dc4699-eb40-4822-ad46-3b3f530fecb7 None admin] RBAC: Authorizing `identity:get_project(project_id=487834c5a8184e199d372be1da9a9d39)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:13:29.123113 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18dc4699-eb40-4822-ad46-3b3f530fecb7 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:13:29.123690 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:13:29.130813 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 215/424] 10.222.0.44 () {56 vars in 1186 bytes} [Thu Jun 16 12:13:28 2022] GET /identity/v3/projects/487834c5a8184e199d372be1da9a9d39 => generated 344 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:13:29.130813 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18dc4699-eb40-4822-ad46-3b3f530fecb7 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:29.170161 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:13:29.219140 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ecaa0e-9663-4edd-a41f-6b9b2f571f73 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:29.242401 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18dc4699-eb40-4822-ad46-3b3f530fecb7 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:29.264959 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f58002-60f6-4daf-9a42-b2f9a02804c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:29.266149 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f58002-60f6-4daf-9a42-b2f9a02804c7 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:29.266859 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f58002-60f6-4daf-9a42-b2f9a02804c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:29.267312 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f58002-60f6-4daf-9a42-b2f9a02804c7 None admin] PATH_INFO: `/v3/roles` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:29.269020 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f58002-60f6-4daf-9a42-b2f9a02804c7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:13:29.269507 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f58002-60f6-4daf-9a42-b2f9a02804c7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:13:29.271861 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f58002-60f6-4daf-9a42-b2f9a02804c7 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:13:29.279210 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8975102-816b-46d8-9587-02f6cbb48202 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:29.279964 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8975102-816b-46d8-9587-02f6cbb48202 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:29.280329 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8975102-816b-46d8-9587-02f6cbb48202 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:29.280706 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8975102-816b-46d8-9587-02f6cbb48202 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:29.281656 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8975102-816b-46d8-9587-02f6cbb48202 None admin] RBAC: Adding query filter params (group.id=f52e88ae0f3e4e4c89d3258aea3be7d0, role.id=c39882b202e942479a7cdac2fc6da72c, scope.project.id=02e13d55192e4bfc8385150aa7249e83) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:13:29.282039 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8975102-816b-46d8-9587-02f6cbb48202 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:13:29.283375 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 210/425] 10.222.0.44 () {56 vars in 1111 bytes} [Thu Jun 16 12:13:29 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:13:29.283547 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8975102-816b-46d8-9587-02f6cbb48202 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:13:29.284599 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f58002-60f6-4daf-9a42-b2f9a02804c7 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:29.296908 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 216/426] 10.222.0.44 () {56 vars in 1376 bytes} [Thu Jun 16 12:13:29 2022] GET /identity/v3/role_assignments?group.id=f52e88ae0f3e4e4c89d3258aea3be7d0&scope.project.id=02e13d55192e4bfc8385150aa7249e83&role.id=c39882b202e942479a7cdac2fc6da72c => generated 611 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:13:29.298113 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8975102-816b-46d8-9587-02f6cbb48202 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:29.403341 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:13:29.417919 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f58002-60f6-4daf-9a42-b2f9a02804c7 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:29.456664 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a1a750-1311-4695-bb6e-3c2b82ca89ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:29.457597 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a1a750-1311-4695-bb6e-3c2b82ca89ef None admin] REQUEST_METHOD: `PUT` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:29.457881 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a1a750-1311-4695-bb6e-3c2b82ca89ef None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:29.458158 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a1a750-1311-4695-bb6e-3c2b82ca89ef None admin] PATH_INFO: `/v3/projects/487834c5a8184e199d372be1da9a9d39/groups/4c0cdedf5fe4473cb82a244e0eabb122/roles/0688968254744e3f9913653cafea3091` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:29.460227 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a1a750-1311-4695-bb6e-3c2b82ca89ef None admin] RBAC: Authorizing `identity:create_grant(project_id=487834c5a8184e199d372be1da9a9d39, group_id=4c0cdedf5fe4473cb82a244e0eabb122, role_id=0688968254744e3f9913653cafea3091)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:13:29.461917 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a1a750-1311-4695-bb6e-3c2b82ca89ef None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:13:29.481141 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 211/427] 10.222.0.44 () {58 vars in 1442 bytes} [Thu Jun 16 12:13:29 2022] PUT /identity/v3/projects/487834c5a8184e199d372be1da9a9d39/groups/4c0cdedf5fe4473cb82a244e0eabb122/roles/0688968254744e3f9913653cafea3091 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:13:29.518602 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:13:29.523337 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8975102-816b-46d8-9587-02f6cbb48202 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:29.580097 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ef5270-180c-4f4b-a239-04e9b473a484 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:29.580804 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ef5270-180c-4f4b-a239-04e9b473a484 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:29.581092 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ef5270-180c-4f4b-a239-04e9b473a484 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:29.581371 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ef5270-180c-4f4b-a239-04e9b473a484 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:29.632521 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a43bf6-2129-434e-964f-b3c4d07a1e75 None None] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:29.633088 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a43bf6-2129-434e-964f-b3c4d07a1e75 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:29.633088 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a43bf6-2129-434e-964f-b3c4d07a1e75 None None] PATH_INFO: `/` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:29.634576 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 212/428] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 12:13:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 12:13:29.640437 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825c1815-7c8f-435f-91ce-83216e14b340 None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:29.640734 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825c1815-7c8f-435f-91ce-83216e14b340 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:29.641040 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825c1815-7c8f-435f-91ce-83216e14b340 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:29.660218 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ef5270-180c-4f4b-a239-04e9b473a484 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:13:29.661655 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ef5270-180c-4f4b-a239-04e9b473a484 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:13:29.664518 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-825c1815-7c8f-435f-91ce-83216e14b340 None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:13:29.666069 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-825c1815-7c8f-435f-91ce-83216e14b340 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:13:29.760847 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 213/429] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 12:13:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 12:13:29.782656 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:13:29.788388 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825c1815-7c8f-435f-91ce-83216e14b340 None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:29.789337 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 217/430] 10.222.0.44 () {58 vars in 1282 bytes} [Thu Jun 16 12:13:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 491 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 12:13:29.795192 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ef5270-180c-4f4b-a239-04e9b473a484 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:29.889213 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:13:29.901421 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825c1815-7c8f-435f-91ce-83216e14b340 None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:29.902352 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ef5270-180c-4f4b-a239-04e9b473a484 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:29.952040 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e9b1f2-6415-4a67-83c6-bf70dcea5818 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:29.952936 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e9b1f2-6415-4a67-83c6-bf70dcea5818 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:29.953219 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e9b1f2-6415-4a67-83c6-bf70dcea5818 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:29.953494 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e9b1f2-6415-4a67-83c6-bf70dcea5818 None admin] PATH_INFO: `/v3/projects/02e13d55192e4bfc8385150aa7249e83` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:29.953715 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26dabfb2-1482-42e3-a64e-63b5a7841ede None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:29.954712 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e9b1f2-6415-4a67-83c6-bf70dcea5818 None admin] RBAC: Authorizing `identity:get_project(project_id=02e13d55192e4bfc8385150aa7249e83)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:13:29.954826 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dabfb2-1482-42e3-a64e-63b5a7841ede None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:29.955169 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dabfb2-1482-42e3-a64e-63b5a7841ede None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:29.955538 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dabfb2-1482-42e3-a64e-63b5a7841ede None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:29.956175 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e9b1f2-6415-4a67-83c6-bf70dcea5818 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:13:29.958346 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 218/431] 10.222.0.44 () {56 vars in 1186 bytes} [Thu Jun 16 12:13:29 2022] GET /identity/v3/projects/02e13d55192e4bfc8385150aa7249e83 => generated 298 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 12:13:29.964297 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e9b1f2-6415-4a67-83c6-bf70dcea5818 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:29.967812 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26dabfb2-1482-42e3-a64e-63b5a7841ede None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 12:13:29.977596 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application [None req-26dabfb2-1482-42e3-a64e-63b5a7841ede None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 12:13:29.977596 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 12:13:29.977596 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 12:13:29.977596 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 12:13:29.977596 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 12:13:29.977596 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 12:13:29.977596 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 12:13:29.977596 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 12:13:29.977596 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 12:13:29.977596 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 12:13:29.977596 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 12:13:29.977596 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 12:13:29.977596 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 12:13:29.977596 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 12:13:29.977596 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 12:13:29.977596 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 12:13:29.978451 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 12:13:29.978451 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 12:13:29.978451 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 12:13:29.978451 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 12:13:29.978451 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 12:13:29.978451 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 12:13:29.978451 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 12:13:29.978451 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 12:13:29.978451 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 12:13:29.978451 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 12:13:29.978451 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 12:13:29.978451 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application with Lock( Jun 16 12:13:29.978451 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 12:13:29.978451 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._enter() Jun 16 12:13:29.978451 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 12:13:29.978451 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 12:13:29.979228 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 12:13:29.979228 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.creator() Jun 16 12:13:29.979228 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 12:13:29.979228 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application created_value = creator( Jun 16 12:13:29.979228 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 12:13:29.979228 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 12:13:29.979228 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 12:13:29.979228 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 12:13:29.979228 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 12:13:29.979228 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 12:13:29.979228 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 12:13:29.979228 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application Jun 16 12:13:29.979228 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 214/432] 10.222.0.44 () {56 vars in 1114 bytes} [Thu Jun 16 12:13:29 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 12:13:29.988988 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26dabfb2-1482-42e3-a64e-63b5a7841ede None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:30.062788 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:13:30.103013 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e9b1f2-6415-4a67-83c6-bf70dcea5818 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:30.140167 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26dabfb2-1482-42e3-a64e-63b5a7841ede None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:30.142659 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19477dd-7704-4227-8e0f-31a4ef2baa1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:30.143753 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19477dd-7704-4227-8e0f-31a4ef2baa1f None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:30.144234 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19477dd-7704-4227-8e0f-31a4ef2baa1f None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:30.144725 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19477dd-7704-4227-8e0f-31a4ef2baa1f None admin] PATH_INFO: `/v3/groups/f52e88ae0f3e4e4c89d3258aea3be7d0` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:30.146189 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19477dd-7704-4227-8e0f-31a4ef2baa1f None admin] RBAC: Authorizing `identity:get_group(group_id=f52e88ae0f3e4e4c89d3258aea3be7d0)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:13:30.148431 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19477dd-7704-4227-8e0f-31a4ef2baa1f None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:13:30.152451 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 219/433] 10.222.0.44 () {56 vars in 1180 bytes} [Thu Jun 16 12:13:29 2022] GET /identity/v3/groups/f52e88ae0f3e4e4c89d3258aea3be7d0 => generated 226 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:13:30.159406 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19477dd-7704-4227-8e0f-31a4ef2baa1f None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:30.189178 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc966513-8a55-4e87-8173-9b0ac140b30a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:30.189774 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc966513-8a55-4e87-8173-9b0ac140b30a None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:30.190050 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc966513-8a55-4e87-8173-9b0ac140b30a None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:30.190319 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc966513-8a55-4e87-8173-9b0ac140b30a None admin] PATH_INFO: `/v3/roles` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:30.191323 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc966513-8a55-4e87-8173-9b0ac140b30a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:13:30.191630 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc966513-8a55-4e87-8173-9b0ac140b30a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:13:30.193250 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc966513-8a55-4e87-8173-9b0ac140b30a None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:13:30.210465 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 215/434] 10.222.0.44 () {56 vars in 1111 bytes} [Thu Jun 16 12:13:29 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:13:30.221966 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc966513-8a55-4e87-8173-9b0ac140b30a None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:30.239843 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:13:30.285745 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19477dd-7704-4227-8e0f-31a4ef2baa1f None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:30.327214 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f415911a-a753-45b1-adc8-a68cf13d37c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:30.328111 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f415911a-a753-45b1-adc8-a68cf13d37c2 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:30.328537 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f415911a-a753-45b1-adc8-a68cf13d37c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:30.328980 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f415911a-a753-45b1-adc8-a68cf13d37c2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:30.329966 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f415911a-a753-45b1-adc8-a68cf13d37c2 None admin] RBAC: Adding query filter params (group.id=f52e88ae0f3e4e4c89d3258aea3be7d0, role.id=e24b3707bc514b1fa606efab092047e6, scope.project.id=02e13d55192e4bfc8385150aa7249e83) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:13:30.330453 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f415911a-a753-45b1-adc8-a68cf13d37c2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:13:30.332056 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f415911a-a753-45b1-adc8-a68cf13d37c2 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:13:30.334438 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:13:30.340612 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 220/435] 10.222.0.44 () {56 vars in 1376 bytes} [Thu Jun 16 12:13:30 2022] GET /identity/v3/role_assignments?group.id=f52e88ae0f3e4e4c89d3258aea3be7d0&scope.project.id=02e13d55192e4bfc8385150aa7249e83&role.id=e24b3707bc514b1fa606efab092047e6 => generated 611 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:13:30.382689 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc966513-8a55-4e87-8173-9b0ac140b30a None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:30.421275 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53990646-cf4b-40a3-927f-cf495d774a7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:30.421952 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53990646-cf4b-40a3-927f-cf495d774a7e None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:30.422231 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53990646-cf4b-40a3-927f-cf495d774a7e None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:30.422500 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53990646-cf4b-40a3-927f-cf495d774a7e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:30.494137 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988838f6-c84a-4889-b5f6-6376c8fd209f None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:30.494495 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988838f6-c84a-4889-b5f6-6376c8fd209f None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:30.494684 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988838f6-c84a-4889-b5f6-6376c8fd209f None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:30.496337 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 221/436] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 12:13:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 12:13:30.501056 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53990646-cf4b-40a3-927f-cf495d774a7e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:13:30.501725 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bf1ef2-e41a-4541-8450-6f996c06ad73 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:30.502011 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bf1ef2-e41a-4541-8450-6f996c06ad73 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:30.502287 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bf1ef2-e41a-4541-8450-6f996c06ad73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:30.502526 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53990646-cf4b-40a3-927f-cf495d774a7e None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:13:30.519964 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:13:30.520535 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-12bf1ef2-e41a-4541-8450-6f996c06ad73 None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:13:30.521915 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-12bf1ef2-e41a-4541-8450-6f996c06ad73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:13:30.610694 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 222/437] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 12:13:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 12:13:30.621286 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 216/438] 10.222.0.44 () {58 vars in 1282 bytes} [Thu Jun 16 12:13:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 16 12:13:30.626378 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bf1ef2-e41a-4541-8450-6f996c06ad73 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:30.638311 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53990646-cf4b-40a3-927f-cf495d774a7e None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:30.766517 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bf1ef2-e41a-4541-8450-6f996c06ad73 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:30.767761 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53990646-cf4b-40a3-927f-cf495d774a7e None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:30.779116 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:13:30.798460 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:13:30.814702 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703fcbb2-19af-4671-b65c-c6e520d975d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:30.815108 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703fcbb2-19af-4671-b65c-c6e520d975d2 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:30.815383 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703fcbb2-19af-4671-b65c-c6e520d975d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:30.815652 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703fcbb2-19af-4671-b65c-c6e520d975d2 None admin] PATH_INFO: `/v3/projects/1adc255cfb4744c1b467603311c319e7` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:30.818646 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1438392-f880-41d4-8483-672fbe2bb57d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:30.818772 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703fcbb2-19af-4671-b65c-c6e520d975d2 None admin] RBAC: Authorizing `identity:get_project(project_id=1adc255cfb4744c1b467603311c319e7)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:13:30.818861 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1438392-f880-41d4-8483-672fbe2bb57d None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:30.818861 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1438392-f880-41d4-8483-672fbe2bb57d None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:30.818861 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1438392-f880-41d4-8483-672fbe2bb57d None admin] PATH_INFO: `/v3/roles/member` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:30.819634 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703fcbb2-19af-4671-b65c-c6e520d975d2 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:13:30.821476 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 223/439] 10.222.0.44 () {56 vars in 1186 bytes} [Thu Jun 16 12:13:30 2022] GET /identity/v3/projects/1adc255cfb4744c1b467603311c319e7 => generated 302 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:13:30.829599 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703fcbb2-19af-4671-b65c-c6e520d975d2 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:30.831053 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1438392-f880-41d4-8483-672fbe2bb57d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 12:13:30.840378 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application [None req-b1438392-f880-41d4-8483-672fbe2bb57d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 16 12:13:30.840378 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 12:13:30.840378 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 12:13:30.840378 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 12:13:30.840378 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 12:13:30.840378 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 12:13:30.840378 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 12:13:30.840378 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 12:13:30.840378 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 12:13:30.840378 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 12:13:30.840378 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 12:13:30.840378 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 12:13:30.840378 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 12:13:30.840378 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 12:13:30.840378 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 12:13:30.840378 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 12:13:30.841351 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 12:13:30.841351 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 12:13:30.841351 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 12:13:30.841351 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 12:13:30.841351 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 12:13:30.841351 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 12:13:30.841351 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 12:13:30.841351 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 12:13:30.841351 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 12:13:30.841351 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 12:13:30.841351 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 12:13:30.841351 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application with Lock( Jun 16 12:13:30.841351 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 12:13:30.841351 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._enter() Jun 16 12:13:30.841351 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 12:13:30.841351 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 12:13:30.842142 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 12:13:30.842142 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.creator() Jun 16 12:13:30.842142 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 12:13:30.842142 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application created_value = creator( Jun 16 12:13:30.842142 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 12:13:30.842142 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 12:13:30.842142 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 12:13:30.842142 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 12:13:30.842142 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 12:13:30.842142 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 12:13:30.842142 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 16 12:13:30.842142 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application Jun 16 12:13:30.842748 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 217/440] 10.222.0.44 () {56 vars in 1099 bytes} [Thu Jun 16 12:13:30 2022] GET /identity/v3/roles/member => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 12:13:30.847967 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1438392-f880-41d4-8483-672fbe2bb57d None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:30.947580 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703fcbb2-19af-4671-b65c-c6e520d975d2 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:30.955278 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1438392-f880-41d4-8483-672fbe2bb57d None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:30.983438 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ced9e9-34c1-4632-854d-b994e6b09145 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:30.984306 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ced9e9-34c1-4632-854d-b994e6b09145 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:30.984585 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ced9e9-34c1-4632-854d-b994e6b09145 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:30.984892 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ced9e9-34c1-4632-854d-b994e6b09145 None admin] PATH_INFO: `/v3/groups/f52e88ae0f3e4e4c89d3258aea3be7d0` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:30.986069 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ced9e9-34c1-4632-854d-b994e6b09145 None admin] RBAC: Authorizing `identity:get_group(group_id=f52e88ae0f3e4e4c89d3258aea3be7d0)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:13:30.987540 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ced9e9-34c1-4632-854d-b994e6b09145 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:13:30.989199 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 224/441] 10.222.0.44 () {56 vars in 1180 bytes} [Thu Jun 16 12:13:30 2022] GET /identity/v3/groups/f52e88ae0f3e4e4c89d3258aea3be7d0 => generated 226 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 12:13:30.992183 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0cccbb-a62f-4edc-9a00-75e95619e7d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:30.993087 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0cccbb-a62f-4edc-9a00-75e95619e7d2 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:30.993544 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0cccbb-a62f-4edc-9a00-75e95619e7d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:30.993992 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0cccbb-a62f-4edc-9a00-75e95619e7d2 None admin] PATH_INFO: `/v3/roles` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:30.994913 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0cccbb-a62f-4edc-9a00-75e95619e7d2 None admin] RBAC: Adding query filter params (name=member) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:13:30.995361 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ced9e9-34c1-4632-854d-b994e6b09145 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:30.995605 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0cccbb-a62f-4edc-9a00-75e95619e7d2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:13:30.997148 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0cccbb-a62f-4edc-9a00-75e95619e7d2 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:13:31.008344 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 218/442] 10.222.0.44 () {56 vars in 1101 bytes} [Thu Jun 16 12:13:30 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:13:31.013855 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0cccbb-a62f-4edc-9a00-75e95619e7d2 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:31.054922 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:13:31.058980 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:13:31.101292 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ced9e9-34c1-4632-854d-b994e6b09145 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:31.125532 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0cccbb-a62f-4edc-9a00-75e95619e7d2 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:31.135889 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75af43d5-68f9-4b8a-9b35-5a86db56dc44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:31.136532 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75af43d5-68f9-4b8a-9b35-5a86db56dc44 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:31.136932 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75af43d5-68f9-4b8a-9b35-5a86db56dc44 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:31.137101 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75af43d5-68f9-4b8a-9b35-5a86db56dc44 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:31.137925 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75af43d5-68f9-4b8a-9b35-5a86db56dc44 None admin] RBAC: Adding query filter params (group.id=f52e88ae0f3e4e4c89d3258aea3be7d0, role.id=e24b3707bc514b1fa606efab092047e6, scope.project.id=1adc255cfb4744c1b467603311c319e7) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:13:31.138228 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75af43d5-68f9-4b8a-9b35-5a86db56dc44 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:13:31.139659 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75af43d5-68f9-4b8a-9b35-5a86db56dc44 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:13:31.156778 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 225/443] 10.222.0.44 () {56 vars in 1376 bytes} [Thu Jun 16 12:13:30 2022] GET /identity/v3/role_assignments?group.id=f52e88ae0f3e4e4c89d3258aea3be7d0&scope.project.id=1adc255cfb4744c1b467603311c319e7&role.id=e24b3707bc514b1fa606efab092047e6 => generated 611 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 12:13:31.159922 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2653f9a-dcb3-4533-ac9e-55f4b3a69f8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:31.160591 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2653f9a-dcb3-4533-ac9e-55f4b3a69f8e None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:31.160906 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2653f9a-dcb3-4533-ac9e-55f4b3a69f8e None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:31.161178 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2653f9a-dcb3-4533-ac9e-55f4b3a69f8e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:31.236493 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2653f9a-dcb3-4533-ac9e-55f4b3a69f8e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:13:31.238000 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2653f9a-dcb3-4533-ac9e-55f4b3a69f8e None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:13:31.268667 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:13:31.347051 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 219/444] 10.222.0.44 () {58 vars in 1282 bytes} [Thu Jun 16 12:13:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 16 12:13:31.353230 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75af43d5-68f9-4b8a-9b35-5a86db56dc44 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:31.452089 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75af43d5-68f9-4b8a-9b35-5a86db56dc44 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:31.478090 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:13:31.486228 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1526a5-4f0d-4e6c-a9ce-4cc90783a9f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:31.487081 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1526a5-4f0d-4e6c-a9ce-4cc90783a9f1 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:31.487355 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1526a5-4f0d-4e6c-a9ce-4cc90783a9f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:31.487645 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1526a5-4f0d-4e6c-a9ce-4cc90783a9f1 None admin] PATH_INFO: `/v3/projects/1adc255cfb4744c1b467603311c319e7` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:31.488848 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1526a5-4f0d-4e6c-a9ce-4cc90783a9f1 None admin] RBAC: Authorizing `identity:get_project(project_id=1adc255cfb4744c1b467603311c319e7)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:13:31.490280 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1526a5-4f0d-4e6c-a9ce-4cc90783a9f1 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:13:31.491983 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 226/445] 10.222.0.44 () {56 vars in 1186 bytes} [Thu Jun 16 12:13:31 2022] GET /identity/v3/projects/1adc255cfb4744c1b467603311c319e7 => generated 302 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 12:13:31.497516 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2653f9a-dcb3-4533-ac9e-55f4b3a69f8e None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:31.593138 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2653f9a-dcb3-4533-ac9e-55f4b3a69f8e None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:31.619902 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:13:31.625812 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b4d7b8-3f03-4104-a32f-679f0df12f62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:31.626658 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b4d7b8-3f03-4104-a32f-679f0df12f62 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:31.626931 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b4d7b8-3f03-4104-a32f-679f0df12f62 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:31.627196 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b4d7b8-3f03-4104-a32f-679f0df12f62 None admin] PATH_INFO: `/v3/groups/f52e88ae0f3e4e4c89d3258aea3be7d0` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:31.628345 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b4d7b8-3f03-4104-a32f-679f0df12f62 None admin] RBAC: Authorizing `identity:get_group(group_id=f52e88ae0f3e4e4c89d3258aea3be7d0)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:13:31.629792 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b4d7b8-3f03-4104-a32f-679f0df12f62 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:13:31.631911 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 220/446] 10.222.0.44 () {56 vars in 1180 bytes} [Thu Jun 16 12:13:31 2022] GET /identity/v3/groups/f52e88ae0f3e4e4c89d3258aea3be7d0 => generated 226 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:13:31.637968 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1526a5-4f0d-4e6c-a9ce-4cc90783a9f1 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:31.734593 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1526a5-4f0d-4e6c-a9ce-4cc90783a9f1 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:31.770720 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a49c581-2b8f-4c00-8b44-2c78705e42ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:31.771378 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a49c581-2b8f-4c00-8b44-2c78705e42ef None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:31.771653 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a49c581-2b8f-4c00-8b44-2c78705e42ef None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:31.771922 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a49c581-2b8f-4c00-8b44-2c78705e42ef None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:31.773379 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a49c581-2b8f-4c00-8b44-2c78705e42ef None admin] RBAC: Adding query filter params (group.id=f52e88ae0f3e4e4c89d3258aea3be7d0, role.id=c39882b202e942479a7cdac2fc6da72c, scope.project.id=1adc255cfb4744c1b467603311c319e7) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:13:31.773684 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a49c581-2b8f-4c00-8b44-2c78705e42ef None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:13:31.775138 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a49c581-2b8f-4c00-8b44-2c78705e42ef None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:13:31.781155 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 227/447] 10.222.0.44 () {56 vars in 1376 bytes} [Thu Jun 16 12:13:31 2022] GET /identity/v3/role_assignments?group.id=f52e88ae0f3e4e4c89d3258aea3be7d0&scope.project.id=1adc255cfb4744c1b467603311c319e7&role.id=c39882b202e942479a7cdac2fc6da72c => generated 611 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:13:31.810688 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78bfec6-e249-4821-b619-91540203ab83 None None] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:31.811216 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78bfec6-e249-4821-b619-91540203ab83 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:31.811384 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78bfec6-e249-4821-b619-91540203ab83 None None] PATH_INFO: `/` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:31.812878 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 221/448] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 12:13:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 12:13:31.818719 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5897cc91-7432-4951-ad39-db3920f834e8 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:31.819538 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5897cc91-7432-4951-ad39-db3920f834e8 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:31.819812 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5897cc91-7432-4951-ad39-db3920f834e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:31.837735 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-5897cc91-7432-4951-ad39-db3920f834e8 None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:13:31.838958 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-5897cc91-7432-4951-ad39-db3920f834e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:13:31.897727 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:13:31.909822 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 228/449] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 12:13:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 12:13:31.935616 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78bfec6-e249-4821-b619-91540203ab83 None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:32.038949 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78bfec6-e249-4821-b619-91540203ab83 None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:32.073151 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd7a42f-a122-472b-be9b-b46294bd60f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:32.073934 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd7a42f-a122-472b-be9b-b46294bd60f1 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:32.074212 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd7a42f-a122-472b-be9b-b46294bd60f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:32.074478 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd7a42f-a122-472b-be9b-b46294bd60f1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:32.084857 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd7a42f-a122-472b-be9b-b46294bd60f1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 12:13:32.092468 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application [None req-7cd7a42f-a122-472b-be9b-b46294bd60f1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 12:13:32.092468 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 12:13:32.092468 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 12:13:32.092468 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 12:13:32.092468 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 12:13:32.092468 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 12:13:32.092468 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 12:13:32.092468 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 12:13:32.092468 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 12:13:32.092468 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 12:13:32.092468 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 12:13:32.092468 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 12:13:32.092468 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 12:13:32.092468 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 12:13:32.092468 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 12:13:32.092468 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 12:13:32.093443 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 12:13:32.093443 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 12:13:32.093443 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 12:13:32.093443 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 12:13:32.093443 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 12:13:32.093443 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 12:13:32.093443 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 12:13:32.093443 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 12:13:32.093443 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 12:13:32.093443 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 12:13:32.093443 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 12:13:32.093443 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application with Lock( Jun 16 12:13:32.093443 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 12:13:32.093443 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._enter() Jun 16 12:13:32.093443 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 12:13:32.093443 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 12:13:32.094216 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 12:13:32.094216 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.creator() Jun 16 12:13:32.094216 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 12:13:32.094216 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application created_value = creator( Jun 16 12:13:32.094216 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 12:13:32.094216 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 12:13:32.094216 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 12:13:32.094216 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 12:13:32.094216 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 12:13:32.094216 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 12:13:32.094216 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 12:13:32.094216 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application Jun 16 12:13:32.094216 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 222/450] 10.222.0.44 () {56 vars in 1096 bytes} [Thu Jun 16 12:13:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 12:13:32.099428 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5897cc91-7432-4951-ad39-db3920f834e8 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:32.198564 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5897cc91-7432-4951-ad39-db3920f834e8 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:32.231909 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e58e4fe-4998-4688-ad42-85131f675dfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:32.232578 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e58e4fe-4998-4688-ad42-85131f675dfd None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:32.232891 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e58e4fe-4998-4688-ad42-85131f675dfd None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:32.233166 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e58e4fe-4998-4688-ad42-85131f675dfd None admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:32.233912 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e58e4fe-4998-4688-ad42-85131f675dfd None admin] RBAC: Adding query filter params (name=admin) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:13:32.234216 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e58e4fe-4998-4688-ad42-85131f675dfd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:13:32.235591 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e58e4fe-4998-4688-ad42-85131f675dfd None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:13:32.244342 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 229/451] 10.222.0.44 () {56 vars in 1099 bytes} [Thu Jun 16 12:13:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:13:32.250492 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd7a42f-a122-472b-be9b-b46294bd60f1 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:32.308170 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:13:32.348725 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd7a42f-a122-472b-be9b-b46294bd60f1 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:32.381559 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1f3678-c3ca-43ab-b079-5508dac17ab9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:32.382187 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1f3678-c3ca-43ab-b079-5508dac17ab9 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:32.382466 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1f3678-c3ca-43ab-b079-5508dac17ab9 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:32.382738 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1f3678-c3ca-43ab-b079-5508dac17ab9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:32.447197 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1f3678-c3ca-43ab-b079-5508dac17ab9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:13:32.448686 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1f3678-c3ca-43ab-b079-5508dac17ab9 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:13:32.502414 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:13:32.542816 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 223/452] 10.222.0.44 () {58 vars in 1282 bytes} [Thu Jun 16 12:13:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 16 12:13:32.548883 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e58e4fe-4998-4688-ad42-85131f675dfd None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:32.598991 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:13:32.643865 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e58e4fe-4998-4688-ad42-85131f675dfd None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:32.675624 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a35f9b6-ecf0-4ff5-a894-a3a0df92ddcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:32.676459 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a35f9b6-ecf0-4ff5-a894-a3a0df92ddcb None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:32.676732 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a35f9b6-ecf0-4ff5-a894-a3a0df92ddcb None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:32.677028 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a35f9b6-ecf0-4ff5-a894-a3a0df92ddcb None admin] PATH_INFO: `/v3/projects/487834c5a8184e199d372be1da9a9d39` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:32.678189 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a35f9b6-ecf0-4ff5-a894-a3a0df92ddcb None admin] RBAC: Authorizing `identity:get_project(project_id=487834c5a8184e199d372be1da9a9d39)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:13:32.680213 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a35f9b6-ecf0-4ff5-a894-a3a0df92ddcb None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:13:32.681900 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 230/453] 10.222.0.44 () {56 vars in 1186 bytes} [Thu Jun 16 12:13:32 2022] GET /identity/v3/projects/487834c5a8184e199d372be1da9a9d39 => generated 344 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:13:32.687211 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1f3678-c3ca-43ab-b079-5508dac17ab9 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:32.782272 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1f3678-c3ca-43ab-b079-5508dac17ab9 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:32.814637 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ec37a3-40de-459d-9957-edf9dad05566 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:32.815466 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ec37a3-40de-459d-9957-edf9dad05566 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:32.815740 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ec37a3-40de-459d-9957-edf9dad05566 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:32.816007 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ec37a3-40de-459d-9957-edf9dad05566 None admin] PATH_INFO: `/v3/groups/4c0cdedf5fe4473cb82a244e0eabb122` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:32.817191 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ec37a3-40de-459d-9957-edf9dad05566 None admin] RBAC: Authorizing `identity:get_group(group_id=4c0cdedf5fe4473cb82a244e0eabb122)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:13:32.818612 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ec37a3-40de-459d-9957-edf9dad05566 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:13:32.820223 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 224/454] 10.222.0.44 () {56 vars in 1180 bytes} [Thu Jun 16 12:13:32 2022] GET /identity/v3/groups/4c0cdedf5fe4473cb82a244e0eabb122 => generated 229 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:13:32.825843 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a35f9b6-ecf0-4ff5-a894-a3a0df92ddcb None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:32.923025 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a35f9b6-ecf0-4ff5-a894-a3a0df92ddcb None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:32.941845 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:13:32.955910 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6c7a0b-240e-4c4b-8612-b453c4088c97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:32.956563 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6c7a0b-240e-4c4b-8612-b453c4088c97 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:32.956890 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6c7a0b-240e-4c4b-8612-b453c4088c97 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:32.957169 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6c7a0b-240e-4c4b-8612-b453c4088c97 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:32.957996 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6c7a0b-240e-4c4b-8612-b453c4088c97 None admin] RBAC: Adding query filter params (group.id=4c0cdedf5fe4473cb82a244e0eabb122, role.id=0688968254744e3f9913653cafea3091, scope.project.id=487834c5a8184e199d372be1da9a9d39) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:13:32.958308 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6c7a0b-240e-4c4b-8612-b453c4088c97 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:13:32.960270 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6c7a0b-240e-4c4b-8612-b453c4088c97 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:13:32.965939 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 231/455] 10.222.0.44 () {56 vars in 1376 bytes} [Thu Jun 16 12:13:32 2022] GET /identity/v3/role_assignments?group.id=4c0cdedf5fe4473cb82a244e0eabb122&scope.project.id=487834c5a8184e199d372be1da9a9d39&role.id=0688968254744e3f9913653cafea3091 => generated 611 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:13:35.501846 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11827bd-be95-45ad-ac03-ee311bb3bad0 None None] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:35.502895 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11827bd-be95-45ad-ac03-ee311bb3bad0 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:35.503411 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11827bd-be95-45ad-ac03-ee311bb3bad0 None None] PATH_INFO: `/` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:35.505471 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 225/456] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 12:13:35 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 12:13:35.512097 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7beb601e-3210-4261-bd9e-b321ec94fa24 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:35.513100 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7beb601e-3210-4261-bd9e-b321ec94fa24 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:35.513580 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7beb601e-3210-4261-bd9e-b321ec94fa24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:35.531548 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-7beb601e-3210-4261-bd9e-b321ec94fa24 None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:13:35.533087 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-7beb601e-3210-4261-bd9e-b321ec94fa24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:13:35.571043 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dc8967-53a4-4d99-be8d-15a9db59f467 None None] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:35.571656 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dc8967-53a4-4d99-be8d-15a9db59f467 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:35.572130 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dc8967-53a4-4d99-be8d-15a9db59f467 None None] PATH_INFO: `/` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:35.573947 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 226/457] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 12:13:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 12:13:35.579297 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c7c141-8f58-420e-b39e-25e15539dc94 None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:35.579584 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c7c141-8f58-420e-b39e-25e15539dc94 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:35.579862 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c7c141-8f58-420e-b39e-25e15539dc94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:35.606996 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-11c7c141-8f58-420e-b39e-25e15539dc94 None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:13:35.608196 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-11c7c141-8f58-420e-b39e-25e15539dc94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:13:35.629180 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 232/458] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 12:13:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 12:13:35.653150 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:13:35.687621 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7beb601e-3210-4261-bd9e-b321ec94fa24 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:35.739472 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 227/459] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 12:13:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 12:13:35.759302 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbfc56a-8d05-44a7-87a6-4863e5ca5f36 None None] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:35.759584 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbfc56a-8d05-44a7-87a6-4863e5ca5f36 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:35.759784 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbfc56a-8d05-44a7-87a6-4863e5ca5f36 None None] PATH_INFO: `/` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:35.761192 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 228/460] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 12:13:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 12:13:35.766232 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34cf205-5800-4b37-90ee-6dafca443f5d None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:35.766521 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34cf205-5800-4b37-90ee-6dafca443f5d None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:35.766799 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34cf205-5800-4b37-90ee-6dafca443f5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:35.789557 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-b34cf205-5800-4b37-90ee-6dafca443f5d None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:13:35.791062 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-b34cf205-5800-4b37-90ee-6dafca443f5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:13:35.813308 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7beb601e-3210-4261-bd9e-b321ec94fa24 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:35.828521 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:13:35.849560 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba44adf2-771d-46eb-b5e1-bb9d887e6cda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:35.850606 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba44adf2-771d-46eb-b5e1-bb9d887e6cda None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:35.851058 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba44adf2-771d-46eb-b5e1-bb9d887e6cda None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:35.851491 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba44adf2-771d-46eb-b5e1-bb9d887e6cda None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:35.861991 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba44adf2-771d-46eb-b5e1-bb9d887e6cda None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:13:35.863618 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba44adf2-771d-46eb-b5e1-bb9d887e6cda None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:13:35.871351 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 229/461] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 12:13:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 12:13:35.872496 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34cf205-5800-4b37-90ee-6dafca443f5d None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:35.893871 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-ba44adf2-771d-46eb-b5e1-bb9d887e6cda None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 12:13:35.893871 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 12:13:35.893871 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 12:13:35.893871 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 12:13:35.893871 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 12:13:35.893871 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 12:13:35.893871 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 12:13:35.893871 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 12:13:35.893871 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 12:13:35.893871 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 12:13:35.893871 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 12:13:35.893871 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 12:13:35.893871 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 12:13:35.893871 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 12:13:35.893871 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 12:13:35.894759 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 12:13:35.894759 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 12:13:35.894759 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 12:13:35.894759 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 12:13:35.894759 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 12:13:35.894759 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 12:13:35.894759 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 12:13:35.894759 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 12:13:35.894759 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jun 16 12:13:35.894759 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 12:13:35.894759 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jun 16 12:13:35.894759 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 12:13:35.894759 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 12:13:35.894759 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 12:13:35.894759 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jun 16 12:13:35.894759 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 12:13:35.894759 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jun 16 12:13:35.895599 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 12:13:35.895599 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 12:13:35.895599 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 12:13:35.895599 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jun 16 12:13:35.897897 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 233/462] 10.222.0.44 () {56 vars in 1108 bytes} [Thu Jun 16 12:13:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 12:13:35.904559 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba44adf2-771d-46eb-b5e1-bb9d887e6cda None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:35.989487 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:13:36.012537 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34cf205-5800-4b37-90ee-6dafca443f5d None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:36.030420 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba44adf2-771d-46eb-b5e1-bb9d887e6cda None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:36.057561 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90ab69e-67d2-43ae-93b4-846b5adbda15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:36.058782 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90ab69e-67d2-43ae-93b4-846b5adbda15 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:36.059324 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90ab69e-67d2-43ae-93b4-846b5adbda15 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:36.059907 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90ab69e-67d2-43ae-93b4-846b5adbda15 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:36.068444 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab26eeee-ce2d-4c88-a849-8ca9372b57a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:36.069055 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab26eeee-ce2d-4c88-a849-8ca9372b57a4 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:36.069339 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab26eeee-ce2d-4c88-a849-8ca9372b57a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:36.069612 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab26eeee-ce2d-4c88-a849-8ca9372b57a4 None admin] PATH_INFO: `/v3/domains` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:36.070341 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab26eeee-ce2d-4c88-a849-8ca9372b57a4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:13:36.070644 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab26eeee-ce2d-4c88-a849-8ca9372b57a4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:13:36.072040 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab26eeee-ce2d-4c88-a849-8ca9372b57a4 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:13:36.074050 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90ab69e-67d2-43ae-93b4-846b5adbda15 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:13:36.075916 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90ab69e-67d2-43ae-93b4-846b5adbda15 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:13:36.084451 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 234/463] 10.222.0.44 () {56 vars in 1109 bytes} [Thu Jun 16 12:13:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:13:36.085375 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab26eeee-ce2d-4c88-a849-8ca9372b57a4 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:36.095963 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application [None req-a90ab69e-67d2-43ae-93b4-846b5adbda15 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 12:13:36.095963 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 12:13:36.095963 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 12:13:36.095963 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 12:13:36.095963 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 12:13:36.095963 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 12:13:36.095963 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 12:13:36.095963 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 12:13:36.095963 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 12:13:36.095963 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 12:13:36.095963 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 12:13:36.095963 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 12:13:36.095963 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 12:13:36.095963 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 12:13:36.095963 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 12:13:36.096891 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 12:13:36.096891 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 12:13:36.096891 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 12:13:36.096891 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 12:13:36.096891 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 12:13:36.096891 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 12:13:36.096891 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 12:13:36.096891 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 12:13:36.096891 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application with Lock( Jun 16 12:13:36.096891 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 12:13:36.096891 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._enter() Jun 16 12:13:36.096891 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 12:13:36.096891 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 12:13:36.096891 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 12:13:36.096891 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.creator() Jun 16 12:13:36.096891 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 12:13:36.096891 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application created_value = creator( Jun 16 12:13:36.097731 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 12:13:36.097731 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 12:13:36.097731 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 12:13:36.097731 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application Jun 16 12:13:36.099720 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 230/464] 10.222.0.44 () {56 vars in 1108 bytes} [Thu Jun 16 12:13:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 12:13:36.101251 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90ab69e-67d2-43ae-93b4-846b5adbda15 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:36.120000 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:13:36.196093 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab26eeee-ce2d-4c88-a849-8ca9372b57a4 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:36.218036 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90ab69e-67d2-43ae-93b4-846b5adbda15 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:36.230786 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4f9737-762d-4a0e-b788-e46b510bc850 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:36.231592 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4f9737-762d-4a0e-b788-e46b510bc850 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:36.231917 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4f9737-762d-4a0e-b788-e46b510bc850 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:36.232197 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4f9737-762d-4a0e-b788-e46b510bc850 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:36.244456 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4f9737-762d-4a0e-b788-e46b510bc850 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:13:36.245986 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4f9737-762d-4a0e-b788-e46b510bc850 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:13:36.262510 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd0254a-3444-4461-9f68-8ec3c398dfa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:36.263635 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd0254a-3444-4461-9f68-8ec3c398dfa3 None admin] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:36.264139 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd0254a-3444-4461-9f68-8ec3c398dfa3 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:36.264609 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd0254a-3444-4461-9f68-8ec3c398dfa3 None admin] PATH_INFO: `/v3/users` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:36.265576 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd0254a-3444-4461-9f68-8ec3c398dfa3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:13:36.267274 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd0254a-3444-4461-9f68-8ec3c398dfa3 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:13:36.267896 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-4f4f9737-762d-4a0e-b788-e46b510bc850 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 12:13:36.267896 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 12:13:36.267896 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 12:13:36.267896 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 12:13:36.267896 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 12:13:36.267896 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 12:13:36.267896 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 12:13:36.267896 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 12:13:36.267896 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 12:13:36.267896 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 12:13:36.267896 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 12:13:36.267896 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 12:13:36.267896 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 12:13:36.267896 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 12:13:36.267896 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 12:13:36.268734 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 12:13:36.268734 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 12:13:36.268734 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 12:13:36.268734 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 12:13:36.268734 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 12:13:36.268734 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 12:13:36.268734 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 12:13:36.268734 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 12:13:36.268734 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jun 16 12:13:36.268734 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 12:13:36.268734 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jun 16 12:13:36.268734 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 12:13:36.268734 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 12:13:36.268734 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 12:13:36.268734 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jun 16 12:13:36.268734 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 12:13:36.268734 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jun 16 12:13:36.269609 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 12:13:36.269609 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 12:13:36.269609 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 12:13:36.269609 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jun 16 12:13:36.269609 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 235/465] 10.222.0.44 () {56 vars in 1108 bytes} [Thu Jun 16 12:13:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 12:13:36.270626 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4f9737-762d-4a0e-b788-e46b510bc850 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:36.282247 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:13:36.300687 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 231/466] 10.222.0.44 () {60 vars in 1132 bytes} [Thu Jun 16 12:13:36 2022] POST /identity/v3/users => generated 246 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 12:13:36.302071 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd0254a-3444-4461-9f68-8ec3c398dfa3 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:36.367397 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:13:36.391667 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4f9737-762d-4a0e-b788-e46b510bc850 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:36.428045 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3afd7b-1f4a-410c-894e-548e3c008b1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:36.429489 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3afd7b-1f4a-410c-894e-548e3c008b1e None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:36.429911 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3afd7b-1f4a-410c-894e-548e3c008b1e None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:36.430190 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3afd7b-1f4a-410c-894e-548e3c008b1e None admin] PATH_INFO: `/v3/domains` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:36.430713 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd0254a-3444-4461-9f68-8ec3c398dfa3 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:36.430930 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3afd7b-1f4a-410c-894e-548e3c008b1e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:13:36.431235 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3afd7b-1f4a-410c-894e-548e3c008b1e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:13:36.432734 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3afd7b-1f4a-410c-894e-548e3c008b1e None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:13:36.450556 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 236/467] 10.222.0.44 () {56 vars in 1109 bytes} [Thu Jun 16 12:13:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:13:36.452098 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7723d15a-625a-4583-9560-59c8f310b4b9 None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:36.452384 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7723d15a-625a-4583-9560-59c8f310b4b9 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:36.452651 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7723d15a-625a-4583-9560-59c8f310b4b9 None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:36.454437 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 237/468] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 12:13:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 12:13:36.455175 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7723d15a-625a-4583-9560-59c8f310b4b9 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:36.474309 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3aa3d4-ef29-4694-b013-2b7ac322a9c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:36.476037 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3aa3d4-ef29-4694-b013-2b7ac322a9c9 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:36.476511 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3aa3d4-ef29-4694-b013-2b7ac322a9c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:36.476809 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3aa3d4-ef29-4694-b013-2b7ac322a9c9 None admin] PATH_INFO: `/v3/domains` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:36.477557 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3aa3d4-ef29-4694-b013-2b7ac322a9c9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:13:36.477867 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3aa3d4-ef29-4694-b013-2b7ac322a9c9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:13:36.479433 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3aa3d4-ef29-4694-b013-2b7ac322a9c9 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:13:36.493177 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 232/469] 10.222.0.44 () {56 vars in 1109 bytes} [Thu Jun 16 12:13:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:13:36.494254 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f7ae20-7c22-4362-9830-85a31b7cd495 None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:36.494586 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f7ae20-7c22-4362-9830-85a31b7cd495 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:36.494873 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f7ae20-7c22-4362-9830-85a31b7cd495 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:36.512980 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-a7f7ae20-7c22-4362-9830-85a31b7cd495 None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:13:36.514425 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-a7f7ae20-7c22-4362-9830-85a31b7cd495 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:13:36.574040 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7723d15a-625a-4583-9560-59c8f310b4b9 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:36.585677 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:13:36.606087 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 233/470] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 12:13:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 12:13:36.606898 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f7ae20-7c22-4362-9830-85a31b7cd495 None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:36.619680 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527f2098-4bc2-495c-a05a-52ec40c4e1ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:36.620953 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527f2098-4bc2-495c-a05a-52ec40c4e1ac None admin] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:36.621417 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527f2098-4bc2-495c-a05a-52ec40c4e1ac None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:36.621837 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527f2098-4bc2-495c-a05a-52ec40c4e1ac None admin] PATH_INFO: `/v3/users` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:36.622788 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527f2098-4bc2-495c-a05a-52ec40c4e1ac None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:13:36.625243 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527f2098-4bc2-495c-a05a-52ec40c4e1ac None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:13:36.637395 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:13:36.655987 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 238/471] 10.222.0.44 () {60 vars in 1132 bytes} [Thu Jun 16 12:13:36 2022] POST /identity/v3/users => generated 248 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 12:13:36.657555 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527f2098-4bc2-495c-a05a-52ec40c4e1ac None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:36.780602 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f7ae20-7c22-4362-9830-85a31b7cd495 None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:36.787395 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527f2098-4bc2-495c-a05a-52ec40c4e1ac None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:36.830525 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dc5851-eaf5-45e4-8259-27eec45d684a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:36.831772 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dc5851-eaf5-45e4-8259-27eec45d684a None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:36.832327 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dc5851-eaf5-45e4-8259-27eec45d684a None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:36.832769 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dc5851-eaf5-45e4-8259-27eec45d684a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:36.847846 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3dc5851-eaf5-45e4-8259-27eec45d684a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:13:36.849779 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3dc5851-eaf5-45e4-8259-27eec45d684a None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:13:36.869919 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-f3dc5851-eaf5-45e4-8259-27eec45d684a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 12:13:36.869919 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 12:13:36.869919 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 12:13:36.869919 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 12:13:36.869919 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 12:13:36.869919 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 12:13:36.869919 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 12:13:36.869919 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 12:13:36.869919 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 12:13:36.869919 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 12:13:36.869919 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 12:13:36.869919 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 12:13:36.869919 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 12:13:36.869919 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 12:13:36.869919 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 12:13:36.870998 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 12:13:36.870998 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 12:13:36.870998 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 12:13:36.870998 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 12:13:36.870998 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 12:13:36.870998 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 12:13:36.870998 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 12:13:36.870998 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 12:13:36.870998 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jun 16 12:13:36.870998 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 12:13:36.870998 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jun 16 12:13:36.870998 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 12:13:36.870998 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 12:13:36.870998 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 12:13:36.870998 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jun 16 12:13:36.870998 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 12:13:36.870998 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jun 16 12:13:36.872050 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 12:13:36.872050 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 12:13:36.872050 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 12:13:36.872050 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jun 16 12:13:36.874021 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 239/472] 10.222.0.44 () {56 vars in 1108 bytes} [Thu Jun 16 12:13:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 12:13:36.874206 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3384945a-9af5-40fa-896d-095f21c25312 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:36.874897 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3384945a-9af5-40fa-896d-095f21c25312 None admin] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:36.875177 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3384945a-9af5-40fa-896d-095f21c25312 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:36.875453 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3384945a-9af5-40fa-896d-095f21c25312 None admin] PATH_INFO: `/v3/users` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:36.876168 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3384945a-9af5-40fa-896d-095f21c25312 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:13:36.879461 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3384945a-9af5-40fa-896d-095f21c25312 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:13:36.885540 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dc5851-eaf5-45e4-8259-27eec45d684a None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:36.909930 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 234/473] 10.222.0.44 () {60 vars in 1132 bytes} [Thu Jun 16 12:13:36 2022] POST /identity/v3/users => generated 248 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 12:13:36.963305 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:13:37.029076 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dc5851-eaf5-45e4-8259-27eec45d684a None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:37.068460 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb16bcb-2cf8-4ad4-8370-ccdb55df7a6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:37.069633 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb16bcb-2cf8-4ad4-8370-ccdb55df7a6e None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:37.069916 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb16bcb-2cf8-4ad4-8370-ccdb55df7a6e None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:37.070194 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb16bcb-2cf8-4ad4-8370-ccdb55df7a6e None admin] PATH_INFO: `/v3/domains` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:37.070931 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb16bcb-2cf8-4ad4-8370-ccdb55df7a6e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:13:37.071241 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb16bcb-2cf8-4ad4-8370-ccdb55df7a6e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:13:37.072718 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb16bcb-2cf8-4ad4-8370-ccdb55df7a6e None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:13:37.088457 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 240/474] 10.222.0.44 () {56 vars in 1109 bytes} [Thu Jun 16 12:13:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:13:37.093446 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3384945a-9af5-40fa-896d-095f21c25312 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:37.146222 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:13:37.214706 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3384945a-9af5-40fa-896d-095f21c25312 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:37.230903 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bccc3b7-057d-46f0-adf9-a854c1d0f863 None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:37.231219 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bccc3b7-057d-46f0-adf9-a854c1d0f863 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:37.231463 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bccc3b7-057d-46f0-adf9-a854c1d0f863 None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:37.233138 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 241/475] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 12:13:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 12:13:37.237982 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146c3808-6f56-4c65-bbd3-4e382fbf1d6d None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:37.238271 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146c3808-6f56-4c65-bbd3-4e382fbf1d6d None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:37.238553 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146c3808-6f56-4c65-bbd3-4e382fbf1d6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:37.254242 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49362f3a-f47f-4d65-bde7-d31f805db397 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:37.255137 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49362f3a-f47f-4d65-bde7-d31f805db397 None admin] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:37.255581 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49362f3a-f47f-4d65-bde7-d31f805db397 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:37.257062 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49362f3a-f47f-4d65-bde7-d31f805db397 None admin] PATH_INFO: `/v3/users` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:37.257922 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49362f3a-f47f-4d65-bde7-d31f805db397 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:13:37.259875 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49362f3a-f47f-4d65-bde7-d31f805db397 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:13:37.263360 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-146c3808-6f56-4c65-bbd3-4e382fbf1d6d None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:13:37.264554 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-146c3808-6f56-4c65-bbd3-4e382fbf1d6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:13:37.293430 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 235/476] 10.222.0.44 () {60 vars in 1132 bytes} [Thu Jun 16 12:13:37 2022] POST /identity/v3/users => generated 249 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 12:13:37.355825 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 242/477] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 12:13:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 12:13:37.379610 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49362f3a-f47f-4d65-bde7-d31f805db397 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:37.502020 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:13:37.511748 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49362f3a-f47f-4d65-bde7-d31f805db397 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:37.557034 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e157d1c2-8a9c-42f0-97a8-2193215dc041 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:37.557766 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e157d1c2-8a9c-42f0-97a8-2193215dc041 None admin] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:37.558049 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e157d1c2-8a9c-42f0-97a8-2193215dc041 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:37.558324 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e157d1c2-8a9c-42f0-97a8-2193215dc041 None admin] PATH_INFO: `/v3/roles` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:37.559148 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e157d1c2-8a9c-42f0-97a8-2193215dc041 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:13:37.560533 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e157d1c2-8a9c-42f0-97a8-2193215dc041 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:13:37.569556 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.sql.core [None req-e157d1c2-8a9c-42f0-97a8-2193215dc041 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 16 12:13:37.569556 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jun 16 12:13:37.569556 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [parameters: {'id': '379a5ea60cf84144a7f8e7df5f2d332e', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jun 16 12:13:37.569556 dv-cinder-846149-2-smb devstack@keystone.service[80075]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80075) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 16 12:13:37.586935 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application [None req-e157d1c2-8a9c-42f0-97a8-2193215dc041 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jun 16 12:13:37.586935 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 12:13:37.586935 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 16 12:13:37.586935 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 16 12:13:37.586935 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 16 12:13:37.586935 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 16 12:13:37.586935 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 16 12:13:37.586935 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application result = self._query(query) Jun 16 12:13:37.586935 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 16 12:13:37.586935 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application conn.query(q) Jun 16 12:13:37.586935 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 16 12:13:37.586935 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 16 12:13:37.586935 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 16 12:13:37.586935 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application result.read() Jun 16 12:13:37.586935 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 16 12:13:37.588004 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 16 12:13:37.588004 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 16 12:13:37.588004 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 16 12:13:37.588004 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 16 12:13:37.588004 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 16 12:13:37.588004 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 16 12:13:37.588004 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 16 12:13:37.588004 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 16 12:13:37.588004 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application Jun 16 12:13:37.588004 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 16 12:13:37.588004 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application Jun 16 12:13:37.588004 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 12:13:37.588004 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 16 12:13:37.588004 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 16 12:13:37.588004 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Jun 16 12:13:37.588004 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return ref.to_dict() Jun 16 12:13:37.588004 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 16 12:13:37.588004 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application next(self.gen) Jun 16 12:13:37.589348 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 16 12:13:37.589348 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application yield resource Jun 16 12:13:37.589348 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 16 12:13:37.589348 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application next(self.gen) Jun 16 12:13:37.589348 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 16 12:13:37.589348 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application self.session.rollback() Jun 16 12:13:37.589348 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 16 12:13:37.589348 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application self.force_reraise() Jun 16 12:13:37.589348 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 16 12:13:37.589348 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application raise self.value Jun 16 12:13:37.589348 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 16 12:13:37.589348 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 16 12:13:37.589348 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 16 12:13:37.589348 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application session.commit() Jun 16 12:13:37.589348 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 16 12:13:37.589348 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 16 12:13:37.589348 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 16 12:13:37.590261 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application self._prepare_impl() Jun 16 12:13:37.590261 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 16 12:13:37.590261 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application self.session.flush() Jun 16 12:13:37.590261 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 16 12:13:37.590261 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application self._flush(objects) Jun 16 12:13:37.590261 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 16 12:13:37.590261 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 16 12:13:37.590261 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 16 12:13:37.590261 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application compat.raise_( Jun 16 12:13:37.590261 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 16 12:13:37.590261 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application raise exception Jun 16 12:13:37.590261 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 16 12:13:37.590261 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application flush_context.execute() Jun 16 12:13:37.590261 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 16 12:13:37.590261 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application rec.execute(self) Jun 16 12:13:37.590261 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 16 12:13:37.590261 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 16 12:13:37.591158 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 16 12:13:37.591158 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 16 12:13:37.591158 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jun 16 12:13:37.591158 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application c = connection._execute_20( Jun 16 12:13:37.591158 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 16 12:13:37.591158 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 16 12:13:37.591158 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 16 12:13:37.591158 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 16 12:13:37.591158 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 16 12:13:37.591158 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 16 12:13:37.591158 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 16 12:13:37.591158 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 16 12:13:37.591158 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 16 12:13:37.591158 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 16 12:13:37.591158 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 16 12:13:37.591158 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application raise exception Jun 16 12:13:37.591965 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 16 12:13:37.591965 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 16 12:13:37.591965 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 16 12:13:37.591965 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 16 12:13:37.591965 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 16 12:13:37.591965 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application result = self._query(query) Jun 16 12:13:37.591965 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 16 12:13:37.591965 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application conn.query(q) Jun 16 12:13:37.591965 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 16 12:13:37.591965 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 16 12:13:37.591965 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 16 12:13:37.591965 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application result.read() Jun 16 12:13:37.591965 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 16 12:13:37.591965 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 16 12:13:37.591965 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 16 12:13:37.591965 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 16 12:13:37.593690 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 16 12:13:37.593690 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 16 12:13:37.593690 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 16 12:13:37.593690 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 16 12:13:37.593690 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 16 12:13:37.593690 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jun 16 12:13:37.593690 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application [parameters: {'id': '379a5ea60cf84144a7f8e7df5f2d332e', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jun 16 12:13:37.593690 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 16 12:13:37.593690 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application Jun 16 12:13:37.593690 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 12:13:37.593690 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application Jun 16 12:13:37.593690 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 12:13:37.593690 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 12:13:37.593690 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 12:13:37.593690 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 12:13:37.593690 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 12:13:37.595616 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 12:13:37.595616 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 12:13:37.595616 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 12:13:37.595616 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 12:13:37.595616 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 12:13:37.595616 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 12:13:37.595616 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Jun 16 12:13:37.595616 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Jun 16 12:13:37.595616 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 12:13:37.595616 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 12:13:37.595616 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Jun 16 12:13:37.595616 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Jun 16 12:13:37.595616 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 16 12:13:37.595616 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 16 12:13:37.595616 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jun 16 12:13:37.595616 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application Jun 16 12:13:37.597726 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 236/478] 10.222.0.44 () {60 vars in 1131 bytes} [Thu Jun 16 12:13:37 2022] POST /identity/v3/roles => generated 144 bytes in 209 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jun 16 12:13:37.597862 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146c3808-6f56-4c65-bbd3-4e382fbf1d6d None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:37.639872 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:13:37.709671 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146c3808-6f56-4c65-bbd3-4e382fbf1d6d None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:37.745394 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466cfa92-48d0-4acf-a4d1-33f7b56a8f20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:37.746213 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466cfa92-48d0-4acf-a4d1-33f7b56a8f20 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:37.746532 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466cfa92-48d0-4acf-a4d1-33f7b56a8f20 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:37.746780 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466cfa92-48d0-4acf-a4d1-33f7b56a8f20 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:37.759014 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466cfa92-48d0-4acf-a4d1-33f7b56a8f20 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 12:13:37.767300 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-466cfa92-48d0-4acf-a4d1-33f7b56a8f20 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 12:13:37.767300 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 12:13:37.767300 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 12:13:37.767300 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 12:13:37.767300 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 12:13:37.767300 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 12:13:37.767300 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 12:13:37.767300 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 12:13:37.767300 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 12:13:37.767300 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 12:13:37.767300 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 12:13:37.767300 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 12:13:37.767300 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 12:13:37.767300 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 12:13:37.767300 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 12:13:37.767300 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 12:13:37.769384 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 12:13:37.769384 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 12:13:37.769384 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 12:13:37.769384 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 12:13:37.769384 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 12:13:37.769384 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 12:13:37.769384 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 12:13:37.769384 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 12:13:37.769384 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 12:13:37.769384 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 12:13:37.769384 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 12:13:37.769384 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jun 16 12:13:37.769384 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 12:13:37.769384 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jun 16 12:13:37.769384 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 12:13:37.769384 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 12:13:37.771442 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 12:13:37.771442 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jun 16 12:13:37.771442 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 12:13:37.771442 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jun 16 12:13:37.771442 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 12:13:37.771442 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 12:13:37.771442 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 12:13:37.771442 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 12:13:37.771442 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 12:13:37.771442 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 12:13:37.771442 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 12:13:37.771442 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jun 16 12:13:37.771442 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 243/479] 10.222.0.44 () {56 vars in 1114 bytes} [Thu Jun 16 12:13:37 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 12:13:37.774866 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e157d1c2-8a9c-42f0-97a8-2193215dc041 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:37.885047 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e157d1c2-8a9c-42f0-97a8-2193215dc041 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:37.924498 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb62d6f-e822-439c-941a-74a411ec076e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:37.925192 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb62d6f-e822-439c-941a-74a411ec076e None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:37.925475 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb62d6f-e822-439c-941a-74a411ec076e None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:37.925753 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb62d6f-e822-439c-941a-74a411ec076e None admin] PATH_INFO: `/v3/roles` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:37.926513 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb62d6f-e822-439c-941a-74a411ec076e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:13:37.926825 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb62d6f-e822-439c-941a-74a411ec076e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:13:37.928328 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb62d6f-e822-439c-941a-74a411ec076e None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:13:37.937680 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 237/480] 10.222.0.44 () {56 vars in 1111 bytes} [Thu Jun 16 12:13:37 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:13:38.787046 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cf3cb0-5a92-4dbb-960a-81ff9c193901 None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:38.787623 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cf3cb0-5a92-4dbb-960a-81ff9c193901 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:38.787623 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cf3cb0-5a92-4dbb-960a-81ff9c193901 None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:38.789040 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 244/481] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 12:13:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 12:13:38.794488 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb38c74d-4fc2-48ae-a821-6cb22a3ca831 None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:38.794870 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb38c74d-4fc2-48ae-a821-6cb22a3ca831 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:38.795065 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb38c74d-4fc2-48ae-a821-6cb22a3ca831 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:38.821400 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-eb38c74d-4fc2-48ae-a821-6cb22a3ca831 None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:13:38.822882 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-eb38c74d-4fc2-48ae-a821-6cb22a3ca831 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:13:38.850008 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:13:38.910046 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 238/482] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 12:13:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 12:13:38.943319 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cf3cb0-5a92-4dbb-960a-81ff9c193901 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:39.078479 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:13:39.086727 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cf3cb0-5a92-4dbb-960a-81ff9c193901 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:39.123681 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49193ca2-004f-4a25-bf32-e229b31dd41c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:39.124477 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49193ca2-004f-4a25-bf32-e229b31dd41c None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:39.124772 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49193ca2-004f-4a25-bf32-e229b31dd41c None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:39.125051 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49193ca2-004f-4a25-bf32-e229b31dd41c None admin] PATH_INFO: `/v3/roles/service` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:39.135484 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49193ca2-004f-4a25-bf32-e229b31dd41c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 12:13:39.143213 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-49193ca2-004f-4a25-bf32-e229b31dd41c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 16 12:13:39.143213 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 12:13:39.143213 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 12:13:39.143213 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 12:13:39.143213 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 12:13:39.143213 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 12:13:39.143213 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 12:13:39.143213 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 12:13:39.143213 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 12:13:39.143213 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 12:13:39.143213 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 12:13:39.143213 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 12:13:39.143213 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 12:13:39.143213 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 12:13:39.143213 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 12:13:39.143213 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 12:13:39.144084 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 12:13:39.144084 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 12:13:39.144084 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 12:13:39.144084 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 12:13:39.144084 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 12:13:39.144084 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 12:13:39.144084 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 12:13:39.144084 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 12:13:39.144084 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 12:13:39.144084 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 12:13:39.144084 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 12:13:39.144084 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jun 16 12:13:39.144084 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 12:13:39.144084 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jun 16 12:13:39.144084 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 12:13:39.144084 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 12:13:39.144898 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 12:13:39.144898 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jun 16 12:13:39.144898 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 12:13:39.144898 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jun 16 12:13:39.144898 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 12:13:39.144898 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 12:13:39.144898 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 12:13:39.144898 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 12:13:39.144898 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 12:13:39.144898 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 12:13:39.144898 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 16 12:13:39.144898 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jun 16 12:13:39.144898 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 245/483] 10.222.0.44 () {56 vars in 1102 bytes} [Thu Jun 16 12:13:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 12:13:39.150488 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb38c74d-4fc2-48ae-a821-6cb22a3ca831 None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:39.254960 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb38c74d-4fc2-48ae-a821-6cb22a3ca831 None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:39.293772 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4dc0d5f-b29d-4b89-8d34-75f986c66aeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:39.294702 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dc0d5f-b29d-4b89-8d34-75f986c66aeb None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:39.294987 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dc0d5f-b29d-4b89-8d34-75f986c66aeb None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:39.295262 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dc0d5f-b29d-4b89-8d34-75f986c66aeb None admin] PATH_INFO: `/v3/roles` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:39.296023 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4dc0d5f-b29d-4b89-8d34-75f986c66aeb None admin] RBAC: Adding query filter params (name=service) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:13:39.296330 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4dc0d5f-b29d-4b89-8d34-75f986c66aeb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:13:39.297726 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4dc0d5f-b29d-4b89-8d34-75f986c66aeb None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:13:39.307245 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 239/484] 10.222.0.44 () {56 vars in 1103 bytes} [Thu Jun 16 12:13:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:13:39.312743 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49193ca2-004f-4a25-bf32-e229b31dd41c None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:39.456942 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49193ca2-004f-4a25-bf32-e229b31dd41c None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:39.506902 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a109a1e-c556-4224-bd86-b8f15f92e173 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:39.508116 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a109a1e-c556-4224-bd86-b8f15f92e173 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:39.508599 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a109a1e-c556-4224-bd86-b8f15f92e173 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:39.509100 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a109a1e-c556-4224-bd86-b8f15f92e173 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:39.531339 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a109a1e-c556-4224-bd86-b8f15f92e173 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:13:39.533250 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a109a1e-c556-4224-bd86-b8f15f92e173 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:13:39.552650 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-8a109a1e-c556-4224-bd86-b8f15f92e173 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 12:13:39.552650 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 12:13:39.552650 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 12:13:39.552650 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 12:13:39.552650 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 12:13:39.552650 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 12:13:39.552650 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 12:13:39.552650 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 12:13:39.552650 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 12:13:39.552650 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 12:13:39.552650 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 12:13:39.552650 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 12:13:39.552650 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 12:13:39.552650 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 12:13:39.552650 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 12:13:39.553616 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 12:13:39.553616 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 12:13:39.553616 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 12:13:39.553616 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 12:13:39.553616 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 12:13:39.553616 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 12:13:39.553616 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 12:13:39.553616 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 12:13:39.553616 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jun 16 12:13:39.553616 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 12:13:39.553616 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jun 16 12:13:39.553616 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 12:13:39.553616 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 12:13:39.553616 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 12:13:39.553616 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jun 16 12:13:39.553616 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 12:13:39.553616 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jun 16 12:13:39.554535 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 12:13:39.554535 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 12:13:39.554535 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 12:13:39.554535 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jun 16 12:13:39.556848 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 246/485] 10.222.0.44 () {56 vars in 1108 bytes} [Thu Jun 16 12:13:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 12:13:39.564778 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4dc0d5f-b29d-4b89-8d34-75f986c66aeb None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:39.589155 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:13:39.594571 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97abcdcd-fd68-44d3-9fd8-ac187392f9ea None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:39.595094 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97abcdcd-fd68-44d3-9fd8-ac187392f9ea None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:39.595568 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97abcdcd-fd68-44d3-9fd8-ac187392f9ea None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:39.597193 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 247/486] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 12:13:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 12:13:39.602863 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea905b1-b628-484a-a4e9-14db8a5efff7 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:39.603416 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea905b1-b628-484a-a4e9-14db8a5efff7 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:39.603889 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea905b1-b628-484a-a4e9-14db8a5efff7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:39.637968 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-1ea905b1-b628-484a-a4e9-14db8a5efff7 None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:13:39.641704 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-1ea905b1-b628-484a-a4e9-14db8a5efff7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:13:39.648090 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:13:39.720690 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4dc0d5f-b29d-4b89-8d34-75f986c66aeb None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:39.745301 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 248/487] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 12:13:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 12:13:39.746635 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71df36c-4230-4384-9490-0a9b3cbf14b9 None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:39.746920 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71df36c-4230-4384-9490-0a9b3cbf14b9 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:39.747196 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71df36c-4230-4384-9490-0a9b3cbf14b9 None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:39.748703 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 249/488] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 12:13:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 12:13:39.753823 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f078810c-c3af-4501-a747-8fe7284cefdf None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:39.754243 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f078810c-c3af-4501-a747-8fe7284cefdf None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:39.754617 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f078810c-c3af-4501-a747-8fe7284cefdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:39.769960 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577789c3-196e-41ce-8cac-04b0b3d70251 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:39.770623 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577789c3-196e-41ce-8cac-04b0b3d70251 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:39.770905 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577789c3-196e-41ce-8cac-04b0b3d70251 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:39.771176 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577789c3-196e-41ce-8cac-04b0b3d70251 None admin] PATH_INFO: `/v3/domains` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:39.772320 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-f078810c-c3af-4501-a747-8fe7284cefdf None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:13:39.772446 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577789c3-196e-41ce-8cac-04b0b3d70251 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:13:39.772727 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577789c3-196e-41ce-8cac-04b0b3d70251 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:13:39.773820 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-f078810c-c3af-4501-a747-8fe7284cefdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:13:39.774142 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577789c3-196e-41ce-8cac-04b0b3d70251 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:13:39.794607 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 240/489] 10.222.0.44 () {56 vars in 1109 bytes} [Thu Jun 16 12:13:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:13:39.795627 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577789c3-196e-41ce-8cac-04b0b3d70251 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:39.845209 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 250/490] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 12:13:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 12:13:39.846168 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f078810c-c3af-4501-a747-8fe7284cefdf None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:39.876857 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:13:39.906278 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577789c3-196e-41ce-8cac-04b0b3d70251 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:39.923078 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:13:39.955901 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cb1714-e0ff-481a-91b0-035d289959c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:39.956698 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cb1714-e0ff-481a-91b0-035d289959c0 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:39.957032 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cb1714-e0ff-481a-91b0-035d289959c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:39.957411 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cb1714-e0ff-481a-91b0-035d289959c0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:39.961671 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f078810c-c3af-4501-a747-8fe7284cefdf None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:39.968394 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cb1714-e0ff-481a-91b0-035d289959c0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 12:13:39.977189 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application [None req-34cb1714-e0ff-481a-91b0-035d289959c0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 16 12:13:39.977189 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 12:13:39.977189 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 12:13:39.977189 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 12:13:39.977189 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 12:13:39.977189 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 12:13:39.977189 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 12:13:39.977189 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 12:13:39.977189 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 12:13:39.977189 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 12:13:39.977189 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 12:13:39.977189 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 12:13:39.977189 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 12:13:39.977189 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 12:13:39.977189 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 12:13:39.977189 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 12:13:39.978061 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 12:13:39.978061 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 12:13:39.978061 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 12:13:39.978061 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 12:13:39.978061 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 12:13:39.978061 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 12:13:39.978061 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 12:13:39.978061 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 12:13:39.978061 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 12:13:39.978061 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 12:13:39.978061 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 12:13:39.978061 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application with Lock( Jun 16 12:13:39.978061 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 12:13:39.978061 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._enter() Jun 16 12:13:39.978061 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 12:13:39.978061 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 12:13:39.978844 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 12:13:39.978844 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.creator() Jun 16 12:13:39.978844 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 12:13:39.978844 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application created_value = creator( Jun 16 12:13:39.978844 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 12:13:39.978844 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 12:13:39.978844 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 12:13:39.978844 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 12:13:39.978844 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 12:13:39.978844 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 12:13:39.978844 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 16 12:13:39.978844 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application Jun 16 12:13:39.978844 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 241/491] 10.222.0.44 () {56 vars in 1102 bytes} [Thu Jun 16 12:13:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 12:13:39.979477 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cb1714-e0ff-481a-91b0-035d289959c0 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:40.007606 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7fa8a4-9cb6-4567-ab3e-09f2bbfbfb28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:40.008811 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7fa8a4-9cb6-4567-ab3e-09f2bbfbfb28 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:40.009258 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7fa8a4-9cb6-4567-ab3e-09f2bbfbfb28 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:40.009669 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7fa8a4-9cb6-4567-ab3e-09f2bbfbfb28 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:40.017925 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7fa8a4-9cb6-4567-ab3e-09f2bbfbfb28 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:13:40.019626 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7fa8a4-9cb6-4567-ab3e-09f2bbfbfb28 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:13:40.037055 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-2f7fa8a4-9cb6-4567-ab3e-09f2bbfbfb28 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 16 12:13:40.037055 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 12:13:40.037055 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 12:13:40.037055 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 12:13:40.037055 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 12:13:40.037055 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 12:13:40.037055 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 12:13:40.037055 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 12:13:40.037055 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 12:13:40.037055 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 12:13:40.037055 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 12:13:40.037055 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 12:13:40.037055 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 12:13:40.037055 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 12:13:40.037055 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 12:13:40.037055 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 12:13:40.038707 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 12:13:40.038707 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 12:13:40.038707 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 12:13:40.038707 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 12:13:40.038707 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 12:13:40.038707 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 12:13:40.038707 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 12:13:40.038707 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 12:13:40.038707 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 12:13:40.038707 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 12:13:40.038707 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 12:13:40.038707 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jun 16 12:13:40.038707 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 12:13:40.038707 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jun 16 12:13:40.038707 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 12:13:40.038707 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 12:13:40.038707 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 12:13:40.038707 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jun 16 12:13:40.039605 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 12:13:40.039605 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jun 16 12:13:40.039605 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 12:13:40.039605 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 12:13:40.039605 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 12:13:40.039605 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 12:13:40.039605 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 12:13:40.039605 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 12:13:40.039605 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 16 12:13:40.039605 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jun 16 12:13:40.041847 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 251/492] 10.222.0.44 () {56 vars in 1093 bytes} [Thu Jun 16 12:13:39 2022] GET /identity/v3/users/nova => generated 82 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 12:13:40.043077 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7fa8a4-9cb6-4567-ab3e-09f2bbfbfb28 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:40.090072 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cb1714-e0ff-481a-91b0-035d289959c0 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:40.127538 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0890e420-945c-4472-9a4a-5d7f62e46976 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:40.128803 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0890e420-945c-4472-9a4a-5d7f62e46976 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:40.129119 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0890e420-945c-4472-9a4a-5d7f62e46976 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:40.129370 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0890e420-945c-4472-9a4a-5d7f62e46976 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:40.131666 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:13:40.141383 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0890e420-945c-4472-9a4a-5d7f62e46976 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 12:13:40.149883 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application [None req-0890e420-945c-4472-9a4a-5d7f62e46976 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 16 12:13:40.149883 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 12:13:40.149883 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 12:13:40.149883 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 12:13:40.149883 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 12:13:40.149883 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 12:13:40.149883 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 12:13:40.149883 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 12:13:40.149883 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 12:13:40.149883 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 12:13:40.149883 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 12:13:40.149883 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 12:13:40.149883 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 12:13:40.149883 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 12:13:40.149883 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 12:13:40.149883 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 12:13:40.150753 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 12:13:40.150753 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 12:13:40.150753 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 12:13:40.150753 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 12:13:40.150753 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 12:13:40.150753 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 12:13:40.150753 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 12:13:40.150753 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 12:13:40.150753 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 12:13:40.150753 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 12:13:40.150753 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 12:13:40.150753 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application with Lock( Jun 16 12:13:40.150753 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 12:13:40.150753 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._enter() Jun 16 12:13:40.150753 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 12:13:40.150753 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 12:13:40.151534 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 12:13:40.151534 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.creator() Jun 16 12:13:40.151534 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 12:13:40.151534 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application created_value = creator( Jun 16 12:13:40.151534 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 12:13:40.151534 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 12:13:40.151534 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 12:13:40.151534 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 12:13:40.151534 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 12:13:40.151534 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 12:13:40.151534 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 16 12:13:40.151534 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application Jun 16 12:13:40.151534 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 242/493] 10.222.0.44 () {56 vars in 1102 bytes} [Thu Jun 16 12:13:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 12:13:40.153143 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0890e420-945c-4472-9a4a-5d7f62e46976 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:40.158432 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7fa8a4-9cb6-4567-ab3e-09f2bbfbfb28 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:40.186073 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:13:40.194600 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45904352-cd92-484d-8a5f-966b7f82c4cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:40.195264 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45904352-cd92-484d-8a5f-966b7f82c4cc None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:40.195545 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45904352-cd92-484d-8a5f-966b7f82c4cc None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:40.195819 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45904352-cd92-484d-8a5f-966b7f82c4cc None admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:40.196563 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45904352-cd92-484d-8a5f-966b7f82c4cc None admin] RBAC: Adding query filter params (name=service) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:13:40.196909 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45904352-cd92-484d-8a5f-966b7f82c4cc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:13:40.198306 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45904352-cd92-484d-8a5f-966b7f82c4cc None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:13:40.206296 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 252/494] 10.222.0.44 () {56 vars in 1103 bytes} [Thu Jun 16 12:13:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:13:40.207485 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9681b139-c904-465e-a5d4-35fed46217ac None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:40.207767 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9681b139-c904-465e-a5d4-35fed46217ac None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:40.208044 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9681b139-c904-465e-a5d4-35fed46217ac None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:40.209970 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 253/495] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 12:13:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 12:13:40.210501 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9681b139-c904-465e-a5d4-35fed46217ac None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:40.264620 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0890e420-945c-4472-9a4a-5d7f62e46976 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:40.301512 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a7e9fc-065f-4ab7-b163-891ebcf327c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:40.302508 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a7e9fc-065f-4ab7-b163-891ebcf327c6 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:40.302960 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a7e9fc-065f-4ab7-b163-891ebcf327c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:40.303397 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a7e9fc-065f-4ab7-b163-891ebcf327c6 None admin] PATH_INFO: `/v3/users` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:40.304371 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a7e9fc-065f-4ab7-b163-891ebcf327c6 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:13:40.304856 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a7e9fc-065f-4ab7-b163-891ebcf327c6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:13:40.306278 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a7e9fc-065f-4ab7-b163-891ebcf327c6 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:13:40.314822 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9681b139-c904-465e-a5d4-35fed46217ac None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:40.345348 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 243/496] 10.222.0.44 () {56 vars in 1133 bytes} [Thu Jun 16 12:13:40 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:13:40.346555 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a7e9fc-065f-4ab7-b163-891ebcf327c6 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:40.356854 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658d608f-5f78-4cb8-b85e-8a95b235e49b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:40.357529 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658d608f-5f78-4cb8-b85e-8a95b235e49b None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:40.357819 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658d608f-5f78-4cb8-b85e-8a95b235e49b None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:40.358094 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658d608f-5f78-4cb8-b85e-8a95b235e49b None admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:40.358898 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658d608f-5f78-4cb8-b85e-8a95b235e49b None admin] RBAC: Adding query filter params (name=service) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:13:40.359144 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658d608f-5f78-4cb8-b85e-8a95b235e49b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:13:40.360530 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658d608f-5f78-4cb8-b85e-8a95b235e49b None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:13:40.373477 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 254/497] 10.222.0.44 () {56 vars in 1103 bytes} [Thu Jun 16 12:13:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:13:40.373477 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98083f2b-4a58-454a-abcd-ccdcc8698ad5 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:40.373477 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98083f2b-4a58-454a-abcd-ccdcc8698ad5 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:40.373477 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98083f2b-4a58-454a-abcd-ccdcc8698ad5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:40.390152 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-98083f2b-4a58-454a-abcd-ccdcc8698ad5 None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:13:40.391371 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-98083f2b-4a58-454a-abcd-ccdcc8698ad5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:13:40.407303 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:13:40.443237 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:13:40.457376 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a7e9fc-065f-4ab7-b163-891ebcf327c6 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:40.477021 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 255/498] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 12:13:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 12:13:40.477815 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98083f2b-4a58-454a-abcd-ccdcc8698ad5 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:40.494094 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7931eaec-c1ca-4cd2-92d5-64058a8da060 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:40.494899 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7931eaec-c1ca-4cd2-92d5-64058a8da060 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:40.495179 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7931eaec-c1ca-4cd2-92d5-64058a8da060 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:40.495452 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7931eaec-c1ca-4cd2-92d5-64058a8da060 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:40.506539 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7931eaec-c1ca-4cd2-92d5-64058a8da060 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:13:40.508032 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7931eaec-c1ca-4cd2-92d5-64058a8da060 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:13:40.528319 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application [None req-7931eaec-c1ca-4cd2-92d5-64058a8da060 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 12:13:40.528319 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 12:13:40.528319 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 12:13:40.528319 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 12:13:40.528319 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 12:13:40.528319 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 12:13:40.528319 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 12:13:40.528319 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 12:13:40.528319 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 12:13:40.528319 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 12:13:40.528319 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 12:13:40.528319 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 12:13:40.528319 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 12:13:40.528319 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 12:13:40.528319 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 12:13:40.529313 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 12:13:40.529313 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 12:13:40.529313 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 12:13:40.529313 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 12:13:40.529313 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 12:13:40.529313 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 12:13:40.529313 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 12:13:40.529313 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 12:13:40.529313 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application with Lock( Jun 16 12:13:40.529313 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 12:13:40.529313 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._enter() Jun 16 12:13:40.529313 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 12:13:40.529313 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 12:13:40.529313 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 12:13:40.529313 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.creator() Jun 16 12:13:40.529313 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 12:13:40.529313 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application created_value = creator( Jun 16 12:13:40.530177 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 12:13:40.530177 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 12:13:40.530177 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 12:13:40.530177 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application Jun 16 12:13:40.530177 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 244/499] 10.222.0.44 () {56 vars in 1108 bytes} [Thu Jun 16 12:13:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 12:13:40.530430 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7931eaec-c1ca-4cd2-92d5-64058a8da060 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:40.588303 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98083f2b-4a58-454a-abcd-ccdcc8698ad5 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:40.623809 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8afb8a-127b-46ff-b63b-b4271ecbd407 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:40.624445 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8afb8a-127b-46ff-b63b-b4271ecbd407 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:40.624721 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8afb8a-127b-46ff-b63b-b4271ecbd407 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:40.625016 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8afb8a-127b-46ff-b63b-b4271ecbd407 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:40.640950 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7931eaec-c1ca-4cd2-92d5-64058a8da060 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:40.644212 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:13:40.681906 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:13:40.682098 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11289aba-8560-4d93-9ddc-c9d52a365cc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:40.683032 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11289aba-8560-4d93-9ddc-c9d52a365cc8 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:40.683413 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11289aba-8560-4d93-9ddc-c9d52a365cc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:40.683786 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11289aba-8560-4d93-9ddc-c9d52a365cc8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:40.696592 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11289aba-8560-4d93-9ddc-c9d52a365cc8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:13:40.698207 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11289aba-8560-4d93-9ddc-c9d52a365cc8 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:13:40.702952 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8afb8a-127b-46ff-b63b-b4271ecbd407 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:13:40.704411 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8afb8a-127b-46ff-b63b-b4271ecbd407 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:13:40.716442 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application [None req-11289aba-8560-4d93-9ddc-c9d52a365cc8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 12:13:40.716442 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 12:13:40.716442 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 12:13:40.716442 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 12:13:40.716442 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 12:13:40.716442 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 12:13:40.716442 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 12:13:40.716442 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 12:13:40.716442 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 12:13:40.716442 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 12:13:40.716442 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 12:13:40.716442 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 12:13:40.716442 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 12:13:40.716442 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 12:13:40.716442 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 12:13:40.717492 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 12:13:40.717492 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 12:13:40.717492 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 12:13:40.717492 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 12:13:40.717492 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 12:13:40.717492 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 12:13:40.717492 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 12:13:40.717492 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 12:13:40.717492 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application with Lock( Jun 16 12:13:40.717492 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 12:13:40.717492 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._enter() Jun 16 12:13:40.717492 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 12:13:40.717492 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 12:13:40.717492 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 12:13:40.717492 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.creator() Jun 16 12:13:40.717492 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 12:13:40.717492 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application created_value = creator( Jun 16 12:13:40.718525 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 12:13:40.718525 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 12:13:40.718525 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 12:13:40.718525 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application Jun 16 12:13:40.719326 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 245/500] 10.222.0.44 () {56 vars in 1108 bytes} [Thu Jun 16 12:13:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 12:13:40.723938 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11289aba-8560-4d93-9ddc-c9d52a365cc8 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:40.815232 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 256/501] 10.222.0.44 () {58 vars in 1282 bytes} [Thu Jun 16 12:13:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 12:13:40.815232 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8afb8a-127b-46ff-b63b-b4271ecbd407 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:40.833694 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11289aba-8560-4d93-9ddc-c9d52a365cc8 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:40.868583 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2538eee4-508b-42b1-a356-f737745ef5d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:40.869435 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2538eee4-508b-42b1-a356-f737745ef5d9 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:40.869718 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2538eee4-508b-42b1-a356-f737745ef5d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:40.869994 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2538eee4-508b-42b1-a356-f737745ef5d9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:40.882323 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2538eee4-508b-42b1-a356-f737745ef5d9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 12:13:40.890389 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application [None req-2538eee4-508b-42b1-a356-f737745ef5d9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 16 12:13:40.890389 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 12:13:40.890389 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 12:13:40.890389 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 12:13:40.890389 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 12:13:40.890389 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 12:13:40.890389 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 12:13:40.890389 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 12:13:40.890389 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 12:13:40.890389 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 12:13:40.890389 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 12:13:40.890389 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 12:13:40.890389 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 12:13:40.890389 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 12:13:40.890389 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 12:13:40.890389 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 12:13:40.891379 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 12:13:40.891379 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 12:13:40.891379 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 12:13:40.891379 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 12:13:40.891379 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 12:13:40.891379 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 12:13:40.891379 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 12:13:40.891379 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 12:13:40.891379 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 12:13:40.891379 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 12:13:40.891379 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 12:13:40.891379 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application with Lock( Jun 16 12:13:40.891379 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 12:13:40.891379 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._enter() Jun 16 12:13:40.891379 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 12:13:40.891379 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 12:13:40.892167 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 12:13:40.892167 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.creator() Jun 16 12:13:40.892167 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 12:13:40.892167 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application created_value = creator( Jun 16 12:13:40.892167 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 12:13:40.892167 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 12:13:40.892167 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 12:13:40.892167 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 12:13:40.892167 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 12:13:40.892167 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 12:13:40.892167 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 16 12:13:40.892167 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application Jun 16 12:13:40.892167 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 246/502] 10.222.0.44 () {56 vars in 1102 bytes} [Thu Jun 16 12:13:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 12:13:40.892850 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2538eee4-508b-42b1-a356-f737745ef5d9 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:40.904339 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:13:40.914312 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:13:40.930861 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8afb8a-127b-46ff-b63b-b4271ecbd407 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:40.967772 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5df10dd-71c8-4cbb-9d8b-11948acb0889 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:40.968432 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5df10dd-71c8-4cbb-9d8b-11948acb0889 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:40.968708 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5df10dd-71c8-4cbb-9d8b-11948acb0889 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:40.969014 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5df10dd-71c8-4cbb-9d8b-11948acb0889 None admin] PATH_INFO: `/v3/domains` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:40.969733 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5df10dd-71c8-4cbb-9d8b-11948acb0889 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:13:40.970037 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5df10dd-71c8-4cbb-9d8b-11948acb0889 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:13:40.971417 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5df10dd-71c8-4cbb-9d8b-11948acb0889 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:13:40.982369 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 257/503] 10.222.0.44 () {56 vars in 1109 bytes} [Thu Jun 16 12:13:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:13:40.983134 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5df10dd-71c8-4cbb-9d8b-11948acb0889 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:40.999955 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2538eee4-508b-42b1-a356-f737745ef5d9 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:41.032589 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d388cca8-7086-4bf2-88cc-4129e01cc45c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:41.033285 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d388cca8-7086-4bf2-88cc-4129e01cc45c None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:41.033567 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d388cca8-7086-4bf2-88cc-4129e01cc45c None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:41.033841 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d388cca8-7086-4bf2-88cc-4129e01cc45c None admin] PATH_INFO: `/v3/domains` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:41.034608 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d388cca8-7086-4bf2-88cc-4129e01cc45c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:13:41.034857 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d388cca8-7086-4bf2-88cc-4129e01cc45c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:13:41.036224 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d388cca8-7086-4bf2-88cc-4129e01cc45c None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:13:41.048393 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 247/504] 10.222.0.44 () {56 vars in 1109 bytes} [Thu Jun 16 12:13:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:13:41.049218 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d388cca8-7086-4bf2-88cc-4129e01cc45c None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:41.080952 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5df10dd-71c8-4cbb-9d8b-11948acb0889 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:41.112813 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96f0dbd-a343-4f04-8819-e8dfb167ba4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:41.113592 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96f0dbd-a343-4f04-8819-e8dfb167ba4b None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:41.113865 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96f0dbd-a343-4f04-8819-e8dfb167ba4b None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:41.114136 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96f0dbd-a343-4f04-8819-e8dfb167ba4b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:41.122951 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:13:41.125680 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96f0dbd-a343-4f04-8819-e8dfb167ba4b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:13:41.127126 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96f0dbd-a343-4f04-8819-e8dfb167ba4b None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:13:41.128874 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:13:41.145438 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-a96f0dbd-a343-4f04-8819-e8dfb167ba4b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 12:13:41.145438 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 12:13:41.145438 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 12:13:41.145438 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 12:13:41.145438 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 12:13:41.145438 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 12:13:41.145438 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 12:13:41.145438 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 12:13:41.145438 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 12:13:41.145438 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 12:13:41.145438 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 12:13:41.145438 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 12:13:41.145438 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 12:13:41.145438 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 12:13:41.145438 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 12:13:41.146291 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 12:13:41.146291 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 12:13:41.146291 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 12:13:41.146291 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 12:13:41.146291 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 12:13:41.146291 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 12:13:41.146291 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 12:13:41.146291 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 12:13:41.146291 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jun 16 12:13:41.146291 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 12:13:41.146291 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jun 16 12:13:41.146291 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 12:13:41.146291 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 12:13:41.146291 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 12:13:41.146291 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jun 16 12:13:41.146291 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 12:13:41.146291 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jun 16 12:13:41.147150 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 12:13:41.147150 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 12:13:41.147150 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 12:13:41.147150 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jun 16 12:13:41.147448 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d388cca8-7086-4bf2-88cc-4129e01cc45c None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:41.147517 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 258/505] 10.222.0.44 () {56 vars in 1108 bytes} [Thu Jun 16 12:13:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 12:13:41.147833 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb97527d-27b3-45e9-b762-d3e20f32771f None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:41.148109 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb97527d-27b3-45e9-b762-d3e20f32771f None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:41.148380 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb97527d-27b3-45e9-b762-d3e20f32771f None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:41.149655 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 259/506] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 12:13:41 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 12:13:41.150339 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb97527d-27b3-45e9-b762-d3e20f32771f None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:41.182430 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcab73a9-0f15-4d8e-a7f3-c3fe635a9b64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:41.183089 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcab73a9-0f15-4d8e-a7f3-c3fe635a9b64 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:41.183364 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcab73a9-0f15-4d8e-a7f3-c3fe635a9b64 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:41.183633 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcab73a9-0f15-4d8e-a7f3-c3fe635a9b64 None admin] PATH_INFO: `/v3/roles` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:41.184370 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcab73a9-0f15-4d8e-a7f3-c3fe635a9b64 None admin] RBAC: Adding query filter params (name=service) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:13:41.184674 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcab73a9-0f15-4d8e-a7f3-c3fe635a9b64 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:13:41.186059 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcab73a9-0f15-4d8e-a7f3-c3fe635a9b64 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:13:41.194399 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 248/507] 10.222.0.44 () {56 vars in 1103 bytes} [Thu Jun 16 12:13:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:13:41.195191 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcab73a9-0f15-4d8e-a7f3-c3fe635a9b64 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:41.250893 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb97527d-27b3-45e9-b762-d3e20f32771f None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:41.282996 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1143e983-cc3b-4584-b6aa-df16c33fd3af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:41.283777 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1143e983-cc3b-4584-b6aa-df16c33fd3af None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:41.284057 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1143e983-cc3b-4584-b6aa-df16c33fd3af None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:41.284327 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1143e983-cc3b-4584-b6aa-df16c33fd3af None admin] PATH_INFO: `/v3/users/glance` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:41.290330 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcab73a9-0f15-4d8e-a7f3-c3fe635a9b64 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:41.291790 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1143e983-cc3b-4584-b6aa-df16c33fd3af None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:13:41.293266 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1143e983-cc3b-4584-b6aa-df16c33fd3af None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:13:41.308827 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-1143e983-cc3b-4584-b6aa-df16c33fd3af None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 16 12:13:41.308827 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 12:13:41.308827 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 12:13:41.308827 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 12:13:41.308827 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 12:13:41.308827 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 12:13:41.308827 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 12:13:41.308827 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 12:13:41.308827 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 12:13:41.308827 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 12:13:41.308827 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 12:13:41.308827 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 12:13:41.308827 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 12:13:41.308827 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 12:13:41.308827 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 12:13:41.308827 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 12:13:41.309862 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 12:13:41.309862 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 12:13:41.309862 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 12:13:41.309862 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 12:13:41.309862 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 12:13:41.309862 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 12:13:41.309862 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 12:13:41.309862 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 12:13:41.309862 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 12:13:41.309862 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 12:13:41.309862 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 12:13:41.309862 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jun 16 12:13:41.309862 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 12:13:41.309862 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jun 16 12:13:41.309862 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 12:13:41.309862 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 12:13:41.309862 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 12:13:41.309862 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jun 16 12:13:41.310751 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 12:13:41.310751 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jun 16 12:13:41.310751 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 12:13:41.310751 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 12:13:41.310751 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 12:13:41.310751 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 12:13:41.310751 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 12:13:41.310751 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 12:13:41.310751 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 16 12:13:41.310751 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jun 16 12:13:41.310751 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 260/508] 10.222.0.44 () {56 vars in 1099 bytes} [Thu Jun 16 12:13:41 2022] GET /identity/v3/users/glance => generated 84 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 12:13:41.310751 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1143e983-cc3b-4584-b6aa-df16c33fd3af None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:41.325650 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfef8053-dbda-4955-8c5b-a7cf7e738d6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:41.326433 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfef8053-dbda-4955-8c5b-a7cf7e738d6f None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:41.326715 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfef8053-dbda-4955-8c5b-a7cf7e738d6f None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:41.326989 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfef8053-dbda-4955-8c5b-a7cf7e738d6f None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:41.334584 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfef8053-dbda-4955-8c5b-a7cf7e738d6f None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:13:41.335958 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfef8053-dbda-4955-8c5b-a7cf7e738d6f None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:13:41.337810 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:13:41.352965 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application [None req-cfef8053-dbda-4955-8c5b-a7cf7e738d6f None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 16 12:13:41.352965 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 12:13:41.352965 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 12:13:41.352965 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 12:13:41.352965 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 12:13:41.352965 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 12:13:41.352965 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 12:13:41.352965 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 12:13:41.352965 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 12:13:41.352965 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 12:13:41.352965 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 12:13:41.352965 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 12:13:41.352965 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 12:13:41.352965 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 12:13:41.352965 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 12:13:41.352965 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 12:13:41.353864 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 12:13:41.353864 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 12:13:41.353864 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 12:13:41.353864 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 12:13:41.353864 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 12:13:41.353864 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 12:13:41.353864 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 12:13:41.353864 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 12:13:41.353864 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 12:13:41.353864 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 12:13:41.353864 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 12:13:41.353864 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application with Lock( Jun 16 12:13:41.353864 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 12:13:41.353864 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._enter() Jun 16 12:13:41.353864 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 12:13:41.353864 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 12:13:41.353864 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 12:13:41.353864 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.creator() Jun 16 12:13:41.354775 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 12:13:41.354775 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application created_value = creator( Jun 16 12:13:41.354775 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 12:13:41.354775 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 12:13:41.354775 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 12:13:41.354775 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 12:13:41.354775 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 12:13:41.354775 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 12:13:41.354775 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 16 12:13:41.354775 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application Jun 16 12:13:41.354775 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 249/509] 10.222.0.44 () {56 vars in 1099 bytes} [Thu Jun 16 12:13:41 2022] GET /identity/v3/users/cinder => generated 84 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 12:13:41.356069 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8341be-72b2-4d07-b6fd-fe1547db7c30 None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:41.356352 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8341be-72b2-4d07-b6fd-fe1547db7c30 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:41.356628 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8341be-72b2-4d07-b6fd-fe1547db7c30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:41.368549 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:13:41.373167 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-fe8341be-72b2-4d07-b6fd-fe1547db7c30 None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:13:41.374337 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-fe8341be-72b2-4d07-b6fd-fe1547db7c30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:13:41.417142 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1143e983-cc3b-4584-b6aa-df16c33fd3af None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:41.439416 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 250/510] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 12:13:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 12:13:41.440228 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8341be-72b2-4d07-b6fd-fe1547db7c30 None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:41.464598 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef8e39d-08ef-48a4-936e-79de639e0d27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:41.465288 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef8e39d-08ef-48a4-936e-79de639e0d27 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:41.465570 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef8e39d-08ef-48a4-936e-79de639e0d27 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:41.465845 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef8e39d-08ef-48a4-936e-79de639e0d27 None admin] PATH_INFO: `/v3/domains` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:41.466565 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef8e39d-08ef-48a4-936e-79de639e0d27 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:13:41.466871 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef8e39d-08ef-48a4-936e-79de639e0d27 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:13:41.468264 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef8e39d-08ef-48a4-936e-79de639e0d27 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:13:41.481131 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 261/511] 10.222.0.44 () {56 vars in 1109 bytes} [Thu Jun 16 12:13:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:13:41.481920 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef8e39d-08ef-48a4-936e-79de639e0d27 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:41.541644 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8341be-72b2-4d07-b6fd-fe1547db7c30 None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:41.568256 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:13:41.576471 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c91e808-a95c-49d6-8e03-04b1d5cf9d8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:41.577281 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c91e808-a95c-49d6-8e03-04b1d5cf9d8c None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:41.577559 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c91e808-a95c-49d6-8e03-04b1d5cf9d8c None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:41.577652 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef8e39d-08ef-48a4-936e-79de639e0d27 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:41.577825 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c91e808-a95c-49d6-8e03-04b1d5cf9d8c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:41.587894 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c91e808-a95c-49d6-8e03-04b1d5cf9d8c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:13:41.589358 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c91e808-a95c-49d6-8e03-04b1d5cf9d8c None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:13:41.591202 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:13:41.607177 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application [None req-8c91e808-a95c-49d6-8e03-04b1d5cf9d8c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 12:13:41.607177 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 12:13:41.607177 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 12:13:41.607177 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 12:13:41.607177 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 12:13:41.607177 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 12:13:41.607177 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 12:13:41.607177 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 12:13:41.607177 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 12:13:41.607177 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 12:13:41.607177 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 12:13:41.607177 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 12:13:41.607177 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 12:13:41.607177 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 12:13:41.607177 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 12:13:41.608188 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 12:13:41.608188 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 12:13:41.608188 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 12:13:41.608188 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 12:13:41.608188 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 12:13:41.608188 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 12:13:41.608188 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 12:13:41.608188 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 12:13:41.608188 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application with Lock( Jun 16 12:13:41.608188 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 12:13:41.608188 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._enter() Jun 16 12:13:41.608188 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 12:13:41.608188 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 12:13:41.608188 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 12:13:41.608188 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.creator() Jun 16 12:13:41.608188 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 12:13:41.608188 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application created_value = creator( Jun 16 12:13:41.609265 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 12:13:41.609265 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 12:13:41.609265 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 12:13:41.609265 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application Jun 16 12:13:41.609265 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 251/512] 10.222.0.44 () {56 vars in 1108 bytes} [Thu Jun 16 12:13:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 12:13:41.609265 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c91e808-a95c-49d6-8e03-04b1d5cf9d8c None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:41.613657 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2e3db6-d258-45bc-a38d-945c9a364158 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:41.614332 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2e3db6-d258-45bc-a38d-945c9a364158 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:41.614609 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2e3db6-d258-45bc-a38d-945c9a364158 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:41.614880 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2e3db6-d258-45bc-a38d-945c9a364158 None admin] PATH_INFO: `/v3/users` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:41.616266 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2e3db6-d258-45bc-a38d-945c9a364158 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:13:41.616570 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2e3db6-d258-45bc-a38d-945c9a364158 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:13:41.618054 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2e3db6-d258-45bc-a38d-945c9a364158 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:13:41.653314 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 262/513] 10.222.0.44 () {56 vars in 1137 bytes} [Thu Jun 16 12:13:41 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:13:41.654116 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2e3db6-d258-45bc-a38d-945c9a364158 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:41.708473 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c91e808-a95c-49d6-8e03-04b1d5cf9d8c None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:41.742142 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56094f64-6a14-4c71-ac7c-faf0c4685c3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:41.742801 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56094f64-6a14-4c71-ac7c-faf0c4685c3c None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:41.743085 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56094f64-6a14-4c71-ac7c-faf0c4685c3c None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:41.743355 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56094f64-6a14-4c71-ac7c-faf0c4685c3c None admin] PATH_INFO: `/v3/users` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:41.744185 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56094f64-6a14-4c71-ac7c-faf0c4685c3c None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:13:41.744493 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56094f64-6a14-4c71-ac7c-faf0c4685c3c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:13:41.745936 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56094f64-6a14-4c71-ac7c-faf0c4685c3c None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:13:41.752194 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2e3db6-d258-45bc-a38d-945c9a364158 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:41.762727 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 252/514] 10.222.0.44 () {56 vars in 1137 bytes} [Thu Jun 16 12:13:41 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:13:41.763517 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56094f64-6a14-4c71-ac7c-faf0c4685c3c None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:41.786287 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21febb3c-cd06-42ff-9a53-08e1cce661e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:41.787132 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21febb3c-cd06-42ff-9a53-08e1cce661e2 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:41.787936 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21febb3c-cd06-42ff-9a53-08e1cce661e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:41.788206 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21febb3c-cd06-42ff-9a53-08e1cce661e2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:41.798267 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21febb3c-cd06-42ff-9a53-08e1cce661e2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:13:41.799730 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21febb3c-cd06-42ff-9a53-08e1cce661e2 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:13:41.803168 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:13:41.816922 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-21febb3c-cd06-42ff-9a53-08e1cce661e2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 12:13:41.816922 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 12:13:41.816922 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 12:13:41.816922 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 12:13:41.816922 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 12:13:41.816922 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 12:13:41.816922 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 12:13:41.816922 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 12:13:41.816922 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 12:13:41.816922 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 12:13:41.816922 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 12:13:41.816922 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 12:13:41.816922 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 12:13:41.816922 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 12:13:41.816922 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 12:13:41.817846 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 12:13:41.817846 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 12:13:41.817846 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 12:13:41.817846 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 12:13:41.817846 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 12:13:41.817846 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 12:13:41.817846 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 12:13:41.817846 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 12:13:41.817846 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jun 16 12:13:41.817846 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 12:13:41.817846 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jun 16 12:13:41.817846 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 12:13:41.817846 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 12:13:41.817846 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 12:13:41.817846 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jun 16 12:13:41.817846 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 12:13:41.817846 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jun 16 12:13:41.823582 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 12:13:41.823582 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 12:13:41.823582 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 12:13:41.823582 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jun 16 12:13:41.823582 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 263/515] 10.222.0.44 () {56 vars in 1108 bytes} [Thu Jun 16 12:13:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 12:13:41.823582 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21febb3c-cd06-42ff-9a53-08e1cce661e2 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:41.844100 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:13:41.862041 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56094f64-6a14-4c71-ac7c-faf0c4685c3c None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:41.895343 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdbf31a-a899-4006-8348-ded3927b09d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:41.896118 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdbf31a-a899-4006-8348-ded3927b09d0 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:41.896395 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdbf31a-a899-4006-8348-ded3927b09d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:41.897214 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdbf31a-a899-4006-8348-ded3927b09d0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:41.903768 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdbf31a-a899-4006-8348-ded3927b09d0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:13:41.905249 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdbf31a-a899-4006-8348-ded3927b09d0 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:13:41.917519 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21febb3c-cd06-42ff-9a53-08e1cce661e2 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:41.920336 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application [None req-ecdbf31a-a899-4006-8348-ded3927b09d0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 12:13:41.920336 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 12:13:41.920336 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 12:13:41.920336 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 12:13:41.920336 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 12:13:41.920336 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 12:13:41.920336 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 12:13:41.920336 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 12:13:41.920336 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 12:13:41.920336 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 12:13:41.920336 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 12:13:41.920336 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 12:13:41.920336 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 12:13:41.920336 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 12:13:41.920336 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 12:13:41.921204 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 12:13:41.921204 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 12:13:41.921204 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 12:13:41.921204 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 12:13:41.921204 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 12:13:41.921204 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 12:13:41.921204 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 12:13:41.921204 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 12:13:41.921204 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application with Lock( Jun 16 12:13:41.921204 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 12:13:41.921204 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._enter() Jun 16 12:13:41.921204 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 12:13:41.921204 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 12:13:41.921204 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 12:13:41.921204 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.creator() Jun 16 12:13:41.921204 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 12:13:41.921204 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application created_value = creator( Jun 16 12:13:41.922032 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 12:13:41.922032 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 12:13:41.922032 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 12:13:41.922032 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 12:13:41.922032 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 12:13:41.922032 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 12:13:41.922032 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 12:13:41.922032 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application Jun 16 12:13:41.922032 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 253/516] 10.222.0.44 () {56 vars in 1111 bytes} [Thu Jun 16 12:13:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 12:13:41.922945 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdbf31a-a899-4006-8348-ded3927b09d0 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:41.954514 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40e72aa-d4b7-4595-8f65-66da7b3dee6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:41.955180 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40e72aa-d4b7-4595-8f65-66da7b3dee6f None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:41.955465 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40e72aa-d4b7-4595-8f65-66da7b3dee6f None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:41.955735 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40e72aa-d4b7-4595-8f65-66da7b3dee6f None admin] PATH_INFO: `/v3/domains` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:41.956447 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40e72aa-d4b7-4595-8f65-66da7b3dee6f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:13:41.956777 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40e72aa-d4b7-4595-8f65-66da7b3dee6f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:13:41.958157 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40e72aa-d4b7-4595-8f65-66da7b3dee6f None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:13:41.970150 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 264/517] 10.222.0.44 () {56 vars in 1109 bytes} [Thu Jun 16 12:13:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:13:41.970944 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40e72aa-d4b7-4595-8f65-66da7b3dee6f None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:42.024466 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:13:42.028279 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdbf31a-a899-4006-8348-ded3927b09d0 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:42.053330 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:13:42.061957 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7d3c2f-bcc3-409b-9b01-ca79070c8c5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:42.062592 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7d3c2f-bcc3-409b-9b01-ca79070c8c5c None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:42.062870 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7d3c2f-bcc3-409b-9b01-ca79070c8c5c None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:42.063140 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7d3c2f-bcc3-409b-9b01-ca79070c8c5c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:42.069666 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40e72aa-d4b7-4595-8f65-66da7b3dee6f None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:42.103977 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a626d7-f2d8-487d-aa9c-dc66a9438c39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:42.104550 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a626d7-f2d8-487d-aa9c-dc66a9438c39 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:42.104863 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a626d7-f2d8-487d-aa9c-dc66a9438c39 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:42.105139 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a626d7-f2d8-487d-aa9c-dc66a9438c39 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:42.127825 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7d3c2f-bcc3-409b-9b01-ca79070c8c5c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:13:42.129291 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7d3c2f-bcc3-409b-9b01-ca79070c8c5c None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:13:42.174441 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a626d7-f2d8-487d-aa9c-dc66a9438c39 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:13:42.175905 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a626d7-f2d8-487d-aa9c-dc66a9438c39 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:13:42.224926 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:13:42.229614 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 254/518] 10.222.0.44 () {58 vars in 1282 bytes} [Thu Jun 16 12:13:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 12:13:42.230718 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7d3c2f-bcc3-409b-9b01-ca79070c8c5c None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:42.259705 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:13:42.276272 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 265/519] 10.222.0.44 () {58 vars in 1282 bytes} [Thu Jun 16 12:13:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 12:13:42.277133 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a626d7-f2d8-487d-aa9c-dc66a9438c39 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:42.332842 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7d3c2f-bcc3-409b-9b01-ca79070c8c5c None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:42.365752 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8deba2a9-67ad-4c51-b022-3e1a2a65e61c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:42.366344 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8deba2a9-67ad-4c51-b022-3e1a2a65e61c None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:42.366625 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8deba2a9-67ad-4c51-b022-3e1a2a65e61c None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:42.366903 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8deba2a9-67ad-4c51-b022-3e1a2a65e61c None admin] PATH_INFO: `/v3/domains` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:42.367623 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8deba2a9-67ad-4c51-b022-3e1a2a65e61c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:13:42.367937 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8deba2a9-67ad-4c51-b022-3e1a2a65e61c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:13:42.369348 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8deba2a9-67ad-4c51-b022-3e1a2a65e61c None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:13:42.370539 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a626d7-f2d8-487d-aa9c-dc66a9438c39 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:42.382319 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 255/520] 10.222.0.44 () {56 vars in 1109 bytes} [Thu Jun 16 12:13:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:13:42.383110 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8deba2a9-67ad-4c51-b022-3e1a2a65e61c None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:42.403825 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cd4e35-6755-48ba-8a88-9768e78927ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:42.404477 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cd4e35-6755-48ba-8a88-9768e78927ac None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:42.404776 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cd4e35-6755-48ba-8a88-9768e78927ac None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:42.405061 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cd4e35-6755-48ba-8a88-9768e78927ac None admin] PATH_INFO: `/v3/projects` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:42.405844 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cd4e35-6755-48ba-8a88-9768e78927ac None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:13:42.406150 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cd4e35-6755-48ba-8a88-9768e78927ac None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:13:42.407570 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cd4e35-6755-48ba-8a88-9768e78927ac None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:13:42.424773 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 266/521] 10.222.0.44 () {56 vars in 1148 bytes} [Thu Jun 16 12:13:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:13:42.425417 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cd4e35-6755-48ba-8a88-9768e78927ac None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:42.446145 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:13:42.471162 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:13:42.486627 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8deba2a9-67ad-4c51-b022-3e1a2a65e61c None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:42.520849 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee3eada-a077-4faf-9095-2453ccac5e4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:42.521691 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee3eada-a077-4faf-9095-2453ccac5e4c None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:42.521978 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee3eada-a077-4faf-9095-2453ccac5e4c None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:42.522252 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee3eada-a077-4faf-9095-2453ccac5e4c None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:42.523694 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cd4e35-6755-48ba-8a88-9768e78927ac None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:42.529576 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee3eada-a077-4faf-9095-2453ccac5e4c None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:13:42.531009 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee3eada-a077-4faf-9095-2453ccac5e4c None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:13:42.545213 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application [None req-3ee3eada-a077-4faf-9095-2453ccac5e4c None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 16 12:13:42.545213 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 12:13:42.545213 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 12:13:42.545213 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 12:13:42.545213 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 12:13:42.545213 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 12:13:42.545213 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 12:13:42.545213 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 12:13:42.545213 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 12:13:42.545213 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 12:13:42.545213 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 12:13:42.545213 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 12:13:42.545213 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 12:13:42.545213 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 12:13:42.545213 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 12:13:42.545213 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 12:13:42.546264 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 12:13:42.546264 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 12:13:42.546264 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 12:13:42.546264 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 12:13:42.546264 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 12:13:42.546264 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 12:13:42.546264 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 12:13:42.546264 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 12:13:42.546264 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 12:13:42.546264 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 12:13:42.546264 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 12:13:42.546264 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application with Lock( Jun 16 12:13:42.546264 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 12:13:42.546264 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._enter() Jun 16 12:13:42.546264 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 12:13:42.546264 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 12:13:42.546264 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 12:13:42.546264 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.creator() Jun 16 12:13:42.547142 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 12:13:42.547142 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application created_value = creator( Jun 16 12:13:42.547142 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 12:13:42.547142 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 12:13:42.547142 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 12:13:42.547142 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 12:13:42.547142 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 12:13:42.547142 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 12:13:42.547142 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 16 12:13:42.547142 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application Jun 16 12:13:42.547142 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 256/522] 10.222.0.44 () {56 vars in 1102 bytes} [Thu Jun 16 12:13:42 2022] GET /identity/v3/users/neutron => generated 85 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 12:13:42.547683 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee3eada-a077-4faf-9095-2453ccac5e4c None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:42.560685 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0170107-5966-471a-a361-9639a16e21e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:42.561509 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0170107-5966-471a-a361-9639a16e21e3 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:42.561784 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0170107-5966-471a-a361-9639a16e21e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:42.562054 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0170107-5966-471a-a361-9639a16e21e3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:42.572594 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0170107-5966-471a-a361-9639a16e21e3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:13:42.574070 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0170107-5966-471a-a361-9639a16e21e3 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:13:42.591142 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-d0170107-5966-471a-a361-9639a16e21e3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 12:13:42.591142 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 12:13:42.591142 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 12:13:42.591142 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 12:13:42.591142 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 12:13:42.591142 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 12:13:42.591142 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 12:13:42.591142 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 12:13:42.591142 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 12:13:42.591142 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 12:13:42.591142 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 12:13:42.591142 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 12:13:42.591142 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 12:13:42.591142 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 12:13:42.591142 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 12:13:42.592153 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 12:13:42.592153 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 12:13:42.592153 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 12:13:42.592153 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 12:13:42.592153 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 12:13:42.592153 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 12:13:42.592153 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 12:13:42.592153 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 12:13:42.592153 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jun 16 12:13:42.592153 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 12:13:42.592153 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jun 16 12:13:42.592153 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 12:13:42.592153 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 12:13:42.592153 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 12:13:42.592153 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jun 16 12:13:42.592153 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 12:13:42.592153 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jun 16 12:13:42.593202 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 12:13:42.593202 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 12:13:42.593202 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 12:13:42.593202 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jun 16 12:13:42.593202 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 267/523] 10.222.0.44 () {56 vars in 1108 bytes} [Thu Jun 16 12:13:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 12:13:42.593202 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0170107-5966-471a-a361-9639a16e21e3 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:42.646219 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee3eada-a077-4faf-9095-2453ccac5e4c None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:42.662838 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:13:42.680387 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbd4ca9-9145-4123-bff0-612085691c31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:42.681202 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbd4ca9-9145-4123-bff0-612085691c31 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:42.681488 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbd4ca9-9145-4123-bff0-612085691c31 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:42.681767 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbd4ca9-9145-4123-bff0-612085691c31 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:42.685531 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:13:42.692100 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0170107-5966-471a-a361-9639a16e21e3 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:42.693163 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbd4ca9-9145-4123-bff0-612085691c31 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:13:42.695170 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbd4ca9-9145-4123-bff0-612085691c31 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:13:42.712069 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application [None req-cfbd4ca9-9145-4123-bff0-612085691c31 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 12:13:42.712069 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 12:13:42.712069 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 12:13:42.712069 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 12:13:42.712069 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 12:13:42.712069 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 12:13:42.712069 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 12:13:42.712069 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 12:13:42.712069 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 12:13:42.712069 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 12:13:42.712069 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 12:13:42.712069 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 12:13:42.712069 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 12:13:42.712069 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 12:13:42.712069 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 12:13:42.713059 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 12:13:42.713059 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 12:13:42.713059 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 12:13:42.713059 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 12:13:42.713059 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 12:13:42.713059 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 12:13:42.713059 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 12:13:42.713059 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 12:13:42.713059 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application with Lock( Jun 16 12:13:42.713059 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 12:13:42.713059 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._enter() Jun 16 12:13:42.713059 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 12:13:42.713059 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 12:13:42.713059 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 12:13:42.713059 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.creator() Jun 16 12:13:42.713059 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 12:13:42.713059 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application created_value = creator( Jun 16 12:13:42.714092 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 12:13:42.714092 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 12:13:42.714092 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 12:13:42.714092 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application Jun 16 12:13:42.714092 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 257/524] 10.222.0.44 () {56 vars in 1108 bytes} [Thu Jun 16 12:13:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 12:13:42.714092 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbd4ca9-9145-4123-bff0-612085691c31 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:42.729155 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fdaac1-5187-4d6b-ac0c-c172e85f3496 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:42.729817 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fdaac1-5187-4d6b-ac0c-c172e85f3496 None admin] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:42.730090 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fdaac1-5187-4d6b-ac0c-c172e85f3496 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:42.730361 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fdaac1-5187-4d6b-ac0c-c172e85f3496 None admin] PATH_INFO: `/v3/users` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:42.731051 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fdaac1-5187-4d6b-ac0c-c172e85f3496 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:13:42.732490 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fdaac1-5187-4d6b-ac0c-c172e85f3496 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:13:42.752018 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 268/525] 10.222.0.44 () {60 vars in 1132 bytes} [Thu Jun 16 12:13:42 2022] POST /identity/v3/users => generated 247 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 12:13:42.752835 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fdaac1-5187-4d6b-ac0c-c172e85f3496 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:42.832434 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbd4ca9-9145-4123-bff0-612085691c31 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:42.865921 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fdaac1-5187-4d6b-ac0c-c172e85f3496 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:42.868361 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9908acba-5648-477f-94ec-e4499750de64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:42.869061 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9908acba-5648-477f-94ec-e4499750de64 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:42.869342 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9908acba-5648-477f-94ec-e4499750de64 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:42.869613 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9908acba-5648-477f-94ec-e4499750de64 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:42.870464 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9908acba-5648-477f-94ec-e4499750de64 None admin] RBAC: Adding query filter params (role.id=a5c06bc21d39451285def24673456ff6, scope.project.id=601361df39e34fcca71175aa94e425c4, user.id=edfb12d445e74136b90800e93941f468) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:13:42.870773 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9908acba-5648-477f-94ec-e4499750de64 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:13:42.872248 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9908acba-5648-477f-94ec-e4499750de64 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:13:42.888814 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 258/526] 10.222.0.44 () {56 vars in 1374 bytes} [Thu Jun 16 12:13:42 2022] GET /identity/v3/role_assignments?user.id=edfb12d445e74136b90800e93941f468&scope.project.id=601361df39e34fcca71175aa94e425c4&role.id=a5c06bc21d39451285def24673456ff6 => generated 259 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:13:42.888814 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9908acba-5648-477f-94ec-e4499750de64 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:42.920863 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15dccae1-b17e-4ef6-b177-b20a5ea63a00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:42.921612 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dccae1-b17e-4ef6-b177-b20a5ea63a00 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:42.921964 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dccae1-b17e-4ef6-b177-b20a5ea63a00 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:42.922264 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dccae1-b17e-4ef6-b177-b20a5ea63a00 None admin] PATH_INFO: `/v3/users` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:42.923095 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15dccae1-b17e-4ef6-b177-b20a5ea63a00 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:13:42.923405 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15dccae1-b17e-4ef6-b177-b20a5ea63a00 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:13:42.924948 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15dccae1-b17e-4ef6-b177-b20a5ea63a00 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:13:42.943643 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:13:42.955973 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 269/527] 10.222.0.44 () {56 vars in 1139 bytes} [Thu Jun 16 12:13:42 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:13:42.957520 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15dccae1-b17e-4ef6-b177-b20a5ea63a00 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:42.974972 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:13:43.046548 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9908acba-5648-477f-94ec-e4499750de64 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:43.083499 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15dccae1-b17e-4ef6-b177-b20a5ea63a00 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:43.102498 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a50fdd-9a11-4018-a472-9565ba90d7e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:43.103163 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a50fdd-9a11-4018-a472-9565ba90d7e2 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:43.103443 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a50fdd-9a11-4018-a472-9565ba90d7e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:43.103715 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a50fdd-9a11-4018-a472-9565ba90d7e2 None admin] PATH_INFO: `/v3/domains` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:43.105005 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a50fdd-9a11-4018-a472-9565ba90d7e2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:13:43.105317 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a50fdd-9a11-4018-a472-9565ba90d7e2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:13:43.107036 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a50fdd-9a11-4018-a472-9565ba90d7e2 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:13:43.119920 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0d7c7b-dc26-4fa2-97be-3ed15ee6c0c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:43.120585 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0d7c7b-dc26-4fa2-97be-3ed15ee6c0c1 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:43.120891 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0d7c7b-dc26-4fa2-97be-3ed15ee6c0c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:43.121165 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0d7c7b-dc26-4fa2-97be-3ed15ee6c0c1 None admin] PATH_INFO: `/v3/domains` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:43.121881 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0d7c7b-dc26-4fa2-97be-3ed15ee6c0c1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:13:43.122181 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0d7c7b-dc26-4fa2-97be-3ed15ee6c0c1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:13:43.123544 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0d7c7b-dc26-4fa2-97be-3ed15ee6c0c1 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:13:43.123799 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 259/528] 10.222.0.44 () {56 vars in 1109 bytes} [Thu Jun 16 12:13:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:13:43.124636 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a50fdd-9a11-4018-a472-9565ba90d7e2 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:43.135933 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 270/529] 10.222.0.44 () {56 vars in 1109 bytes} [Thu Jun 16 12:13:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:13:43.136782 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0d7c7b-dc26-4fa2-97be-3ed15ee6c0c1 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:43.232586 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:13:43.239599 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:13:43.241160 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a50fdd-9a11-4018-a472-9565ba90d7e2 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:43.276437 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0d7c7b-dc26-4fa2-97be-3ed15ee6c0c1 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:43.286519 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd6f546-5700-422a-82ac-14c6ca4ff112 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:43.287765 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd6f546-5700-422a-82ac-14c6ca4ff112 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:43.288426 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd6f546-5700-422a-82ac-14c6ca4ff112 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:43.288701 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd6f546-5700-422a-82ac-14c6ca4ff112 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:43.313124 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5d6ad2-b457-4528-8dd7-f26551461771 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:43.314014 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5d6ad2-b457-4528-8dd7-f26551461771 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:43.314293 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5d6ad2-b457-4528-8dd7-f26551461771 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:43.314562 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5d6ad2-b457-4528-8dd7-f26551461771 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:43.323720 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5d6ad2-b457-4528-8dd7-f26551461771 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:13:43.325868 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5d6ad2-b457-4528-8dd7-f26551461771 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:13:43.346236 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-fe5d6ad2-b457-4528-8dd7-f26551461771 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 12:13:43.346236 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 12:13:43.346236 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 12:13:43.346236 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 12:13:43.346236 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 12:13:43.346236 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 12:13:43.346236 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 12:13:43.346236 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 12:13:43.346236 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 12:13:43.346236 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 12:13:43.346236 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 12:13:43.346236 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 12:13:43.346236 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 12:13:43.346236 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 12:13:43.346236 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 12:13:43.347297 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 12:13:43.347297 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 12:13:43.347297 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 12:13:43.347297 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 12:13:43.347297 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 12:13:43.347297 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 12:13:43.347297 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 12:13:43.347297 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 12:13:43.347297 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jun 16 12:13:43.347297 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 12:13:43.347297 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jun 16 12:13:43.347297 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 12:13:43.347297 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 12:13:43.347297 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 12:13:43.347297 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jun 16 12:13:43.347297 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 12:13:43.347297 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jun 16 12:13:43.348333 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 12:13:43.348333 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 12:13:43.348333 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 12:13:43.348333 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 12:13:43.348333 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 12:13:43.348333 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 12:13:43.348333 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 12:13:43.348333 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jun 16 12:13:43.348333 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 271/530] 10.222.0.44 () {56 vars in 1111 bytes} [Thu Jun 16 12:13:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 12:13:43.349102 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5d6ad2-b457-4528-8dd7-f26551461771 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:43.374131 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd6f546-5700-422a-82ac-14c6ca4ff112 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:13:43.375580 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd6f546-5700-422a-82ac-14c6ca4ff112 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:13:43.467873 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5d6ad2-b457-4528-8dd7-f26551461771 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:43.489682 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:13:43.498996 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 260/531] 10.222.0.44 () {58 vars in 1282 bytes} [Thu Jun 16 12:13:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 12:13:43.499948 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd6f546-5700-422a-82ac-14c6ca4ff112 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:43.509418 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:13:43.518365 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5b5d02-68c7-4840-8091-72b402915cc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:43.519775 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5b5d02-68c7-4840-8091-72b402915cc0 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:43.520255 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5b5d02-68c7-4840-8091-72b402915cc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:43.520723 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5b5d02-68c7-4840-8091-72b402915cc0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:43.531385 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5b5d02-68c7-4840-8091-72b402915cc0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:13:43.533714 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5b5d02-68c7-4840-8091-72b402915cc0 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:13:43.552505 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-1d5b5d02-68c7-4840-8091-72b402915cc0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 12:13:43.552505 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 12:13:43.552505 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 12:13:43.552505 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 12:13:43.552505 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 12:13:43.552505 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 12:13:43.552505 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 12:13:43.552505 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 12:13:43.552505 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 12:13:43.552505 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 12:13:43.552505 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 12:13:43.552505 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 12:13:43.552505 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 12:13:43.552505 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 12:13:43.552505 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 12:13:43.553458 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 12:13:43.553458 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 12:13:43.553458 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 12:13:43.553458 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 12:13:43.553458 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 12:13:43.553458 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 12:13:43.553458 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 12:13:43.553458 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 12:13:43.553458 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jun 16 12:13:43.553458 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 12:13:43.553458 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jun 16 12:13:43.553458 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 12:13:43.553458 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 12:13:43.553458 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 12:13:43.553458 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jun 16 12:13:43.553458 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 12:13:43.553458 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jun 16 12:13:43.554306 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 12:13:43.554306 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 12:13:43.554306 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 12:13:43.554306 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 12:13:43.554306 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 12:13:43.554306 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 12:13:43.554306 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 12:13:43.554306 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jun 16 12:13:43.558622 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 272/532] 10.222.0.44 () {56 vars in 1111 bytes} [Thu Jun 16 12:13:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 12:13:43.559245 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5b5d02-68c7-4840-8091-72b402915cc0 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:43.628100 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd6f546-5700-422a-82ac-14c6ca4ff112 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:43.666292 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbeac017-7f50-4b36-9a30-35f5e1a04ca7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:43.666988 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbeac017-7f50-4b36-9a30-35f5e1a04ca7 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:43.667331 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbeac017-7f50-4b36-9a30-35f5e1a04ca7 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:43.667530 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbeac017-7f50-4b36-9a30-35f5e1a04ca7 None admin] PATH_INFO: `/v3/projects` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:43.668311 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbeac017-7f50-4b36-9a30-35f5e1a04ca7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:13:43.668612 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbeac017-7f50-4b36-9a30-35f5e1a04ca7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:13:43.670260 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5b5d02-68c7-4840-8091-72b402915cc0 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:43.670370 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbeac017-7f50-4b36-9a30-35f5e1a04ca7 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:13:43.690467 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 261/533] 10.222.0.44 () {56 vars in 1148 bytes} [Thu Jun 16 12:13:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:13:43.691858 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbeac017-7f50-4b36-9a30-35f5e1a04ca7 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:43.706159 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f07e2d4-58ce-42a3-95ba-ac4af635c49c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:43.707299 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f07e2d4-58ce-42a3-95ba-ac4af635c49c None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:43.707776 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f07e2d4-58ce-42a3-95ba-ac4af635c49c None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:43.708246 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f07e2d4-58ce-42a3-95ba-ac4af635c49c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:43.721547 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f07e2d4-58ce-42a3-95ba-ac4af635c49c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:13:43.723415 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f07e2d4-58ce-42a3-95ba-ac4af635c49c None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:13:43.741963 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-1f07e2d4-58ce-42a3-95ba-ac4af635c49c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 12:13:43.741963 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 12:13:43.741963 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 12:13:43.741963 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 12:13:43.741963 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 12:13:43.741963 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 12:13:43.741963 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 12:13:43.741963 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 12:13:43.741963 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 12:13:43.741963 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 12:13:43.741963 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 12:13:43.741963 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 12:13:43.741963 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 12:13:43.741963 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 12:13:43.741963 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 12:13:43.742769 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 12:13:43.742769 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 12:13:43.742769 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 12:13:43.742769 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 12:13:43.742769 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 12:13:43.742769 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 12:13:43.742769 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 12:13:43.742769 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 12:13:43.742769 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jun 16 12:13:43.742769 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 12:13:43.742769 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jun 16 12:13:43.742769 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 12:13:43.742769 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 12:13:43.742769 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 12:13:43.742769 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jun 16 12:13:43.742769 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 12:13:43.742769 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jun 16 12:13:43.743591 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 12:13:43.743591 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 12:13:43.743591 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 12:13:43.743591 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jun 16 12:13:43.745571 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 273/534] 10.222.0.44 () {56 vars in 1108 bytes} [Thu Jun 16 12:13:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 12:13:43.746639 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f07e2d4-58ce-42a3-95ba-ac4af635c49c None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:43.752145 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:13:43.793536 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:13:43.803192 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbeac017-7f50-4b36-9a30-35f5e1a04ca7 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:43.842001 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9726c6dc-e5e8-4e38-98bc-1a140259ceb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:43.842363 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9726c6dc-e5e8-4e38-98bc-1a140259ceb8 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:43.842644 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9726c6dc-e5e8-4e38-98bc-1a140259ceb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:43.842916 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9726c6dc-e5e8-4e38-98bc-1a140259ceb8 None admin] PATH_INFO: `/v3/projects` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:43.843694 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9726c6dc-e5e8-4e38-98bc-1a140259ceb8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:13:43.843996 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9726c6dc-e5e8-4e38-98bc-1a140259ceb8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:13:43.845446 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9726c6dc-e5e8-4e38-98bc-1a140259ceb8 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:13:43.855734 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f07e2d4-58ce-42a3-95ba-ac4af635c49c None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:43.862548 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 262/535] 10.222.0.44 () {56 vars in 1148 bytes} [Thu Jun 16 12:13:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:13:43.863499 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9726c6dc-e5e8-4e38-98bc-1a140259ceb8 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:43.900654 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184fa5d6-d47b-430e-b8f1-4ef2d571cc7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:43.902381 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184fa5d6-d47b-430e-b8f1-4ef2d571cc7e None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:43.902863 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184fa5d6-d47b-430e-b8f1-4ef2d571cc7e None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:43.903359 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184fa5d6-d47b-430e-b8f1-4ef2d571cc7e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:43.904667 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184fa5d6-d47b-430e-b8f1-4ef2d571cc7e None admin] RBAC: Adding query filter params (role.id=a5c06bc21d39451285def24673456ff6, scope.project.id=601361df39e34fcca71175aa94e425c4, user.id=42dedbccc64747d581c862a69ae20941) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:13:43.906024 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184fa5d6-d47b-430e-b8f1-4ef2d571cc7e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:13:43.907686 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184fa5d6-d47b-430e-b8f1-4ef2d571cc7e None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:13:43.915136 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 274/536] 10.222.0.44 () {56 vars in 1374 bytes} [Thu Jun 16 12:13:43 2022] GET /identity/v3/role_assignments?user.id=42dedbccc64747d581c862a69ae20941&scope.project.id=601361df39e34fcca71175aa94e425c4&role.id=a5c06bc21d39451285def24673456ff6 => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:13:43.916430 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184fa5d6-d47b-430e-b8f1-4ef2d571cc7e None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:44.042476 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9726c6dc-e5e8-4e38-98bc-1a140259ceb8 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:44.067155 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184fa5d6-d47b-430e-b8f1-4ef2d571cc7e None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:44.072539 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:13:44.080835 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:13:44.097661 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece75568-8a78-4f54-8046-a9bfacf98975 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:44.098876 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece75568-8a78-4f54-8046-a9bfacf98975 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:44.099379 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece75568-8a78-4f54-8046-a9bfacf98975 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:44.099905 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece75568-8a78-4f54-8046-a9bfacf98975 None admin] PATH_INFO: `/v3/domains` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:44.101457 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece75568-8a78-4f54-8046-a9bfacf98975 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:13:44.101989 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece75568-8a78-4f54-8046-a9bfacf98975 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:13:44.103908 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece75568-8a78-4f54-8046-a9bfacf98975 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:13:44.119457 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 263/537] 10.222.0.44 () {56 vars in 1109 bytes} [Thu Jun 16 12:13:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:13:44.124443 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece75568-8a78-4f54-8046-a9bfacf98975 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:44.165992 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84620a0c-558f-4524-8585-5902327d8dde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:44.166663 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84620a0c-558f-4524-8585-5902327d8dde None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:44.166937 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84620a0c-558f-4524-8585-5902327d8dde None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:44.167205 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84620a0c-558f-4524-8585-5902327d8dde None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:44.168048 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84620a0c-558f-4524-8585-5902327d8dde None admin] RBAC: Adding query filter params (role.id=a5c06bc21d39451285def24673456ff6, scope.project.id=601361df39e34fcca71175aa94e425c4, user.id=4f96fc14ed89478c8a8c2f11c87511e3) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:13:44.168353 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84620a0c-558f-4524-8585-5902327d8dde None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:13:44.170170 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84620a0c-558f-4524-8585-5902327d8dde None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:13:44.181204 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 275/538] 10.222.0.44 () {56 vars in 1374 bytes} [Thu Jun 16 12:13:43 2022] GET /identity/v3/role_assignments?user.id=4f96fc14ed89478c8a8c2f11c87511e3&scope.project.id=601361df39e34fcca71175aa94e425c4&role.id=a5c06bc21d39451285def24673456ff6 => generated 259 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:13:44.283830 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece75568-8a78-4f54-8046-a9bfacf98975 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:44.339219 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142fa196-f343-4f62-b338-842912206095 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:44.340419 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142fa196-f343-4f62-b338-842912206095 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:44.340978 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142fa196-f343-4f62-b338-842912206095 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:44.341452 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142fa196-f343-4f62-b338-842912206095 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:44.352651 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142fa196-f343-4f62-b338-842912206095 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:13:44.354467 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142fa196-f343-4f62-b338-842912206095 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:13:44.374086 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application [None req-142fa196-f343-4f62-b338-842912206095 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 12:13:44.374086 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 12:13:44.374086 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 12:13:44.374086 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 12:13:44.374086 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 12:13:44.374086 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 12:13:44.374086 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 12:13:44.374086 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 12:13:44.374086 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 12:13:44.374086 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 12:13:44.374086 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 12:13:44.374086 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 12:13:44.374086 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 12:13:44.374086 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 12:13:44.374086 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 12:13:44.374952 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 12:13:44.374952 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 12:13:44.374952 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 12:13:44.374952 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 12:13:44.374952 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 12:13:44.374952 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 12:13:44.374952 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 12:13:44.374952 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 12:13:44.374952 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application with Lock( Jun 16 12:13:44.374952 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 12:13:44.374952 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._enter() Jun 16 12:13:44.374952 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 12:13:44.374952 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 12:13:44.374952 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 12:13:44.374952 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.creator() Jun 16 12:13:44.374952 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 12:13:44.374952 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application created_value = creator( Jun 16 12:13:44.375772 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 12:13:44.375772 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 12:13:44.375772 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 12:13:44.375772 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 12:13:44.375772 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 12:13:44.375772 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 12:13:44.375772 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 12:13:44.375772 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application Jun 16 12:13:44.378235 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 264/539] 10.222.0.44 () {56 vars in 1111 bytes} [Thu Jun 16 12:13:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 12:13:44.383463 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84620a0c-558f-4524-8585-5902327d8dde None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:44.490383 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84620a0c-558f-4524-8585-5902327d8dde None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:44.527512 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff3dba4-6718-4a07-83ef-2af135533680 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:44.528554 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff3dba4-6718-4a07-83ef-2af135533680 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:44.529115 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff3dba4-6718-4a07-83ef-2af135533680 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:44.529582 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff3dba4-6718-4a07-83ef-2af135533680 None admin] PATH_INFO: `/v3/projects` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:44.530610 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff3dba4-6718-4a07-83ef-2af135533680 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:13:44.531112 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff3dba4-6718-4a07-83ef-2af135533680 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:13:44.532772 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff3dba4-6718-4a07-83ef-2af135533680 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:13:44.546760 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 276/540] 10.222.0.44 () {56 vars in 1148 bytes} [Thu Jun 16 12:13:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:13:44.553830 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142fa196-f343-4f62-b338-842912206095 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:44.597587 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:13:44.680501 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142fa196-f343-4f62-b338-842912206095 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:44.727989 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351a6940-044b-4581-9c87-09d0e8edc5a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:44.728656 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351a6940-044b-4581-9c87-09d0e8edc5a7 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:44.728963 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351a6940-044b-4581-9c87-09d0e8edc5a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:44.729240 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351a6940-044b-4581-9c87-09d0e8edc5a7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:44.730128 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351a6940-044b-4581-9c87-09d0e8edc5a7 None admin] RBAC: Adding query filter params (role.id=a5c06bc21d39451285def24673456ff6, scope.project.id=601361df39e34fcca71175aa94e425c4, user.id=e1094729b25a4be7b0b394998c9ca681) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:13:44.730439 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351a6940-044b-4581-9c87-09d0e8edc5a7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:13:44.731923 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351a6940-044b-4581-9c87-09d0e8edc5a7 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:13:44.740630 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 265/541] 10.222.0.44 () {56 vars in 1374 bytes} [Thu Jun 16 12:13:44 2022] GET /identity/v3/role_assignments?user.id=e1094729b25a4be7b0b394998c9ca681&scope.project.id=601361df39e34fcca71175aa94e425c4&role.id=a5c06bc21d39451285def24673456ff6 => generated 259 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:13:45.109745 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1417819-95be-4e07-85e0-4afeb93cc8e5 None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:45.110288 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1417819-95be-4e07-85e0-4afeb93cc8e5 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:45.110288 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1417819-95be-4e07-85e0-4afeb93cc8e5 None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:45.111877 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 277/542] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 12:13:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 12:13:45.117902 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6a239a-a88e-47ee-8a26-0baf70c3842a None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:45.118314 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6a239a-a88e-47ee-8a26-0baf70c3842a None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:45.118486 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6a239a-a88e-47ee-8a26-0baf70c3842a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:45.136618 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-2e6a239a-a88e-47ee-8a26-0baf70c3842a None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:13:45.137834 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-2e6a239a-a88e-47ee-8a26-0baf70c3842a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:13:45.238078 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 266/543] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 12:13:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 12:13:45.273668 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1417819-95be-4e07-85e0-4afeb93cc8e5 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:45.324976 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:13:45.350703 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7189e6f9-768c-4715-b399-8284b76b7bc7 None None] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:45.351028 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7189e6f9-768c-4715-b399-8284b76b7bc7 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:45.351260 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7189e6f9-768c-4715-b399-8284b76b7bc7 None None] PATH_INFO: `/` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:45.352791 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 267/544] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 12:13:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 12:13:45.358030 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05893e07-2032-430b-8eda-867ba9f4a98b None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:45.358547 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05893e07-2032-430b-8eda-867ba9f4a98b None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:45.359029 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05893e07-2032-430b-8eda-867ba9f4a98b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:45.376994 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-05893e07-2032-430b-8eda-867ba9f4a98b None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:13:45.378500 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-05893e07-2032-430b-8eda-867ba9f4a98b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:13:45.417109 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:13:45.447477 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1417819-95be-4e07-85e0-4afeb93cc8e5 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:45.500263 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 268/545] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 12:13:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 12:13:45.511061 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076c7a42-6bd6-4259-a574-ef89ca860bac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:45.511919 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076c7a42-6bd6-4259-a574-ef89ca860bac None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:45.512202 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076c7a42-6bd6-4259-a574-ef89ca860bac None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:45.512528 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076c7a42-6bd6-4259-a574-ef89ca860bac None admin] PATH_INFO: `/v3/roles/service` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:45.529518 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076c7a42-6bd6-4259-a574-ef89ca860bac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 12:13:45.537608 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-076c7a42-6bd6-4259-a574-ef89ca860bac None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 16 12:13:45.537608 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 12:13:45.537608 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 12:13:45.537608 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 12:13:45.537608 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 12:13:45.537608 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 12:13:45.537608 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 12:13:45.537608 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 12:13:45.537608 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 12:13:45.537608 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 12:13:45.537608 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 12:13:45.537608 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 12:13:45.537608 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 12:13:45.537608 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 12:13:45.537608 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 12:13:45.537608 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 12:13:45.538478 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 12:13:45.538478 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 12:13:45.538478 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 12:13:45.538478 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 12:13:45.538478 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 12:13:45.538478 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 12:13:45.538478 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 12:13:45.538478 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 12:13:45.538478 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 12:13:45.538478 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 12:13:45.538478 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 12:13:45.538478 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jun 16 12:13:45.538478 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 12:13:45.538478 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jun 16 12:13:45.538478 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 12:13:45.538478 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 12:13:45.539257 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 12:13:45.539257 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jun 16 12:13:45.539257 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 12:13:45.539257 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jun 16 12:13:45.539257 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 12:13:45.539257 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 12:13:45.539257 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 12:13:45.539257 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 12:13:45.539257 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 12:13:45.539257 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 12:13:45.539257 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 16 12:13:45.539257 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jun 16 12:13:45.539257 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 278/546] 10.222.0.44 () {56 vars in 1102 bytes} [Thu Jun 16 12:13:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 12:13:45.545114 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05893e07-2032-430b-8eda-867ba9f4a98b None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:45.553869 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076c7a42-6bd6-4259-a574-ef89ca860bac None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:45.651199 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:13:45.660949 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076c7a42-6bd6-4259-a574-ef89ca860bac None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:45.696764 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c4f190-b0d0-49a0-8757-5d7f18ac5749 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:45.697563 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c4f190-b0d0-49a0-8757-5d7f18ac5749 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:45.697845 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c4f190-b0d0-49a0-8757-5d7f18ac5749 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:45.698124 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c4f190-b0d0-49a0-8757-5d7f18ac5749 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:45.708640 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c4f190-b0d0-49a0-8757-5d7f18ac5749 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 12:13:45.716582 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-c1c4f190-b0d0-49a0-8757-5d7f18ac5749 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 16 12:13:45.716582 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 12:13:45.716582 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 12:13:45.716582 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 12:13:45.716582 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 12:13:45.716582 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 12:13:45.716582 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 12:13:45.716582 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 12:13:45.716582 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 12:13:45.716582 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 12:13:45.716582 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 12:13:45.716582 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 12:13:45.716582 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 12:13:45.716582 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 12:13:45.716582 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 12:13:45.716582 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 12:13:45.717490 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 12:13:45.717490 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 12:13:45.717490 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 12:13:45.717490 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 12:13:45.717490 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 12:13:45.717490 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 12:13:45.717490 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 12:13:45.717490 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 12:13:45.717490 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 12:13:45.717490 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 12:13:45.717490 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 12:13:45.717490 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jun 16 12:13:45.717490 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 12:13:45.717490 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jun 16 12:13:45.717490 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 12:13:45.717490 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 12:13:45.718266 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 12:13:45.718266 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jun 16 12:13:45.718266 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 12:13:45.718266 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jun 16 12:13:45.718266 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 12:13:45.718266 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 12:13:45.718266 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 12:13:45.718266 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 12:13:45.718266 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 12:13:45.718266 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 12:13:45.718266 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 16 12:13:45.718266 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jun 16 12:13:45.718266 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 279/547] 10.222.0.44 () {56 vars in 1102 bytes} [Thu Jun 16 12:13:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 12:13:45.725696 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c4f190-b0d0-49a0-8757-5d7f18ac5749 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:45.776863 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05893e07-2032-430b-8eda-867ba9f4a98b None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:45.850423 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c617f8a-a3fd-4af5-9316-af324c4c98fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:45.852104 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c617f8a-a3fd-4af5-9316-af324c4c98fc None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:45.853180 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c617f8a-a3fd-4af5-9316-af324c4c98fc None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:45.853843 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c617f8a-a3fd-4af5-9316-af324c4c98fc None admin] PATH_INFO: `/v3/roles` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:45.855818 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c4f190-b0d0-49a0-8757-5d7f18ac5749 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:45.856802 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c617f8a-a3fd-4af5-9316-af324c4c98fc None admin] RBAC: Adding query filter params (name=service) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:13:45.857315 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c617f8a-a3fd-4af5-9316-af324c4c98fc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:13:45.858908 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c617f8a-a3fd-4af5-9316-af324c4c98fc None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:13:45.878232 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 269/548] 10.222.0.44 () {56 vars in 1103 bytes} [Thu Jun 16 12:13:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 334 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:13:45.884693 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c617f8a-a3fd-4af5-9316-af324c4c98fc None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:45.915608 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e625f78-0398-4b98-941e-5d31d5c4566d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:45.916674 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e625f78-0398-4b98-941e-5d31d5c4566d None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:45.917197 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e625f78-0398-4b98-941e-5d31d5c4566d None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:45.917763 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e625f78-0398-4b98-941e-5d31d5c4566d None admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:45.918772 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e625f78-0398-4b98-941e-5d31d5c4566d None admin] RBAC: Adding query filter params (name=service) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:13:45.919630 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e625f78-0398-4b98-941e-5d31d5c4566d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:13:45.921245 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e625f78-0398-4b98-941e-5d31d5c4566d None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:13:45.932792 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 280/549] 10.222.0.44 () {56 vars in 1103 bytes} [Thu Jun 16 12:13:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:13:45.938519 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e625f78-0398-4b98-941e-5d31d5c4566d None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:45.949232 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:13:45.981128 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:13:46.109376 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c617f8a-a3fd-4af5-9316-af324c4c98fc None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:46.118713 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e625f78-0398-4b98-941e-5d31d5c4566d None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:46.173531 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab5b6f9-0085-4d0d-907b-52464568c705 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:46.174328 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab5b6f9-0085-4d0d-907b-52464568c705 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:46.174602 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab5b6f9-0085-4d0d-907b-52464568c705 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:46.174867 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab5b6f9-0085-4d0d-907b-52464568c705 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:46.189472 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99624f8-46f2-47f1-8ed1-b71725d09d8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:46.190273 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99624f8-46f2-47f1-8ed1-b71725d09d8f None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:46.190545 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99624f8-46f2-47f1-8ed1-b71725d09d8f None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:46.190813 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99624f8-46f2-47f1-8ed1-b71725d09d8f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:46.199889 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab5b6f9-0085-4d0d-907b-52464568c705 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:13:46.201413 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab5b6f9-0085-4d0d-907b-52464568c705 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:13:46.212409 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99624f8-46f2-47f1-8ed1-b71725d09d8f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:13:46.213975 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99624f8-46f2-47f1-8ed1-b71725d09d8f None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:13:46.229411 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application [None req-cab5b6f9-0085-4d0d-907b-52464568c705 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 12:13:46.229411 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 12:13:46.229411 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 12:13:46.229411 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 12:13:46.229411 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 12:13:46.229411 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 12:13:46.229411 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 12:13:46.229411 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 12:13:46.229411 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 12:13:46.229411 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 12:13:46.229411 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 12:13:46.229411 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 12:13:46.229411 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 12:13:46.229411 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 12:13:46.229411 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 12:13:46.230457 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 12:13:46.230457 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 12:13:46.230457 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 12:13:46.230457 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 12:13:46.230457 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 12:13:46.230457 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 12:13:46.230457 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 12:13:46.230457 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 12:13:46.230457 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application with Lock( Jun 16 12:13:46.230457 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 12:13:46.230457 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._enter() Jun 16 12:13:46.230457 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 12:13:46.230457 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 12:13:46.230457 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 12:13:46.230457 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.creator() Jun 16 12:13:46.230457 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 12:13:46.230457 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application created_value = creator( Jun 16 12:13:46.231284 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 12:13:46.231284 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 12:13:46.231284 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 12:13:46.231284 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application Jun 16 12:13:46.231284 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 270/550] 10.222.0.44 () {56 vars in 1108 bytes} [Thu Jun 16 12:13:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 346 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 12:13:46.236143 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab5b6f9-0085-4d0d-907b-52464568c705 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:46.259710 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-f99624f8-46f2-47f1-8ed1-b71725d09d8f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 12:13:46.259710 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 12:13:46.259710 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 12:13:46.259710 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 12:13:46.259710 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 12:13:46.259710 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 12:13:46.259710 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 12:13:46.259710 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 12:13:46.259710 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 12:13:46.259710 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 12:13:46.259710 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 12:13:46.259710 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 12:13:46.259710 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 12:13:46.259710 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 12:13:46.259710 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 12:13:46.261927 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 12:13:46.261927 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 12:13:46.261927 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 12:13:46.261927 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 12:13:46.261927 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 12:13:46.261927 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 12:13:46.261927 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 12:13:46.261927 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 12:13:46.261927 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jun 16 12:13:46.261927 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 12:13:46.261927 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jun 16 12:13:46.261927 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 12:13:46.261927 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 12:13:46.261927 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 12:13:46.261927 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jun 16 12:13:46.261927 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 12:13:46.261927 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jun 16 12:13:46.264077 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 12:13:46.264077 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 12:13:46.264077 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 12:13:46.264077 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jun 16 12:13:46.264077 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 281/551] 10.222.0.44 () {56 vars in 1108 bytes} [Thu Jun 16 12:13:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 323 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 12:13:46.270565 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99624f8-46f2-47f1-8ed1-b71725d09d8f None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:46.311590 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:13:46.344622 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab5b6f9-0085-4d0d-907b-52464568c705 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:46.383572 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102a5fed-dca6-4151-8d43-a9790a7097ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:46.384299 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102a5fed-dca6-4151-8d43-a9790a7097ab None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:46.384586 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102a5fed-dca6-4151-8d43-a9790a7097ab None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:46.384908 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102a5fed-dca6-4151-8d43-a9790a7097ab None admin] PATH_INFO: `/v3/domains` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:46.385639 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102a5fed-dca6-4151-8d43-a9790a7097ab None admin] RBAC: Adding query filter params (name=Default) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:13:46.385949 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102a5fed-dca6-4151-8d43-a9790a7097ab None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:13:46.387322 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102a5fed-dca6-4151-8d43-a9790a7097ab None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:13:46.405057 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 271/552] 10.222.0.44 () {56 vars in 1109 bytes} [Thu Jun 16 12:13:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 12:13:46.407264 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102a5fed-dca6-4151-8d43-a9790a7097ab None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:46.444915 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:13:46.512003 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99624f8-46f2-47f1-8ed1-b71725d09d8f None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:46.516044 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102a5fed-dca6-4151-8d43-a9790a7097ab None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:46.552853 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0e75eb-f5ac-4b3f-9da0-b8135c5048a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:46.553524 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0e75eb-f5ac-4b3f-9da0-b8135c5048a8 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:46.553807 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0e75eb-f5ac-4b3f-9da0-b8135c5048a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:46.554084 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0e75eb-f5ac-4b3f-9da0-b8135c5048a8 None admin] PATH_INFO: `/v3/domains` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:46.554954 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0e75eb-f5ac-4b3f-9da0-b8135c5048a8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:13:46.555259 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0e75eb-f5ac-4b3f-9da0-b8135c5048a8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:13:46.557490 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0e75eb-f5ac-4b3f-9da0-b8135c5048a8 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:13:46.570065 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:13:46.578644 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfd4466-ae2f-4f2e-953f-bf652cee237a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:46.579467 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfd4466-ae2f-4f2e-953f-bf652cee237a None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:46.579751 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfd4466-ae2f-4f2e-953f-bf652cee237a None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:46.580030 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfd4466-ae2f-4f2e-953f-bf652cee237a None admin] PATH_INFO: `/v3/users/swift` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:46.583000 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 282/553] 10.222.0.44 () {56 vars in 1109 bytes} [Thu Jun 16 12:13:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:13:46.591141 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0e75eb-f5ac-4b3f-9da0-b8135c5048a8 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:46.595313 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfd4466-ae2f-4f2e-953f-bf652cee237a None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:13:46.596837 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfd4466-ae2f-4f2e-953f-bf652cee237a None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:13:46.628501 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application [None req-3bfd4466-ae2f-4f2e-953f-bf652cee237a None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 16 12:13:46.628501 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 12:13:46.628501 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 12:13:46.628501 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 12:13:46.628501 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 12:13:46.628501 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 12:13:46.628501 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 12:13:46.628501 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 12:13:46.628501 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 12:13:46.628501 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 12:13:46.628501 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 12:13:46.628501 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 12:13:46.628501 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 12:13:46.628501 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 12:13:46.628501 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 12:13:46.628501 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 12:13:46.629601 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 12:13:46.629601 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 12:13:46.629601 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 12:13:46.629601 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 12:13:46.629601 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 12:13:46.629601 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 12:13:46.629601 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 12:13:46.629601 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 12:13:46.629601 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 12:13:46.629601 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 12:13:46.629601 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 12:13:46.629601 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application with Lock( Jun 16 12:13:46.629601 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 12:13:46.629601 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._enter() Jun 16 12:13:46.629601 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 12:13:46.629601 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 12:13:46.629601 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 12:13:46.629601 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.creator() Jun 16 12:13:46.631040 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 12:13:46.631040 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application created_value = creator( Jun 16 12:13:46.631040 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 12:13:46.631040 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 12:13:46.631040 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 12:13:46.631040 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 12:13:46.631040 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 12:13:46.631040 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 12:13:46.631040 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 16 12:13:46.631040 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application Jun 16 12:13:46.631040 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 272/554] 10.222.0.44 () {56 vars in 1096 bytes} [Thu Jun 16 12:13:46 2022] GET /identity/v3/users/swift => generated 83 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 12:13:46.637359 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfd4466-ae2f-4f2e-953f-bf652cee237a None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:46.727097 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0e75eb-f5ac-4b3f-9da0-b8135c5048a8 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:46.759150 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:13:46.770534 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3affed18-35fc-4d32-9175-bed988a1e71e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:46.771958 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3affed18-35fc-4d32-9175-bed988a1e71e None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:46.772159 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3affed18-35fc-4d32-9175-bed988a1e71e None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:46.772433 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3affed18-35fc-4d32-9175-bed988a1e71e None admin] PATH_INFO: `/v3/users/nova` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:46.775799 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfd4466-ae2f-4f2e-953f-bf652cee237a None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:46.779961 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3affed18-35fc-4d32-9175-bed988a1e71e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:13:46.781447 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3affed18-35fc-4d32-9175-bed988a1e71e None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:13:46.796161 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-3affed18-35fc-4d32-9175-bed988a1e71e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 16 12:13:46.796161 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 12:13:46.796161 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 12:13:46.796161 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 12:13:46.796161 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 12:13:46.796161 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 12:13:46.796161 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 12:13:46.796161 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 12:13:46.796161 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 12:13:46.796161 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 12:13:46.796161 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 12:13:46.796161 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 12:13:46.796161 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 12:13:46.796161 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 12:13:46.796161 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 12:13:46.796161 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 12:13:46.797288 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 12:13:46.797288 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 12:13:46.797288 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 12:13:46.797288 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 12:13:46.797288 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 12:13:46.797288 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 12:13:46.797288 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 12:13:46.797288 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 12:13:46.797288 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 12:13:46.797288 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 12:13:46.797288 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 12:13:46.797288 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jun 16 12:13:46.797288 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 12:13:46.797288 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jun 16 12:13:46.797288 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 12:13:46.797288 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 12:13:46.797288 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 12:13:46.797288 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jun 16 12:13:46.803144 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 12:13:46.803144 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jun 16 12:13:46.803144 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 12:13:46.803144 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 12:13:46.803144 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 12:13:46.803144 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 12:13:46.803144 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 12:13:46.803144 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 12:13:46.803144 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 16 12:13:46.803144 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jun 16 12:13:46.803144 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 283/555] 10.222.0.44 () {56 vars in 1093 bytes} [Thu Jun 16 12:13:46 2022] GET /identity/v3/users/nova => generated 82 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 12:13:46.803144 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d304c57-c03d-426d-b6f3-db5836868012 None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:46.803144 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d304c57-c03d-426d-b6f3-db5836868012 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:46.803834 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d304c57-c03d-426d-b6f3-db5836868012 None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:46.803834 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 284/556] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 12:13:46 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 12:13:46.803834 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f5c2a8-86c8-4d32-8072-e8e5fd8db8f2 None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:46.803834 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f5c2a8-86c8-4d32-8072-e8e5fd8db8f2 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:46.803834 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f5c2a8-86c8-4d32-8072-e8e5fd8db8f2 None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:46.803834 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 285/557] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 12:13:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 12:13:46.804773 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f5c2a8-86c8-4d32-8072-e8e5fd8db8f2 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:46.826149 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e18e3b-65e5-4a51-8f20-d34cdeb15287 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:46.826824 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e18e3b-65e5-4a51-8f20-d34cdeb15287 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:46.827101 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e18e3b-65e5-4a51-8f20-d34cdeb15287 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:46.827372 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e18e3b-65e5-4a51-8f20-d34cdeb15287 None admin] PATH_INFO: `/v3/users` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:46.828630 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e18e3b-65e5-4a51-8f20-d34cdeb15287 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:13:46.828972 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e18e3b-65e5-4a51-8f20-d34cdeb15287 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:13:46.830383 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e18e3b-65e5-4a51-8f20-d34cdeb15287 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:13:46.848810 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 273/558] 10.222.0.44 () {56 vars in 1135 bytes} [Thu Jun 16 12:13:46 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:13:46.854421 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c402cb2-2eac-4151-b8f3-b76776a15add None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:46.854716 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c402cb2-2eac-4151-b8f3-b76776a15add None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:46.855293 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c402cb2-2eac-4151-b8f3-b76776a15add None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:46.871092 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-6c402cb2-2eac-4151-b8f3-b76776a15add None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:13:46.872271 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-6c402cb2-2eac-4151-b8f3-b76776a15add None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:13:46.912735 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f5c2a8-86c8-4d32-8072-e8e5fd8db8f2 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:46.927523 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:13:46.950762 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4ce2d1-ab68-4715-aea3-cc564ff8c791 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:46.951443 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4ce2d1-ab68-4715-aea3-cc564ff8c791 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:46.951724 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4ce2d1-ab68-4715-aea3-cc564ff8c791 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:46.951998 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4ce2d1-ab68-4715-aea3-cc564ff8c791 None admin] PATH_INFO: `/v3/users` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:46.952864 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4ce2d1-ab68-4715-aea3-cc564ff8c791 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:13:46.953173 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4ce2d1-ab68-4715-aea3-cc564ff8c791 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:13:46.954611 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4ce2d1-ab68-4715-aea3-cc564ff8c791 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:13:46.956729 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 274/559] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 12:13:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 12:13:46.958294 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa993e9-d561-4ac0-ad92-94a8044a40a9 None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:46.958580 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa993e9-d561-4ac0-ad92-94a8044a40a9 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:46.959463 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa993e9-d561-4ac0-ad92-94a8044a40a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:46.983504 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 286/560] 10.222.0.44 () {56 vars in 1133 bytes} [Thu Jun 16 12:13:46 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:13:46.984416 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-7aa993e9-d561-4ac0-ad92-94a8044a40a9 None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:13:46.984655 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4ce2d1-ab68-4715-aea3-cc564ff8c791 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:46.985632 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-7aa993e9-d561-4ac0-ad92-94a8044a40a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:13:47.033263 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:13:47.060074 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 275/561] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 12:13:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 12:13:47.060863 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa993e9-d561-4ac0-ad92-94a8044a40a9 None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:47.099375 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4ce2d1-ab68-4715-aea3-cc564ff8c791 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:47.135573 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120eab7f-32af-4e8f-9a20-912ed1b5f6bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:47.136209 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120eab7f-32af-4e8f-9a20-912ed1b5f6bd None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:47.136488 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120eab7f-32af-4e8f-9a20-912ed1b5f6bd None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:47.136778 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120eab7f-32af-4e8f-9a20-912ed1b5f6bd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:47.174531 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa993e9-d561-4ac0-ad92-94a8044a40a9 None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:47.186789 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:13:47.207944 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120eab7f-32af-4e8f-9a20-912ed1b5f6bd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:13:47.209467 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120eab7f-32af-4e8f-9a20-912ed1b5f6bd None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:13:47.213104 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0fdca8-38d0-4fe3-9262-2d9a3c7846e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:47.213927 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0fdca8-38d0-4fe3-9262-2d9a3c7846e6 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:47.214208 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0fdca8-38d0-4fe3-9262-2d9a3c7846e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:47.214477 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0fdca8-38d0-4fe3-9262-2d9a3c7846e6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:47.226415 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0fdca8-38d0-4fe3-9262-2d9a3c7846e6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 12:13:47.234162 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application [None req-eb0fdca8-38d0-4fe3-9262-2d9a3c7846e6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 16 12:13:47.234162 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 12:13:47.234162 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 12:13:47.234162 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 12:13:47.234162 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 12:13:47.234162 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 12:13:47.234162 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 12:13:47.234162 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 12:13:47.234162 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 12:13:47.234162 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 12:13:47.234162 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 12:13:47.234162 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 12:13:47.234162 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 12:13:47.234162 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 12:13:47.234162 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 12:13:47.234162 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 12:13:47.235069 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 12:13:47.235069 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 12:13:47.235069 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 12:13:47.235069 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 12:13:47.235069 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 12:13:47.235069 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 12:13:47.235069 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 12:13:47.235069 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 12:13:47.235069 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 12:13:47.235069 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 12:13:47.235069 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 12:13:47.235069 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application with Lock( Jun 16 12:13:47.235069 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 12:13:47.235069 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._enter() Jun 16 12:13:47.235069 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 12:13:47.235069 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 12:13:47.235967 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 12:13:47.235967 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.creator() Jun 16 12:13:47.235967 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 12:13:47.235967 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application created_value = creator( Jun 16 12:13:47.235967 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 12:13:47.235967 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 12:13:47.235967 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 12:13:47.235967 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 12:13:47.235967 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 12:13:47.235967 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 12:13:47.235967 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 16 12:13:47.235967 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application Jun 16 12:13:47.235967 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 276/562] 10.222.0.44 () {56 vars in 1102 bytes} [Thu Jun 16 12:13:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 12:13:47.237371 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0fdca8-38d0-4fe3-9262-2d9a3c7846e6 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:47.257749 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:13:47.327323 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 287/563] 10.222.0.44 () {58 vars in 1282 bytes} [Thu Jun 16 12:13:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 12:13:47.327323 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120eab7f-32af-4e8f-9a20-912ed1b5f6bd None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:47.349979 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0fdca8-38d0-4fe3-9262-2d9a3c7846e6 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:47.383506 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7daef9f1-7e72-4b0f-8caa-5030243343f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:47.384287 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7daef9f1-7e72-4b0f-8caa-5030243343f6 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:47.384565 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7daef9f1-7e72-4b0f-8caa-5030243343f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:47.384872 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7daef9f1-7e72-4b0f-8caa-5030243343f6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:47.395127 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7daef9f1-7e72-4b0f-8caa-5030243343f6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:13:47.396590 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7daef9f1-7e72-4b0f-8caa-5030243343f6 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:13:47.413602 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application [None req-7daef9f1-7e72-4b0f-8caa-5030243343f6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 12:13:47.413602 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 12:13:47.413602 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 12:13:47.413602 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 12:13:47.413602 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 12:13:47.413602 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 12:13:47.413602 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 12:13:47.413602 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 12:13:47.413602 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 12:13:47.413602 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 12:13:47.413602 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 12:13:47.413602 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 12:13:47.413602 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 12:13:47.413602 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 12:13:47.413602 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 12:13:47.414464 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 12:13:47.414464 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 12:13:47.414464 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 12:13:47.414464 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 12:13:47.414464 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 12:13:47.414464 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 12:13:47.414464 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 12:13:47.414464 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 12:13:47.414464 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application with Lock( Jun 16 12:13:47.414464 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 12:13:47.414464 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._enter() Jun 16 12:13:47.414464 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 12:13:47.414464 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 12:13:47.414464 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 12:13:47.414464 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.creator() Jun 16 12:13:47.414464 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 12:13:47.414464 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application created_value = creator( Jun 16 12:13:47.415314 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 12:13:47.415314 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 12:13:47.415314 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 12:13:47.415314 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application Jun 16 12:13:47.415314 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 277/564] 10.222.0.44 () {56 vars in 1108 bytes} [Thu Jun 16 12:13:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 12:13:47.415947 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7daef9f1-7e72-4b0f-8caa-5030243343f6 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:47.428201 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120eab7f-32af-4e8f-9a20-912ed1b5f6bd None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:47.443991 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:13:47.461833 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25d83a7-5893-4a4c-87d6-403d43566361 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:47.462627 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25d83a7-5893-4a4c-87d6-403d43566361 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:47.462906 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25d83a7-5893-4a4c-87d6-403d43566361 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:47.463185 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25d83a7-5893-4a4c-87d6-403d43566361 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:47.472999 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25d83a7-5893-4a4c-87d6-403d43566361 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 12:13:47.481265 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-f25d83a7-5893-4a4c-87d6-403d43566361 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 16 12:13:47.481265 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 12:13:47.481265 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 12:13:47.481265 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 12:13:47.481265 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 12:13:47.481265 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 12:13:47.481265 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 12:13:47.481265 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 12:13:47.481265 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 12:13:47.481265 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 12:13:47.481265 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 12:13:47.481265 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 12:13:47.481265 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 12:13:47.481265 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 12:13:47.481265 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 12:13:47.481265 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 12:13:47.482150 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 12:13:47.482150 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 12:13:47.482150 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 12:13:47.482150 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 12:13:47.482150 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 12:13:47.482150 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 12:13:47.482150 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 12:13:47.482150 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 12:13:47.482150 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 12:13:47.482150 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 12:13:47.482150 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 12:13:47.482150 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jun 16 12:13:47.482150 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 12:13:47.482150 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jun 16 12:13:47.482150 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 12:13:47.482150 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 12:13:47.482972 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 12:13:47.482972 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jun 16 12:13:47.482972 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 12:13:47.482972 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jun 16 12:13:47.482972 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 12:13:47.482972 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 12:13:47.482972 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 12:13:47.482972 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 12:13:47.482972 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 12:13:47.482972 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 12:13:47.482972 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 16 12:13:47.482972 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jun 16 12:13:47.482972 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 288/565] 10.222.0.44 () {56 vars in 1102 bytes} [Thu Jun 16 12:13:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 12:13:47.483643 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25d83a7-5893-4a4c-87d6-403d43566361 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:47.487308 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:13:47.521219 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7daef9f1-7e72-4b0f-8caa-5030243343f6 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:47.554726 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d177af99-5146-4f74-9d2e-b0e20009fcf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:47.555407 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d177af99-5146-4f74-9d2e-b0e20009fcf3 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:47.555692 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d177af99-5146-4f74-9d2e-b0e20009fcf3 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:47.555968 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d177af99-5146-4f74-9d2e-b0e20009fcf3 None admin] PATH_INFO: `/v3/roles` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:47.556711 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d177af99-5146-4f74-9d2e-b0e20009fcf3 None admin] RBAC: Adding query filter params (name=service) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:13:47.557052 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d177af99-5146-4f74-9d2e-b0e20009fcf3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:13:47.558416 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d177af99-5146-4f74-9d2e-b0e20009fcf3 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:13:47.566233 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 278/566] 10.222.0.44 () {56 vars in 1103 bytes} [Thu Jun 16 12:13:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:13:47.567428 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92743b56-6149-42de-97c2-4a0dfd4f64ce None None] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:47.567714 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92743b56-6149-42de-97c2-4a0dfd4f64ce None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:47.568491 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92743b56-6149-42de-97c2-4a0dfd4f64ce None None] PATH_INFO: `/` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:47.569749 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 279/567] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 12:13:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 12:13:47.570444 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92743b56-6149-42de-97c2-4a0dfd4f64ce None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:47.587039 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25d83a7-5893-4a4c-87d6-403d43566361 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:47.619227 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262856b9-5deb-4b34-a059-adb24d3861b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:47.620019 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262856b9-5deb-4b34-a059-adb24d3861b0 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:47.620293 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262856b9-5deb-4b34-a059-adb24d3861b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:47.620578 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262856b9-5deb-4b34-a059-adb24d3861b0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:47.631173 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262856b9-5deb-4b34-a059-adb24d3861b0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:13:47.632612 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262856b9-5deb-4b34-a059-adb24d3861b0 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:13:47.649646 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-262856b9-5deb-4b34-a059-adb24d3861b0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 12:13:47.649646 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 12:13:47.649646 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 12:13:47.649646 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 12:13:47.649646 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 12:13:47.649646 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 12:13:47.649646 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 12:13:47.649646 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 12:13:47.649646 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 12:13:47.649646 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 12:13:47.649646 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 12:13:47.649646 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 12:13:47.649646 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 12:13:47.649646 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 12:13:47.649646 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 12:13:47.650503 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 12:13:47.650503 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 12:13:47.650503 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 12:13:47.650503 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 12:13:47.650503 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 12:13:47.650503 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 12:13:47.650503 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 12:13:47.650503 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 12:13:47.650503 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jun 16 12:13:47.650503 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 12:13:47.650503 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jun 16 12:13:47.650503 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 12:13:47.650503 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 12:13:47.650503 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 12:13:47.650503 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jun 16 12:13:47.650503 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 12:13:47.650503 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jun 16 12:13:47.651409 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 12:13:47.651409 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 12:13:47.651409 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 12:13:47.651409 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jun 16 12:13:47.651409 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 289/568] 10.222.0.44 () {56 vars in 1108 bytes} [Thu Jun 16 12:13:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 12:13:47.651675 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262856b9-5deb-4b34-a059-adb24d3861b0 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:47.661476 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:13:47.679226 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92743b56-6149-42de-97c2-4a0dfd4f64ce None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:47.706833 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:13:47.714980 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6430c663-5dff-4697-8344-0d66942c6fa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:47.715638 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6430c663-5dff-4697-8344-0d66942c6fa0 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:47.715921 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6430c663-5dff-4697-8344-0d66942c6fa0 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:47.716198 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6430c663-5dff-4697-8344-0d66942c6fa0 None admin] PATH_INFO: `/v3/domains` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:47.716943 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6430c663-5dff-4697-8344-0d66942c6fa0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:13:47.717251 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6430c663-5dff-4697-8344-0d66942c6fa0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:13:47.718614 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6430c663-5dff-4697-8344-0d66942c6fa0 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:13:47.729601 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 280/569] 10.222.0.44 () {56 vars in 1109 bytes} [Thu Jun 16 12:13:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:13:47.730388 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6430c663-5dff-4697-8344-0d66942c6fa0 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:47.755523 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262856b9-5deb-4b34-a059-adb24d3861b0 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:47.788237 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91f810c-34b2-4296-8ac8-03fc830788de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:47.788929 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91f810c-34b2-4296-8ac8-03fc830788de None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:47.789233 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91f810c-34b2-4296-8ac8-03fc830788de None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:47.789505 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91f810c-34b2-4296-8ac8-03fc830788de None admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:47.790246 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91f810c-34b2-4296-8ac8-03fc830788de None admin] RBAC: Adding query filter params (name=service) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:13:47.790546 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91f810c-34b2-4296-8ac8-03fc830788de None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:13:47.791913 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91f810c-34b2-4296-8ac8-03fc830788de None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:13:47.799891 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 290/570] 10.222.0.44 () {56 vars in 1103 bytes} [Thu Jun 16 12:13:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:13:47.801084 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c19090-4d5b-4db6-8d6e-5710ad8d97c0 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:47.801367 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c19090-4d5b-4db6-8d6e-5710ad8d97c0 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:47.801640 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c19090-4d5b-4db6-8d6e-5710ad8d97c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:47.817569 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-33c19090-4d5b-4db6-8d6e-5710ad8d97c0 None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:13:47.819312 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-33c19090-4d5b-4db6-8d6e-5710ad8d97c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:13:47.830018 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6430c663-5dff-4697-8344-0d66942c6fa0 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:47.862368 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0a832f-1b4d-494c-be49-e7c4c4a41511 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:47.863151 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0a832f-1b4d-494c-be49-e7c4c4a41511 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:47.863431 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0a832f-1b4d-494c-be49-e7c4c4a41511 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:47.863708 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0a832f-1b4d-494c-be49-e7c4c4a41511 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:47.874624 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0a832f-1b4d-494c-be49-e7c4c4a41511 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:13:47.876058 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0a832f-1b4d-494c-be49-e7c4c4a41511 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:13:47.878539 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:13:47.883633 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 291/571] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 12:13:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 12:13:47.884448 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c19090-4d5b-4db6-8d6e-5710ad8d97c0 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:47.897075 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application [None req-de0a832f-1b4d-494c-be49-e7c4c4a41511 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 12:13:47.897075 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 12:13:47.897075 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 12:13:47.897075 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 12:13:47.897075 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 12:13:47.897075 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 12:13:47.897075 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 12:13:47.897075 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 12:13:47.897075 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 12:13:47.897075 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 12:13:47.897075 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 12:13:47.897075 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 12:13:47.897075 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 12:13:47.897075 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 12:13:47.897075 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 12:13:47.898105 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 12:13:47.898105 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 12:13:47.898105 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 12:13:47.898105 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 12:13:47.898105 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 12:13:47.898105 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 12:13:47.898105 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 12:13:47.898105 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 12:13:47.898105 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application with Lock( Jun 16 12:13:47.898105 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 12:13:47.898105 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._enter() Jun 16 12:13:47.898105 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 12:13:47.898105 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 12:13:47.898105 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 12:13:47.898105 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.creator() Jun 16 12:13:47.898105 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 12:13:47.898105 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application created_value = creator( Jun 16 12:13:47.899256 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 12:13:47.899256 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 12:13:47.899256 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 12:13:47.899256 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application Jun 16 12:13:47.905945 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 281/572] 10.222.0.44 () {56 vars in 1108 bytes} [Thu Jun 16 12:13:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 12:13:47.907408 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0a832f-1b4d-494c-be49-e7c4c4a41511 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:47.932184 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:13:47.985541 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c19090-4d5b-4db6-8d6e-5710ad8d97c0 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:48.010490 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0a832f-1b4d-494c-be49-e7c4c4a41511 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:48.018940 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd38d87-09dd-4c5b-9fc8-f2a7a237d72e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:48.019597 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd38d87-09dd-4c5b-9fc8-f2a7a237d72e None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:48.019882 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd38d87-09dd-4c5b-9fc8-f2a7a237d72e None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:48.020154 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd38d87-09dd-4c5b-9fc8-f2a7a237d72e None admin] PATH_INFO: `/v3/domains` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:48.020918 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd38d87-09dd-4c5b-9fc8-f2a7a237d72e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:13:48.021228 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd38d87-09dd-4c5b-9fc8-f2a7a237d72e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:13:48.022593 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd38d87-09dd-4c5b-9fc8-f2a7a237d72e None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:13:48.033473 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 292/573] 10.222.0.44 () {56 vars in 1109 bytes} [Thu Jun 16 12:13:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:13:48.034242 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd38d87-09dd-4c5b-9fc8-f2a7a237d72e None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:48.044330 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524a7ef3-5663-4136-a562-e870698fec88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:48.045149 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524a7ef3-5663-4136-a562-e870698fec88 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:48.045432 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524a7ef3-5663-4136-a562-e870698fec88 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:48.045707 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524a7ef3-5663-4136-a562-e870698fec88 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:48.052826 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524a7ef3-5663-4136-a562-e870698fec88 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:13:48.054290 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524a7ef3-5663-4136-a562-e870698fec88 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:13:48.068835 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application [None req-524a7ef3-5663-4136-a562-e870698fec88 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 12:13:48.068835 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 12:13:48.068835 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 12:13:48.068835 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 12:13:48.068835 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 12:13:48.068835 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 12:13:48.068835 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 12:13:48.068835 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 12:13:48.068835 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 12:13:48.068835 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 12:13:48.068835 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 12:13:48.068835 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 12:13:48.068835 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 12:13:48.068835 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 12:13:48.068835 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 12:13:48.069833 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 12:13:48.069833 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 12:13:48.069833 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 12:13:48.069833 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 12:13:48.069833 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 12:13:48.069833 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 12:13:48.069833 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 12:13:48.069833 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 12:13:48.069833 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application with Lock( Jun 16 12:13:48.069833 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 12:13:48.069833 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._enter() Jun 16 12:13:48.069833 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 12:13:48.069833 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 12:13:48.069833 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 12:13:48.069833 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.creator() Jun 16 12:13:48.069833 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 12:13:48.069833 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application created_value = creator( Jun 16 12:13:48.070705 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 12:13:48.070705 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 12:13:48.070705 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 12:13:48.070705 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 12:13:48.070705 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 12:13:48.070705 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 12:13:48.070705 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 12:13:48.070705 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application Jun 16 12:13:48.070705 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 282/574] 10.222.0.44 () {56 vars in 1111 bytes} [Thu Jun 16 12:13:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 12:13:48.071441 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524a7ef3-5663-4136-a562-e870698fec88 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:48.129438 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:13:48.130717 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd38d87-09dd-4c5b-9fc8-f2a7a237d72e None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:48.137751 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:13:48.164679 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801b042f-6d26-4731-9621-719f3c3d074c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:48.165510 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801b042f-6d26-4731-9621-719f3c3d074c None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:48.165789 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801b042f-6d26-4731-9621-719f3c3d074c None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:48.166059 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801b042f-6d26-4731-9621-719f3c3d074c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:48.173678 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524a7ef3-5663-4136-a562-e870698fec88 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:48.176726 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801b042f-6d26-4731-9621-719f3c3d074c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:13:48.178961 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801b042f-6d26-4731-9621-719f3c3d074c None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:13:48.195933 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-801b042f-6d26-4731-9621-719f3c3d074c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 12:13:48.195933 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 12:13:48.195933 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 12:13:48.195933 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 12:13:48.195933 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 12:13:48.195933 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 12:13:48.195933 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 12:13:48.195933 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 12:13:48.195933 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 12:13:48.195933 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 12:13:48.195933 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 12:13:48.195933 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 12:13:48.195933 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 12:13:48.195933 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 12:13:48.195933 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 12:13:48.196888 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 12:13:48.196888 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 12:13:48.196888 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 12:13:48.196888 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 12:13:48.196888 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 12:13:48.196888 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 12:13:48.196888 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 12:13:48.196888 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 12:13:48.196888 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jun 16 12:13:48.196888 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 12:13:48.196888 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jun 16 12:13:48.196888 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 12:13:48.196888 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 12:13:48.196888 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 12:13:48.196888 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jun 16 12:13:48.196888 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 12:13:48.196888 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jun 16 12:13:48.197760 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 12:13:48.197760 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 12:13:48.197760 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 12:13:48.197760 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jun 16 12:13:48.197760 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 293/575] 10.222.0.44 () {56 vars in 1108 bytes} [Thu Jun 16 12:13:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 12:13:48.198048 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801b042f-6d26-4731-9621-719f3c3d074c None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:48.213103 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59697e0-85f9-41f9-8542-4505e5ada86f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:48.213974 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59697e0-85f9-41f9-8542-4505e5ada86f None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:48.214260 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59697e0-85f9-41f9-8542-4505e5ada86f None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:48.214532 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59697e0-85f9-41f9-8542-4505e5ada86f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:48.226077 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59697e0-85f9-41f9-8542-4505e5ada86f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 12:13:48.233747 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application [None req-f59697e0-85f9-41f9-8542-4505e5ada86f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 16 12:13:48.233747 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 12:13:48.233747 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 12:13:48.233747 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 12:13:48.233747 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 12:13:48.233747 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 12:13:48.233747 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 12:13:48.233747 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 12:13:48.233747 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 12:13:48.233747 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 12:13:48.233747 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 12:13:48.233747 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 12:13:48.233747 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 12:13:48.233747 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 12:13:48.233747 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 12:13:48.233747 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 12:13:48.234846 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 12:13:48.234846 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 12:13:48.234846 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 12:13:48.234846 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 12:13:48.234846 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 12:13:48.234846 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 12:13:48.234846 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 12:13:48.234846 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 12:13:48.234846 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 12:13:48.234846 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 12:13:48.234846 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 12:13:48.234846 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application with Lock( Jun 16 12:13:48.234846 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 12:13:48.234846 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._enter() Jun 16 12:13:48.234846 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 12:13:48.234846 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 12:13:48.241328 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 12:13:48.241328 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.creator() Jun 16 12:13:48.241328 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 12:13:48.241328 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application created_value = creator( Jun 16 12:13:48.241328 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 12:13:48.241328 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 12:13:48.241328 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 12:13:48.241328 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 12:13:48.241328 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 12:13:48.241328 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 12:13:48.241328 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 16 12:13:48.241328 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application Jun 16 12:13:48.241328 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 283/576] 10.222.0.44 () {56 vars in 1102 bytes} [Thu Jun 16 12:13:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 12:13:48.241328 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59697e0-85f9-41f9-8542-4505e5ada86f None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:48.300528 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801b042f-6d26-4731-9621-719f3c3d074c None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:48.331865 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59697e0-85f9-41f9-8542-4505e5ada86f None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:48.333551 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1daa9ed1-860d-438b-969b-2ff7b77cf77a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:48.334209 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daa9ed1-860d-438b-969b-2ff7b77cf77a None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:48.334494 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daa9ed1-860d-438b-969b-2ff7b77cf77a None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:48.334772 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daa9ed1-860d-438b-969b-2ff7b77cf77a None admin] PATH_INFO: `/v3/domains` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:48.335486 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1daa9ed1-860d-438b-969b-2ff7b77cf77a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:13:48.335792 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1daa9ed1-860d-438b-969b-2ff7b77cf77a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:13:48.337209 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1daa9ed1-860d-438b-969b-2ff7b77cf77a None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:13:48.347418 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:13:48.348600 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 294/577] 10.222.0.44 () {56 vars in 1109 bytes} [Thu Jun 16 12:13:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:13:48.349922 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1daa9ed1-860d-438b-969b-2ff7b77cf77a None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:48.366497 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62799b0-b4f0-4ce3-a6f3-e315b9678674 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:48.367280 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62799b0-b4f0-4ce3-a6f3-e315b9678674 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:48.367637 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62799b0-b4f0-4ce3-a6f3-e315b9678674 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:48.367823 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62799b0-b4f0-4ce3-a6f3-e315b9678674 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:48.371782 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:13:48.374560 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62799b0-b4f0-4ce3-a6f3-e315b9678674 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:13:48.375985 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62799b0-b4f0-4ce3-a6f3-e315b9678674 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:13:48.391096 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application [None req-a62799b0-b4f0-4ce3-a6f3-e315b9678674 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 12:13:48.391096 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 12:13:48.391096 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 12:13:48.391096 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 12:13:48.391096 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 12:13:48.391096 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 12:13:48.391096 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 12:13:48.391096 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 12:13:48.391096 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 12:13:48.391096 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 12:13:48.391096 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 12:13:48.391096 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 12:13:48.391096 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 12:13:48.391096 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 12:13:48.391096 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 12:13:48.391964 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 12:13:48.391964 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 12:13:48.391964 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 12:13:48.391964 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 12:13:48.391964 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 12:13:48.391964 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 12:13:48.391964 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 12:13:48.391964 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 12:13:48.391964 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application with Lock( Jun 16 12:13:48.391964 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 12:13:48.391964 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._enter() Jun 16 12:13:48.391964 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 12:13:48.391964 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 12:13:48.391964 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 12:13:48.391964 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.creator() Jun 16 12:13:48.391964 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 12:13:48.391964 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application created_value = creator( Jun 16 12:13:48.392871 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 12:13:48.392871 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 12:13:48.392871 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 12:13:48.392871 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 12:13:48.392871 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 12:13:48.392871 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 12:13:48.392871 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 12:13:48.392871 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application Jun 16 12:13:48.392871 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 284/578] 10.222.0.44 () {56 vars in 1111 bytes} [Thu Jun 16 12:13:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 12:13:48.393449 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62799b0-b4f0-4ce3-a6f3-e315b9678674 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:48.453605 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1daa9ed1-860d-438b-969b-2ff7b77cf77a None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:48.486356 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa89183-4474-47a9-878d-59df601e2682 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:48.487001 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa89183-4474-47a9-878d-59df601e2682 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:48.487275 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa89183-4474-47a9-878d-59df601e2682 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:48.487541 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa89183-4474-47a9-878d-59df601e2682 None admin] PATH_INFO: `/v3/projects` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:48.488321 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa89183-4474-47a9-878d-59df601e2682 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:13:48.488619 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa89183-4474-47a9-878d-59df601e2682 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:13:48.490612 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa89183-4474-47a9-878d-59df601e2682 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:13:48.494053 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62799b0-b4f0-4ce3-a6f3-e315b9678674 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:48.501679 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 295/579] 10.222.0.44 () {56 vars in 1148 bytes} [Thu Jun 16 12:13:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:13:48.502444 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa89183-4474-47a9-878d-59df601e2682 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:48.531625 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d089939-ce6f-4699-8de0-7e08cd035417 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:48.532269 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d089939-ce6f-4699-8de0-7e08cd035417 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:48.532545 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d089939-ce6f-4699-8de0-7e08cd035417 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:48.532913 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d089939-ce6f-4699-8de0-7e08cd035417 None admin] PATH_INFO: `/v3/domains` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:48.533632 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d089939-ce6f-4699-8de0-7e08cd035417 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:13:48.533930 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d089939-ce6f-4699-8de0-7e08cd035417 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:13:48.535273 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d089939-ce6f-4699-8de0-7e08cd035417 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:13:48.546337 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 285/580] 10.222.0.44 () {56 vars in 1109 bytes} [Thu Jun 16 12:13:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:13:48.547111 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d089939-ce6f-4699-8de0-7e08cd035417 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:48.581233 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:13:48.582365 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:13:48.603257 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa89183-4474-47a9-878d-59df601e2682 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:48.635535 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f08de49-1a82-47ab-8ade-5d4b53c05fe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:48.636187 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f08de49-1a82-47ab-8ade-5d4b53c05fe6 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:48.636462 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f08de49-1a82-47ab-8ade-5d4b53c05fe6 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:48.636730 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f08de49-1a82-47ab-8ade-5d4b53c05fe6 None admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:48.637486 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f08de49-1a82-47ab-8ade-5d4b53c05fe6 None admin] RBAC: Adding query filter params (name=service) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:13:48.637785 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f08de49-1a82-47ab-8ade-5d4b53c05fe6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:13:48.639132 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f08de49-1a82-47ab-8ade-5d4b53c05fe6 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:13:48.644294 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d089939-ce6f-4699-8de0-7e08cd035417 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:48.647236 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 296/581] 10.222.0.44 () {56 vars in 1103 bytes} [Thu Jun 16 12:13:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:13:48.648004 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f08de49-1a82-47ab-8ade-5d4b53c05fe6 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:48.678669 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fb56df-3751-4d80-8672-17b126be0418 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:48.679454 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fb56df-3751-4d80-8672-17b126be0418 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:48.679730 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fb56df-3751-4d80-8672-17b126be0418 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:48.680000 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fb56df-3751-4d80-8672-17b126be0418 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:48.687229 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fb56df-3751-4d80-8672-17b126be0418 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:13:48.688640 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fb56df-3751-4d80-8672-17b126be0418 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:13:48.703318 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application [None req-e5fb56df-3751-4d80-8672-17b126be0418 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 16 12:13:48.703318 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 12:13:48.703318 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 12:13:48.703318 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 12:13:48.703318 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 12:13:48.703318 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 12:13:48.703318 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 12:13:48.703318 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 12:13:48.703318 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 12:13:48.703318 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 12:13:48.703318 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 12:13:48.703318 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 12:13:48.703318 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 12:13:48.703318 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 12:13:48.703318 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 12:13:48.703318 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 12:13:48.704297 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 12:13:48.704297 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 12:13:48.704297 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 12:13:48.704297 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 12:13:48.704297 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 12:13:48.704297 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 12:13:48.704297 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 12:13:48.704297 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 12:13:48.704297 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 12:13:48.704297 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 12:13:48.704297 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 12:13:48.704297 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application with Lock( Jun 16 12:13:48.704297 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 12:13:48.704297 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._enter() Jun 16 12:13:48.704297 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 12:13:48.704297 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 12:13:48.704297 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 12:13:48.704297 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.creator() Jun 16 12:13:48.710529 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 12:13:48.710529 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application created_value = creator( Jun 16 12:13:48.710529 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 12:13:48.710529 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 12:13:48.710529 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 12:13:48.710529 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 12:13:48.710529 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 12:13:48.710529 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 12:13:48.710529 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 16 12:13:48.710529 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application Jun 16 12:13:48.710529 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 286/582] 10.222.0.44 () {56 vars in 1099 bytes} [Thu Jun 16 12:13:48 2022] GET /identity/v3/users/glance => generated 84 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 12:13:48.710529 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fb56df-3751-4d80-8672-17b126be0418 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:48.745905 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f08de49-1a82-47ab-8ade-5d4b53c05fe6 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:48.778274 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc36e9e-a71b-4272-b119-2b340aa0b743 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:48.778919 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc36e9e-a71b-4272-b119-2b340aa0b743 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:48.779194 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc36e9e-a71b-4272-b119-2b340aa0b743 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:48.779468 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc36e9e-a71b-4272-b119-2b340aa0b743 None admin] PATH_INFO: `/v3/projects` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:48.780242 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc36e9e-a71b-4272-b119-2b340aa0b743 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:13:48.780548 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc36e9e-a71b-4272-b119-2b340aa0b743 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:13:48.782000 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc36e9e-a71b-4272-b119-2b340aa0b743 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:13:48.791284 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:13:48.794860 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 297/583] 10.222.0.44 () {56 vars in 1148 bytes} [Thu Jun 16 12:13:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:13:48.795739 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc36e9e-a71b-4272-b119-2b340aa0b743 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:48.800570 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:13:48.807000 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fb56df-3751-4d80-8672-17b126be0418 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:48.840346 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555dff6e-0935-4c08-90de-211fa7245499 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:48.841253 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555dff6e-0935-4c08-90de-211fa7245499 None admin] REQUEST_METHOD: `PUT` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:48.841527 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555dff6e-0935-4c08-90de-211fa7245499 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:48.841808 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555dff6e-0935-4c08-90de-211fa7245499 None admin] PATH_INFO: `/v3/projects/601361df39e34fcca71175aa94e425c4/users/edfb12d445e74136b90800e93941f468/roles/a5c06bc21d39451285def24673456ff6` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:48.855875 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555dff6e-0935-4c08-90de-211fa7245499 None admin] RBAC: Authorizing `identity:create_grant(project_id=601361df39e34fcca71175aa94e425c4, user_id=edfb12d445e74136b90800e93941f468, role_id=a5c06bc21d39451285def24673456ff6)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:13:48.857366 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555dff6e-0935-4c08-90de-211fa7245499 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:13:48.869668 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 287/584] 10.222.0.44 () {58 vars in 1439 bytes} [Thu Jun 16 12:13:48 2022] PUT /identity/v3/projects/601361df39e34fcca71175aa94e425c4/users/edfb12d445e74136b90800e93941f468/roles/a5c06bc21d39451285def24673456ff6 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:13:48.870304 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555dff6e-0935-4c08-90de-211fa7245499 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:48.899038 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc36e9e-a71b-4272-b119-2b340aa0b743 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:48.945845 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03df7e94-1dff-408f-92dc-4da37ca73ae3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:48.946761 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03df7e94-1dff-408f-92dc-4da37ca73ae3 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:48.947106 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03df7e94-1dff-408f-92dc-4da37ca73ae3 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:48.947385 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03df7e94-1dff-408f-92dc-4da37ca73ae3 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:48.955528 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03df7e94-1dff-408f-92dc-4da37ca73ae3 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:13:48.956956 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03df7e94-1dff-408f-92dc-4da37ca73ae3 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:13:48.972924 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-03df7e94-1dff-408f-92dc-4da37ca73ae3 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 16 12:13:48.972924 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 12:13:48.972924 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 12:13:48.972924 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 12:13:48.972924 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 12:13:48.972924 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 12:13:48.972924 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 12:13:48.972924 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 12:13:48.972924 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 12:13:48.972924 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 12:13:48.972924 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 12:13:48.972924 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 12:13:48.972924 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 12:13:48.972924 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 12:13:48.972924 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 12:13:48.972924 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 12:13:48.974162 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 12:13:48.974162 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 12:13:48.974162 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 12:13:48.974162 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 12:13:48.974162 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 12:13:48.974162 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 12:13:48.974162 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 12:13:48.974162 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 12:13:48.974162 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 12:13:48.974162 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 12:13:48.974162 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 12:13:48.974162 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jun 16 12:13:48.974162 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 12:13:48.974162 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jun 16 12:13:48.974162 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 12:13:48.974162 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 12:13:48.974162 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 12:13:48.974162 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jun 16 12:13:48.975123 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 12:13:48.975123 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jun 16 12:13:48.975123 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 12:13:48.975123 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 12:13:48.975123 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 12:13:48.975123 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 12:13:48.975123 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 12:13:48.975123 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 12:13:48.975123 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 16 12:13:48.975123 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jun 16 12:13:48.975123 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 298/585] 10.222.0.44 () {56 vars in 1099 bytes} [Thu Jun 16 12:13:48 2022] GET /identity/v3/users/cinder => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 12:13:48.975734 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03df7e94-1dff-408f-92dc-4da37ca73ae3 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:48.994386 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555dff6e-0935-4c08-90de-211fa7245499 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:49.040107 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2030728f-2358-4578-b3d4-fe353b759c9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:49.041652 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2030728f-2358-4578-b3d4-fe353b759c9d None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:49.041652 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2030728f-2358-4578-b3d4-fe353b759c9d None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:49.041652 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2030728f-2358-4578-b3d4-fe353b759c9d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:49.045739 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:13:49.054413 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2030728f-2358-4578-b3d4-fe353b759c9d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:13:49.055858 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2030728f-2358-4578-b3d4-fe353b759c9d None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:13:49.062978 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:13:49.077018 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application [None req-2030728f-2358-4578-b3d4-fe353b759c9d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 12:13:49.077018 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 12:13:49.077018 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 12:13:49.077018 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 12:13:49.077018 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 12:13:49.077018 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 12:13:49.077018 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 12:13:49.077018 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 12:13:49.077018 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 12:13:49.077018 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 12:13:49.077018 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 12:13:49.077018 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 12:13:49.077018 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 12:13:49.077018 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 12:13:49.077018 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 12:13:49.078128 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 12:13:49.078128 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 12:13:49.078128 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 12:13:49.078128 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 12:13:49.078128 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 12:13:49.078128 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 12:13:49.078128 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 12:13:49.078128 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 12:13:49.078128 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application with Lock( Jun 16 12:13:49.078128 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 12:13:49.078128 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._enter() Jun 16 12:13:49.078128 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 12:13:49.078128 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 12:13:49.078128 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 12:13:49.078128 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.creator() Jun 16 12:13:49.078128 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 12:13:49.078128 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application created_value = creator( Jun 16 12:13:49.079199 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 12:13:49.079199 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 12:13:49.079199 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 12:13:49.079199 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application Jun 16 12:13:49.079878 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 288/586] 10.222.0.44 () {56 vars in 1108 bytes} [Thu Jun 16 12:13:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 12:13:49.080797 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2030728f-2358-4578-b3d4-fe353b759c9d None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:49.098409 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03df7e94-1dff-408f-92dc-4da37ca73ae3 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:49.135181 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff5af62-09d4-4a18-a3b7-a64bbb204f54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:49.135852 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff5af62-09d4-4a18-a3b7-a64bbb204f54 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:49.136204 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff5af62-09d4-4a18-a3b7-a64bbb204f54 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:49.136478 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff5af62-09d4-4a18-a3b7-a64bbb204f54 None admin] PATH_INFO: `/v3/users` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:49.137774 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff5af62-09d4-4a18-a3b7-a64bbb204f54 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:13:49.138302 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff5af62-09d4-4a18-a3b7-a64bbb204f54 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:13:49.139935 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff5af62-09d4-4a18-a3b7-a64bbb204f54 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:13:49.163637 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 299/587] 10.222.0.44 () {56 vars in 1137 bytes} [Thu Jun 16 12:13:48 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:13:49.163637 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff5af62-09d4-4a18-a3b7-a64bbb204f54 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:49.190845 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2030728f-2358-4578-b3d4-fe353b759c9d None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:49.228132 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3134017c-4d4a-4374-8caa-3d80be2c2209 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:49.228807 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3134017c-4d4a-4374-8caa-3d80be2c2209 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:49.229114 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3134017c-4d4a-4374-8caa-3d80be2c2209 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:49.229383 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3134017c-4d4a-4374-8caa-3d80be2c2209 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:49.230092 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3134017c-4d4a-4374-8caa-3d80be2c2209 None admin] RBAC: Adding query filter params (role.id=a5c06bc21d39451285def24673456ff6, scope.project.id=601361df39e34fcca71175aa94e425c4, user.id=c159f79c1921496487101aac5d530ae5) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:13:49.230397 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3134017c-4d4a-4374-8caa-3d80be2c2209 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:13:49.231841 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3134017c-4d4a-4374-8caa-3d80be2c2209 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:13:49.248795 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 289/588] 10.222.0.44 () {56 vars in 1374 bytes} [Thu Jun 16 12:13:49 2022] GET /identity/v3/role_assignments?user.id=c159f79c1921496487101aac5d530ae5&scope.project.id=601361df39e34fcca71175aa94e425c4&role.id=a5c06bc21d39451285def24673456ff6 => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:13:49.248795 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3134017c-4d4a-4374-8caa-3d80be2c2209 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:49.270170 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff5af62-09d4-4a18-a3b7-a64bbb204f54 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:49.290513 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:13:49.310733 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d97b45-6dd1-4124-93f8-9a7aeaee9776 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:49.311554 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d97b45-6dd1-4124-93f8-9a7aeaee9776 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:49.311905 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d97b45-6dd1-4124-93f8-9a7aeaee9776 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:49.312252 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d97b45-6dd1-4124-93f8-9a7aeaee9776 None admin] PATH_INFO: `/v3/users` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:49.313212 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d97b45-6dd1-4124-93f8-9a7aeaee9776 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:13:49.313598 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d97b45-6dd1-4124-93f8-9a7aeaee9776 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:13:49.315218 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d97b45-6dd1-4124-93f8-9a7aeaee9776 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:13:49.336374 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 300/589] 10.222.0.44 () {56 vars in 1137 bytes} [Thu Jun 16 12:13:49 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:13:49.337462 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d97b45-6dd1-4124-93f8-9a7aeaee9776 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:49.361348 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:13:49.386545 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3134017c-4d4a-4374-8caa-3d80be2c2209 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:49.428453 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c303e5-43dc-44ec-89ff-ad03860449cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:49.429579 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c303e5-43dc-44ec-89ff-ad03860449cb None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:49.429579 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c303e5-43dc-44ec-89ff-ad03860449cb None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:49.429775 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c303e5-43dc-44ec-89ff-ad03860449cb None admin] PATH_INFO: `/v3/domains` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:49.430480 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c303e5-43dc-44ec-89ff-ad03860449cb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:13:49.430781 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c303e5-43dc-44ec-89ff-ad03860449cb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:13:49.432129 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c303e5-43dc-44ec-89ff-ad03860449cb None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:13:49.446668 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 290/590] 10.222.0.44 () {56 vars in 1109 bytes} [Thu Jun 16 12:13:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:13:49.447515 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c303e5-43dc-44ec-89ff-ad03860449cb None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:49.472542 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d97b45-6dd1-4124-93f8-9a7aeaee9776 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:49.514953 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341952c2-b561-4feb-84b3-c11d351c6f3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:49.515982 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341952c2-b561-4feb-84b3-c11d351c6f3c None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:49.516669 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341952c2-b561-4feb-84b3-c11d351c6f3c None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:49.517335 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341952c2-b561-4feb-84b3-c11d351c6f3c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:49.530961 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341952c2-b561-4feb-84b3-c11d351c6f3c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:13:49.532640 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341952c2-b561-4feb-84b3-c11d351c6f3c None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:13:49.552966 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-341952c2-b561-4feb-84b3-c11d351c6f3c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 12:13:49.552966 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 12:13:49.552966 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 12:13:49.552966 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 12:13:49.552966 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 12:13:49.552966 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 12:13:49.552966 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 12:13:49.552966 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 12:13:49.552966 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 12:13:49.552966 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 12:13:49.552966 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 12:13:49.552966 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 12:13:49.552966 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 12:13:49.552966 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 12:13:49.552966 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 12:13:49.553892 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 12:13:49.553892 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 12:13:49.553892 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 12:13:49.553892 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 12:13:49.553892 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 12:13:49.553892 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 12:13:49.553892 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 12:13:49.553892 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 12:13:49.553892 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jun 16 12:13:49.553892 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 12:13:49.553892 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jun 16 12:13:49.553892 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 12:13:49.553892 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 12:13:49.553892 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 12:13:49.553892 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jun 16 12:13:49.553892 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 12:13:49.553892 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jun 16 12:13:49.554784 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 12:13:49.554784 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 12:13:49.554784 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 12:13:49.554784 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jun 16 12:13:49.554784 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 301/591] 10.222.0.44 () {56 vars in 1108 bytes} [Thu Jun 16 12:13:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 12:13:49.555507 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341952c2-b561-4feb-84b3-c11d351c6f3c None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:49.574952 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c303e5-43dc-44ec-89ff-ad03860449cb None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:49.591693 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:13:49.602186 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:13:49.616040 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca30a4a4-bb25-4d5b-8093-e0c7a6242636 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:49.617128 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca30a4a4-bb25-4d5b-8093-e0c7a6242636 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:49.617577 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca30a4a4-bb25-4d5b-8093-e0c7a6242636 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:49.618097 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca30a4a4-bb25-4d5b-8093-e0c7a6242636 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:49.629668 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca30a4a4-bb25-4d5b-8093-e0c7a6242636 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:13:49.631595 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca30a4a4-bb25-4d5b-8093-e0c7a6242636 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:13:49.650999 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application [None req-ca30a4a4-bb25-4d5b-8093-e0c7a6242636 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 12:13:49.650999 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 12:13:49.650999 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 12:13:49.650999 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 12:13:49.650999 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 12:13:49.650999 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 12:13:49.650999 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 12:13:49.650999 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 12:13:49.650999 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 12:13:49.650999 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 12:13:49.650999 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 12:13:49.650999 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 12:13:49.650999 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 12:13:49.650999 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 12:13:49.650999 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 12:13:49.652145 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 12:13:49.652145 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 12:13:49.652145 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 12:13:49.652145 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 12:13:49.652145 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 12:13:49.652145 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 12:13:49.652145 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 12:13:49.652145 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 12:13:49.652145 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application with Lock( Jun 16 12:13:49.652145 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 12:13:49.652145 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._enter() Jun 16 12:13:49.652145 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 12:13:49.652145 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 12:13:49.652145 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 12:13:49.652145 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.creator() Jun 16 12:13:49.652145 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 12:13:49.652145 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application created_value = creator( Jun 16 12:13:49.653303 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 12:13:49.653303 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 12:13:49.653303 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 12:13:49.653303 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application Jun 16 12:13:49.655294 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 291/592] 10.222.0.44 () {56 vars in 1108 bytes} [Thu Jun 16 12:13:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 12:13:49.656296 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca30a4a4-bb25-4d5b-8093-e0c7a6242636 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:49.671933 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341952c2-b561-4feb-84b3-c11d351c6f3c None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:49.709662 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e533de35-47ce-4eb6-b3ea-4bc9cea20b79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:49.710463 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e533de35-47ce-4eb6-b3ea-4bc9cea20b79 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:49.710743 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e533de35-47ce-4eb6-b3ea-4bc9cea20b79 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:49.711017 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e533de35-47ce-4eb6-b3ea-4bc9cea20b79 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:49.718636 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e533de35-47ce-4eb6-b3ea-4bc9cea20b79 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:13:49.720093 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e533de35-47ce-4eb6-b3ea-4bc9cea20b79 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:13:49.735837 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-e533de35-47ce-4eb6-b3ea-4bc9cea20b79 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 16 12:13:49.735837 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 12:13:49.735837 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 12:13:49.735837 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 12:13:49.735837 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 12:13:49.735837 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 12:13:49.735837 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 12:13:49.735837 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 12:13:49.735837 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 12:13:49.735837 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 12:13:49.735837 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 12:13:49.735837 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 12:13:49.735837 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 12:13:49.735837 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 12:13:49.735837 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 12:13:49.735837 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 12:13:49.737040 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 12:13:49.737040 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 12:13:49.737040 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 12:13:49.737040 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 12:13:49.737040 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 12:13:49.737040 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 12:13:49.737040 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 12:13:49.737040 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 12:13:49.737040 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 12:13:49.737040 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 12:13:49.737040 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 12:13:49.737040 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jun 16 12:13:49.737040 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 12:13:49.737040 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jun 16 12:13:49.737040 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 12:13:49.737040 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 12:13:49.737040 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 12:13:49.737040 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jun 16 12:13:49.738105 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 12:13:49.738105 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jun 16 12:13:49.738105 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 12:13:49.738105 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 12:13:49.738105 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 12:13:49.738105 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 12:13:49.738105 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 12:13:49.738105 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 12:13:49.738105 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 16 12:13:49.738105 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jun 16 12:13:49.738105 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 302/593] 10.222.0.44 () {56 vars in 1102 bytes} [Thu Jun 16 12:13:49 2022] GET /identity/v3/users/neutron => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 12:13:49.738105 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e533de35-47ce-4eb6-b3ea-4bc9cea20b79 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:49.773065 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca30a4a4-bb25-4d5b-8093-e0c7a6242636 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:49.811106 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c133b363-e9b3-48f3-8457-086734e57cf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:49.812067 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c133b363-e9b3-48f3-8457-086734e57cf3 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:49.812595 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c133b363-e9b3-48f3-8457-086734e57cf3 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:49.812901 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c133b363-e9b3-48f3-8457-086734e57cf3 None admin] PATH_INFO: `/v3/domains` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:49.813630 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c133b363-e9b3-48f3-8457-086734e57cf3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:13:49.813937 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c133b363-e9b3-48f3-8457-086734e57cf3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:13:49.815293 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c133b363-e9b3-48f3-8457-086734e57cf3 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:13:49.827731 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 292/594] 10.222.0.44 () {56 vars in 1109 bytes} [Thu Jun 16 12:13:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:13:49.828352 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c133b363-e9b3-48f3-8457-086734e57cf3 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:49.838370 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:13:49.858460 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e533de35-47ce-4eb6-b3ea-4bc9cea20b79 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:49.870228 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:13:49.905058 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1af140-e143-4e03-92c1-eb2a839326c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:49.905825 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1af140-e143-4e03-92c1-eb2a839326c6 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:49.906177 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1af140-e143-4e03-92c1-eb2a839326c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:49.906520 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1af140-e143-4e03-92c1-eb2a839326c6 None admin] PATH_INFO: `/v3/domains` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:49.907318 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1af140-e143-4e03-92c1-eb2a839326c6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:13:49.907695 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1af140-e143-4e03-92c1-eb2a839326c6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:13:49.909193 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1af140-e143-4e03-92c1-eb2a839326c6 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:13:49.925144 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 303/595] 10.222.0.44 () {56 vars in 1109 bytes} [Thu Jun 16 12:13:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:13:49.926132 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1af140-e143-4e03-92c1-eb2a839326c6 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:49.956265 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c133b363-e9b3-48f3-8457-086734e57cf3 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:49.996521 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e08308-a594-44f4-8566-2fb3c9a2a1c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:49.997625 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e08308-a594-44f4-8566-2fb3c9a2a1c1 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:49.998108 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e08308-a594-44f4-8566-2fb3c9a2a1c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:49.998527 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e08308-a594-44f4-8566-2fb3c9a2a1c1 None admin] PATH_INFO: `/v3/users` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:49.999573 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e08308-a594-44f4-8566-2fb3c9a2a1c1 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:13:50.000028 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e08308-a594-44f4-8566-2fb3c9a2a1c1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:13:50.001807 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e08308-a594-44f4-8566-2fb3c9a2a1c1 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:13:50.022872 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 293/596] 10.222.0.44 () {56 vars in 1139 bytes} [Thu Jun 16 12:13:49 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:13:50.024279 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e08308-a594-44f4-8566-2fb3c9a2a1c1 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:50.063150 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1af140-e143-4e03-92c1-eb2a839326c6 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:50.100033 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08930ed-b816-43b6-b7e5-e3d9341a319a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:50.101131 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08930ed-b816-43b6-b7e5-e3d9341a319a None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:50.101561 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08930ed-b816-43b6-b7e5-e3d9341a319a None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:50.101984 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08930ed-b816-43b6-b7e5-e3d9341a319a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:50.109749 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08930ed-b816-43b6-b7e5-e3d9341a319a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:13:50.111404 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08930ed-b816-43b6-b7e5-e3d9341a319a None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:13:50.127801 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-f08930ed-b816-43b6-b7e5-e3d9341a319a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 12:13:50.127801 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 12:13:50.127801 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 12:13:50.127801 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 12:13:50.127801 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 12:13:50.127801 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 12:13:50.127801 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 12:13:50.127801 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 12:13:50.127801 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 12:13:50.127801 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 12:13:50.127801 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 12:13:50.127801 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 12:13:50.127801 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 12:13:50.127801 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 12:13:50.127801 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 12:13:50.128945 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 12:13:50.128945 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 12:13:50.128945 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 12:13:50.128945 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 12:13:50.128945 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 12:13:50.128945 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 12:13:50.128945 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 12:13:50.128945 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 12:13:50.128945 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jun 16 12:13:50.128945 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 12:13:50.128945 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jun 16 12:13:50.128945 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 12:13:50.128945 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 12:13:50.128945 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 12:13:50.128945 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jun 16 12:13:50.128945 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 12:13:50.128945 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jun 16 12:13:50.130053 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 12:13:50.130053 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 12:13:50.130053 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 12:13:50.130053 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 12:13:50.130053 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 12:13:50.130053 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 12:13:50.130053 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 12:13:50.130053 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jun 16 12:13:50.132776 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 304/597] 10.222.0.44 () {56 vars in 1111 bytes} [Thu Jun 16 12:13:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 12:13:50.133760 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08930ed-b816-43b6-b7e5-e3d9341a319a None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:50.145177 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:13:50.146460 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:13:50.158776 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e08308-a594-44f4-8566-2fb3c9a2a1c1 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:50.205832 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bca0192-044f-4ad1-b09e-b39dc1dbae18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:50.206627 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bca0192-044f-4ad1-b09e-b39dc1dbae18 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:50.206908 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bca0192-044f-4ad1-b09e-b39dc1dbae18 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:50.207176 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bca0192-044f-4ad1-b09e-b39dc1dbae18 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:50.216435 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bca0192-044f-4ad1-b09e-b39dc1dbae18 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:13:50.218399 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bca0192-044f-4ad1-b09e-b39dc1dbae18 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:13:50.234531 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application [None req-9bca0192-044f-4ad1-b09e-b39dc1dbae18 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 12:13:50.234531 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 12:13:50.234531 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 12:13:50.234531 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 12:13:50.234531 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 12:13:50.234531 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 12:13:50.234531 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 12:13:50.234531 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 12:13:50.234531 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 12:13:50.234531 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 12:13:50.234531 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 12:13:50.234531 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 12:13:50.234531 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 12:13:50.234531 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 12:13:50.234531 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 12:13:50.235813 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 12:13:50.235813 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 12:13:50.235813 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 12:13:50.235813 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 12:13:50.235813 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 12:13:50.235813 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 12:13:50.235813 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 12:13:50.235813 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 12:13:50.235813 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application with Lock( Jun 16 12:13:50.235813 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 12:13:50.235813 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._enter() Jun 16 12:13:50.235813 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 12:13:50.235813 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 12:13:50.235813 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 12:13:50.235813 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.creator() Jun 16 12:13:50.235813 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 12:13:50.235813 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application created_value = creator( Jun 16 12:13:50.236685 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 12:13:50.236685 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 12:13:50.236685 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 12:13:50.236685 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 12:13:50.236685 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 12:13:50.236685 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 12:13:50.236685 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 12:13:50.236685 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application Jun 16 12:13:50.238818 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 294/598] 10.222.0.44 () {56 vars in 1111 bytes} [Thu Jun 16 12:13:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 12:13:50.240272 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bca0192-044f-4ad1-b09e-b39dc1dbae18 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:50.255042 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08930ed-b816-43b6-b7e5-e3d9341a319a None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:50.299156 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ffd3ad-74fe-44ac-84f8-a2b947ed3634 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:50.299876 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ffd3ad-74fe-44ac-84f8-a2b947ed3634 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:50.300154 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ffd3ad-74fe-44ac-84f8-a2b947ed3634 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:50.300421 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ffd3ad-74fe-44ac-84f8-a2b947ed3634 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:50.314829 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ffd3ad-74fe-44ac-84f8-a2b947ed3634 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:13:50.317140 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ffd3ad-74fe-44ac-84f8-a2b947ed3634 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:13:50.340666 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-59ffd3ad-74fe-44ac-84f8-a2b947ed3634 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 12:13:50.340666 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 12:13:50.340666 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 12:13:50.340666 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 12:13:50.340666 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 12:13:50.340666 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 12:13:50.340666 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 12:13:50.340666 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 12:13:50.340666 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 12:13:50.340666 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 12:13:50.340666 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 12:13:50.340666 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 12:13:50.340666 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 12:13:50.340666 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 12:13:50.340666 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 12:13:50.341601 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 12:13:50.341601 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 12:13:50.341601 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 12:13:50.341601 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 12:13:50.341601 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 12:13:50.341601 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 12:13:50.341601 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 12:13:50.341601 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 12:13:50.341601 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jun 16 12:13:50.341601 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 12:13:50.341601 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jun 16 12:13:50.341601 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 12:13:50.341601 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 12:13:50.341601 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 12:13:50.341601 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jun 16 12:13:50.341601 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 12:13:50.341601 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jun 16 12:13:50.342521 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 12:13:50.342521 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 12:13:50.342521 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 12:13:50.342521 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jun 16 12:13:50.344901 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 305/599] 10.222.0.44 () {56 vars in 1108 bytes} [Thu Jun 16 12:13:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 12:13:50.345793 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ffd3ad-74fe-44ac-84f8-a2b947ed3634 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:50.359338 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bca0192-044f-4ad1-b09e-b39dc1dbae18 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:50.406448 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bfc5bb-115f-4b32-b1fe-5e6521fcdd36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:50.407391 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bfc5bb-115f-4b32-b1fe-5e6521fcdd36 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:50.407681 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bfc5bb-115f-4b32-b1fe-5e6521fcdd36 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:50.407959 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bfc5bb-115f-4b32-b1fe-5e6521fcdd36 None admin] PATH_INFO: `/v3/projects` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:50.408940 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bfc5bb-115f-4b32-b1fe-5e6521fcdd36 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:13:50.409255 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bfc5bb-115f-4b32-b1fe-5e6521fcdd36 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:13:50.411313 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bfc5bb-115f-4b32-b1fe-5e6521fcdd36 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:13:50.413626 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:13:50.435554 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 295/600] 10.222.0.44 () {56 vars in 1148 bytes} [Thu Jun 16 12:13:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:13:50.435554 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bfc5bb-115f-4b32-b1fe-5e6521fcdd36 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:50.449007 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:13:50.467213 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ffd3ad-74fe-44ac-84f8-a2b947ed3634 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:50.506499 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dd8ebb-4abe-4183-af74-aaf91d7fa3dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:50.507512 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dd8ebb-4abe-4183-af74-aaf91d7fa3dc None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:50.507800 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dd8ebb-4abe-4183-af74-aaf91d7fa3dc None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:50.508485 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dd8ebb-4abe-4183-af74-aaf91d7fa3dc None admin] PATH_INFO: `/v3/projects` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:50.509582 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20dd8ebb-4abe-4183-af74-aaf91d7fa3dc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:13:50.509893 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20dd8ebb-4abe-4183-af74-aaf91d7fa3dc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:13:50.512292 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20dd8ebb-4abe-4183-af74-aaf91d7fa3dc None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:13:50.533344 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 306/601] 10.222.0.44 () {56 vars in 1148 bytes} [Thu Jun 16 12:13:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:13:50.534295 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dd8ebb-4abe-4183-af74-aaf91d7fa3dc None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:50.550740 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bfc5bb-115f-4b32-b1fe-5e6521fcdd36 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:50.586637 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc91ae39-b603-4fb7-81a2-d75d4f17eca2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:50.587298 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc91ae39-b603-4fb7-81a2-d75d4f17eca2 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:50.587577 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc91ae39-b603-4fb7-81a2-d75d4f17eca2 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:50.587847 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc91ae39-b603-4fb7-81a2-d75d4f17eca2 None admin] PATH_INFO: `/v3/domains` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:50.588559 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc91ae39-b603-4fb7-81a2-d75d4f17eca2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:13:50.588885 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc91ae39-b603-4fb7-81a2-d75d4f17eca2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:13:50.590231 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc91ae39-b603-4fb7-81a2-d75d4f17eca2 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:13:50.602710 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 296/602] 10.222.0.44 () {56 vars in 1109 bytes} [Thu Jun 16 12:13:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:13:50.603563 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc91ae39-b603-4fb7-81a2-d75d4f17eca2 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:50.648491 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dd8ebb-4abe-4183-af74-aaf91d7fa3dc None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:50.670467 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:13:50.679999 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:13:50.689129 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac499f8-c37d-42fa-881c-8c100f37fdce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:50.690309 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac499f8-c37d-42fa-881c-8c100f37fdce None admin] REQUEST_METHOD: `PUT` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:50.690737 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac499f8-c37d-42fa-881c-8c100f37fdce None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:50.691184 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac499f8-c37d-42fa-881c-8c100f37fdce None admin] PATH_INFO: `/v3/projects/601361df39e34fcca71175aa94e425c4/users/42dedbccc64747d581c862a69ae20941/roles/a5c06bc21d39451285def24673456ff6` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:50.707453 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac499f8-c37d-42fa-881c-8c100f37fdce None admin] RBAC: Authorizing `identity:create_grant(project_id=601361df39e34fcca71175aa94e425c4, user_id=42dedbccc64747d581c862a69ae20941, role_id=a5c06bc21d39451285def24673456ff6)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:13:50.709934 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac499f8-c37d-42fa-881c-8c100f37fdce None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:13:50.712295 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc91ae39-b603-4fb7-81a2-d75d4f17eca2 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:50.725149 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 307/603] 10.222.0.44 () {58 vars in 1439 bytes} [Thu Jun 16 12:13:50 2022] PUT /identity/v3/projects/601361df39e34fcca71175aa94e425c4/users/42dedbccc64747d581c862a69ae20941/roles/a5c06bc21d39451285def24673456ff6 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:13:50.726403 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac499f8-c37d-42fa-881c-8c100f37fdce None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:50.749679 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eaa9a0f-efd1-431d-a2f6-5a7a0889830b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:50.750587 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaa9a0f-efd1-431d-a2f6-5a7a0889830b None admin] REQUEST_METHOD: `PUT` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:50.750867 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaa9a0f-efd1-431d-a2f6-5a7a0889830b None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:50.751139 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaa9a0f-efd1-431d-a2f6-5a7a0889830b None admin] PATH_INFO: `/v3/projects/601361df39e34fcca71175aa94e425c4/users/4f96fc14ed89478c8a8c2f11c87511e3/roles/a5c06bc21d39451285def24673456ff6` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:50.767502 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eaa9a0f-efd1-431d-a2f6-5a7a0889830b None admin] RBAC: Authorizing `identity:create_grant(project_id=601361df39e34fcca71175aa94e425c4, user_id=4f96fc14ed89478c8a8c2f11c87511e3, role_id=a5c06bc21d39451285def24673456ff6)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:13:50.768988 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eaa9a0f-efd1-431d-a2f6-5a7a0889830b None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:13:50.786258 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 297/604] 10.222.0.44 () {58 vars in 1439 bytes} [Thu Jun 16 12:13:50 2022] PUT /identity/v3/projects/601361df39e34fcca71175aa94e425c4/users/4f96fc14ed89478c8a8c2f11c87511e3/roles/a5c06bc21d39451285def24673456ff6 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:13:50.892202 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac499f8-c37d-42fa-881c-8c100f37fdce None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:50.944365 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f38f50-6165-4012-9a67-08bbcba52885 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:50.945217 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f38f50-6165-4012-9a67-08bbcba52885 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:50.945496 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f38f50-6165-4012-9a67-08bbcba52885 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:50.945764 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f38f50-6165-4012-9a67-08bbcba52885 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:50.956499 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f38f50-6165-4012-9a67-08bbcba52885 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:13:50.958100 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f38f50-6165-4012-9a67-08bbcba52885 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:13:50.978060 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-d3f38f50-6165-4012-9a67-08bbcba52885 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 12:13:50.978060 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 12:13:50.978060 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 12:13:50.978060 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 12:13:50.978060 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 12:13:50.978060 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 12:13:50.978060 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 12:13:50.978060 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 12:13:50.978060 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 12:13:50.978060 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 12:13:50.978060 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 12:13:50.978060 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 12:13:50.978060 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 12:13:50.978060 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 12:13:50.978060 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 12:13:50.979063 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 12:13:50.979063 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 12:13:50.979063 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 12:13:50.979063 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 12:13:50.979063 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 12:13:50.979063 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 12:13:50.979063 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 12:13:50.979063 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 12:13:50.979063 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jun 16 12:13:50.979063 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 12:13:50.979063 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jun 16 12:13:50.979063 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 12:13:50.979063 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 12:13:50.979063 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 12:13:50.979063 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jun 16 12:13:50.979063 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 12:13:50.979063 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jun 16 12:13:50.979968 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 12:13:50.979968 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 12:13:50.979968 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 12:13:50.979968 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 12:13:50.979968 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 12:13:50.979968 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 12:13:50.979968 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 12:13:50.979968 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jun 16 12:13:50.979968 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 308/605] 10.222.0.44 () {56 vars in 1111 bytes} [Thu Jun 16 12:13:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 12:13:50.986724 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eaa9a0f-efd1-431d-a2f6-5a7a0889830b None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:51.087492 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7468f290-90ed-49f3-b9f9-ba4140148902 None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:51.087853 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7468f290-90ed-49f3-b9f9-ba4140148902 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:51.088028 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7468f290-90ed-49f3-b9f9-ba4140148902 None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:51.090094 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 309/606] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 12:13:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 12:13:51.095860 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83105af9-66de-4f45-b880-59a94212e4f6 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:51.096148 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83105af9-66de-4f45-b880-59a94212e4f6 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:51.096423 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83105af9-66de-4f45-b880-59a94212e4f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:51.115208 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eaa9a0f-efd1-431d-a2f6-5a7a0889830b None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:51.116503 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-83105af9-66de-4f45-b880-59a94212e4f6 None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:13:51.117861 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-83105af9-66de-4f45-b880-59a94212e4f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:13:51.151403 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:13:51.157117 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:13:51.178083 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3327853-de62-402d-9938-7c06d019b1d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:51.178759 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3327853-de62-402d-9938-7c06d019b1d3 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:51.179046 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3327853-de62-402d-9938-7c06d019b1d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:51.179322 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3327853-de62-402d-9938-7c06d019b1d3 None admin] PATH_INFO: `/v3/projects` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:51.180122 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3327853-de62-402d-9938-7c06d019b1d3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:13:51.180430 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3327853-de62-402d-9938-7c06d019b1d3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:13:51.181895 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3327853-de62-402d-9938-7c06d019b1d3 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:13:51.202381 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 310/607] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 12:13:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 12:13:51.203815 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 298/608] 10.222.0.44 () {56 vars in 1148 bytes} [Thu Jun 16 12:13:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:13:51.213738 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83105af9-66de-4f45-b880-59a94212e4f6 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:51.267953 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3327853-de62-402d-9938-7c06d019b1d3 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:51.328614 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83105af9-66de-4f45-b880-59a94212e4f6 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:51.385487 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09eb47fb-3783-42af-b239-6c6876d4a719 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:51.386402 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09eb47fb-3783-42af-b239-6c6876d4a719 None admin] REQUEST_METHOD: `PUT` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:51.386683 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09eb47fb-3783-42af-b239-6c6876d4a719 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:51.386945 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09eb47fb-3783-42af-b239-6c6876d4a719 None admin] PATH_INFO: `/v3/projects/601361df39e34fcca71175aa94e425c4/users/e1094729b25a4be7b0b394998c9ca681/roles/a5c06bc21d39451285def24673456ff6` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:51.414893 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09eb47fb-3783-42af-b239-6c6876d4a719 None admin] RBAC: Authorizing `identity:create_grant(project_id=601361df39e34fcca71175aa94e425c4, user_id=e1094729b25a4be7b0b394998c9ca681, role_id=a5c06bc21d39451285def24673456ff6)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:13:51.416283 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09eb47fb-3783-42af-b239-6c6876d4a719 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:13:51.441358 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 311/609] 10.222.0.44 () {58 vars in 1439 bytes} [Thu Jun 16 12:13:51 2022] PUT /identity/v3/projects/601361df39e34fcca71175aa94e425c4/users/e1094729b25a4be7b0b394998c9ca681/roles/a5c06bc21d39451285def24673456ff6 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:13:51.453322 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3327853-de62-402d-9938-7c06d019b1d3 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:51.500702 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8626ed98-9e93-4e14-82f1-9d64852d5111 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:51.501594 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8626ed98-9e93-4e14-82f1-9d64852d5111 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:51.501878 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8626ed98-9e93-4e14-82f1-9d64852d5111 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:51.502150 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8626ed98-9e93-4e14-82f1-9d64852d5111 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:51.522808 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8626ed98-9e93-4e14-82f1-9d64852d5111 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 12:13:51.530776 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application [None req-8626ed98-9e93-4e14-82f1-9d64852d5111 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 16 12:13:51.530776 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 12:13:51.530776 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 12:13:51.530776 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 12:13:51.530776 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 12:13:51.530776 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 12:13:51.530776 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 12:13:51.530776 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 12:13:51.530776 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 12:13:51.530776 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 12:13:51.530776 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 12:13:51.530776 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 12:13:51.530776 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 12:13:51.530776 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 12:13:51.530776 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 12:13:51.530776 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 12:13:51.531688 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 12:13:51.531688 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 12:13:51.531688 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 12:13:51.531688 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 12:13:51.531688 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 12:13:51.531688 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 12:13:51.531688 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 12:13:51.531688 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 12:13:51.531688 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 12:13:51.531688 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 12:13:51.531688 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 12:13:51.531688 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application with Lock( Jun 16 12:13:51.531688 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 12:13:51.531688 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._enter() Jun 16 12:13:51.531688 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 12:13:51.531688 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 12:13:51.532528 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 12:13:51.532528 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.creator() Jun 16 12:13:51.532528 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 12:13:51.532528 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application created_value = creator( Jun 16 12:13:51.532528 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 12:13:51.532528 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 12:13:51.532528 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 12:13:51.532528 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 12:13:51.532528 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 12:13:51.532528 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 12:13:51.532528 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 16 12:13:51.532528 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application Jun 16 12:13:51.535510 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 299/610] 10.222.0.44 () {56 vars in 1102 bytes} [Thu Jun 16 12:13:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 12:13:51.539073 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09eb47fb-3783-42af-b239-6c6876d4a719 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:51.561137 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:13:51.707499 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09eb47fb-3783-42af-b239-6c6876d4a719 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:51.720547 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b19884-7752-4465-abea-077f55c44c3c None None] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:51.720880 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b19884-7752-4465-abea-077f55c44c3c None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:51.721139 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b19884-7752-4465-abea-077f55c44c3c None None] PATH_INFO: `/` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:51.722808 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 300/611] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 12:13:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 12:13:51.728849 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c40d1e-6918-4d40-915a-63bd2cdda725 None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:51.729138 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c40d1e-6918-4d40-915a-63bd2cdda725 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:51.729417 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c40d1e-6918-4d40-915a-63bd2cdda725 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:51.761829 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-26c40d1e-6918-4d40-915a-63bd2cdda725 None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:13:51.763785 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-26c40d1e-6918-4d40-915a-63bd2cdda725 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:13:51.769887 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0826d7b9-5f0e-42e9-a61d-7fb81cab0530 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:51.770677 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0826d7b9-5f0e-42e9-a61d-7fb81cab0530 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:51.771058 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0826d7b9-5f0e-42e9-a61d-7fb81cab0530 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:51.771469 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0826d7b9-5f0e-42e9-a61d-7fb81cab0530 None admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:51.772497 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0826d7b9-5f0e-42e9-a61d-7fb81cab0530 None admin] RBAC: Adding query filter params (name=service) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:13:51.773655 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0826d7b9-5f0e-42e9-a61d-7fb81cab0530 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:13:51.775143 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0826d7b9-5f0e-42e9-a61d-7fb81cab0530 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:13:51.791936 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 312/612] 10.222.0.44 () {56 vars in 1103 bytes} [Thu Jun 16 12:13:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:13:51.797300 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0826d7b9-5f0e-42e9-a61d-7fb81cab0530 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:51.839164 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:13:51.897920 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 301/613] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 12:13:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 12:13:51.928834 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:13:51.939573 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c40d1e-6918-4d40-915a-63bd2cdda725 None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:51.966613 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0826d7b9-5f0e-42e9-a61d-7fb81cab0530 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:52.013065 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626b9f49-79e0-4a0d-aadd-faa8f74daaef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:52.013867 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626b9f49-79e0-4a0d-aadd-faa8f74daaef None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:52.014152 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626b9f49-79e0-4a0d-aadd-faa8f74daaef None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:52.014431 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626b9f49-79e0-4a0d-aadd-faa8f74daaef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:52.025589 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626b9f49-79e0-4a0d-aadd-faa8f74daaef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:13:52.027054 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626b9f49-79e0-4a0d-aadd-faa8f74daaef None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:13:52.045347 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-626b9f49-79e0-4a0d-aadd-faa8f74daaef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 12:13:52.045347 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 12:13:52.045347 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 12:13:52.045347 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 12:13:52.045347 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 12:13:52.045347 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 12:13:52.045347 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 12:13:52.045347 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 12:13:52.045347 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 12:13:52.045347 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 12:13:52.045347 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 12:13:52.045347 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 12:13:52.045347 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 12:13:52.045347 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 12:13:52.045347 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 12:13:52.046460 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 12:13:52.046460 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 12:13:52.046460 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 12:13:52.046460 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 12:13:52.046460 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 12:13:52.046460 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 12:13:52.046460 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 12:13:52.046460 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 12:13:52.046460 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jun 16 12:13:52.046460 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 12:13:52.046460 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jun 16 12:13:52.046460 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 12:13:52.046460 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 12:13:52.046460 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 12:13:52.046460 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jun 16 12:13:52.046460 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 12:13:52.046460 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jun 16 12:13:52.047575 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 12:13:52.047575 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 12:13:52.047575 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 12:13:52.047575 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jun 16 12:13:52.047575 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 313/614] 10.222.0.44 () {56 vars in 1108 bytes} [Thu Jun 16 12:13:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 12:13:52.056120 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626b9f49-79e0-4a0d-aadd-faa8f74daaef None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:52.093717 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c40d1e-6918-4d40-915a-63bd2cdda725 None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:52.157464 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5202aa-2519-4b91-a708-ddc6089aabf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:52.158599 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5202aa-2519-4b91-a708-ddc6089aabf9 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:52.159059 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5202aa-2519-4b91-a708-ddc6089aabf9 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:52.159515 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5202aa-2519-4b91-a708-ddc6089aabf9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:52.178359 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5202aa-2519-4b91-a708-ddc6089aabf9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 12:13:52.188782 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626b9f49-79e0-4a0d-aadd-faa8f74daaef None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:52.195603 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application [None req-2d5202aa-2519-4b91-a708-ddc6089aabf9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 16 12:13:52.195603 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 12:13:52.195603 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 12:13:52.195603 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 12:13:52.195603 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 12:13:52.195603 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 12:13:52.195603 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 12:13:52.195603 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 12:13:52.195603 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 12:13:52.195603 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 12:13:52.195603 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 12:13:52.195603 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 12:13:52.195603 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 12:13:52.195603 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 12:13:52.195603 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 12:13:52.195603 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 12:13:52.196531 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 12:13:52.196531 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 12:13:52.196531 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 12:13:52.196531 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 12:13:52.196531 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 12:13:52.196531 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 12:13:52.196531 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 12:13:52.196531 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 12:13:52.196531 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 12:13:52.196531 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 12:13:52.196531 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 12:13:52.196531 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application with Lock( Jun 16 12:13:52.196531 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 12:13:52.196531 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._enter() Jun 16 12:13:52.196531 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 12:13:52.196531 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 12:13:52.197400 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 12:13:52.197400 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.creator() Jun 16 12:13:52.197400 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 12:13:52.197400 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application created_value = creator( Jun 16 12:13:52.197400 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 12:13:52.197400 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 12:13:52.197400 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 12:13:52.197400 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 12:13:52.197400 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 12:13:52.197400 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 12:13:52.197400 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 16 12:13:52.197400 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application Jun 16 12:13:52.206543 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 302/615] 10.222.0.44 () {56 vars in 1102 bytes} [Thu Jun 16 12:13:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 12:13:52.212716 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5202aa-2519-4b91-a708-ddc6089aabf9 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:52.213132 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:13:52.233463 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18c33d4-41b5-467f-b393-91123cd8b9e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:52.234119 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18c33d4-41b5-467f-b393-91123cd8b9e0 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:52.234406 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18c33d4-41b5-467f-b393-91123cd8b9e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:52.234686 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18c33d4-41b5-467f-b393-91123cd8b9e0 None admin] PATH_INFO: `/v3/domains` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:52.235429 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18c33d4-41b5-467f-b393-91123cd8b9e0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:13:52.235840 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18c33d4-41b5-467f-b393-91123cd8b9e0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:13:52.237382 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18c33d4-41b5-467f-b393-91123cd8b9e0 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:13:52.249160 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:13:52.279209 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 314/616] 10.222.0.44 () {56 vars in 1109 bytes} [Thu Jun 16 12:13:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:13:52.289846 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18c33d4-41b5-467f-b393-91123cd8b9e0 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:52.327303 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5202aa-2519-4b91-a708-ddc6089aabf9 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:52.375847 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd3bd63-98bc-4c87-a551-13b4c8c20321 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:52.376522 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd3bd63-98bc-4c87-a551-13b4c8c20321 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:52.376826 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd3bd63-98bc-4c87-a551-13b4c8c20321 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:52.377104 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd3bd63-98bc-4c87-a551-13b4c8c20321 None admin] PATH_INFO: `/v3/roles` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:52.377858 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd3bd63-98bc-4c87-a551-13b4c8c20321 None admin] RBAC: Adding query filter params (name=service) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:13:52.378162 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd3bd63-98bc-4c87-a551-13b4c8c20321 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:13:52.379534 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd3bd63-98bc-4c87-a551-13b4c8c20321 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:13:52.398289 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 303/617] 10.222.0.44 () {56 vars in 1103 bytes} [Thu Jun 16 12:13:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:13:52.404063 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd3bd63-98bc-4c87-a551-13b4c8c20321 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:52.516524 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18c33d4-41b5-467f-b393-91123cd8b9e0 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:52.521272 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:13:52.528335 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd3bd63-98bc-4c87-a551-13b4c8c20321 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:52.569139 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cceaead5-3ceb-4393-aed9-54ab9536eaaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:52.570345 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cceaead5-3ceb-4393-aed9-54ab9536eaaf None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:52.570866 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cceaead5-3ceb-4393-aed9-54ab9536eaaf None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:52.571346 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cceaead5-3ceb-4393-aed9-54ab9536eaaf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:52.582518 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cceaead5-3ceb-4393-aed9-54ab9536eaaf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:13:52.584769 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cceaead5-3ceb-4393-aed9-54ab9536eaaf None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:13:52.602770 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application [None req-cceaead5-3ceb-4393-aed9-54ab9536eaaf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 12:13:52.602770 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 12:13:52.602770 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 12:13:52.602770 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 12:13:52.602770 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 12:13:52.602770 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 12:13:52.602770 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 12:13:52.602770 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 12:13:52.602770 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 12:13:52.602770 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 12:13:52.602770 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 12:13:52.602770 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 12:13:52.602770 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 12:13:52.602770 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 12:13:52.602770 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 12:13:52.603702 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 12:13:52.603702 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 12:13:52.603702 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 12:13:52.603702 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 12:13:52.603702 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 12:13:52.603702 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 12:13:52.603702 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 12:13:52.603702 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 12:13:52.603702 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application with Lock( Jun 16 12:13:52.603702 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 12:13:52.603702 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._enter() Jun 16 12:13:52.603702 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 12:13:52.603702 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 12:13:52.603702 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 12:13:52.603702 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.creator() Jun 16 12:13:52.603702 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 12:13:52.603702 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application created_value = creator( Jun 16 12:13:52.604644 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 12:13:52.604644 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 12:13:52.604644 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 12:13:52.604644 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application Jun 16 12:13:52.606855 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 304/618] 10.222.0.44 () {56 vars in 1108 bytes} [Thu Jun 16 12:13:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 12:13:52.613669 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cceaead5-3ceb-4393-aed9-54ab9536eaaf None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:52.617437 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a459037-2bcc-422a-b4f3-5b07a66a52e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:52.618250 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a459037-2bcc-422a-b4f3-5b07a66a52e1 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:52.618530 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a459037-2bcc-422a-b4f3-5b07a66a52e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:52.618802 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a459037-2bcc-422a-b4f3-5b07a66a52e1 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:52.649536 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a459037-2bcc-422a-b4f3-5b07a66a52e1 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:13:52.650995 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a459037-2bcc-422a-b4f3-5b07a66a52e1 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:13:52.674141 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-0a459037-2bcc-422a-b4f3-5b07a66a52e1 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 16 12:13:52.674141 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 12:13:52.674141 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 12:13:52.674141 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 12:13:52.674141 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 12:13:52.674141 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 12:13:52.674141 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 12:13:52.674141 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 12:13:52.674141 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 12:13:52.674141 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 12:13:52.674141 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 12:13:52.674141 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 12:13:52.674141 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 12:13:52.674141 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 12:13:52.674141 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 12:13:52.674141 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 12:13:52.675106 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 12:13:52.675106 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 12:13:52.675106 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 12:13:52.675106 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 12:13:52.675106 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 12:13:52.675106 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 12:13:52.675106 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 12:13:52.675106 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 12:13:52.675106 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 12:13:52.675106 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 12:13:52.675106 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 12:13:52.675106 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jun 16 12:13:52.675106 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 12:13:52.675106 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jun 16 12:13:52.675106 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 12:13:52.675106 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 12:13:52.675106 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 12:13:52.675106 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jun 16 12:13:52.676240 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 12:13:52.676240 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jun 16 12:13:52.676240 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 12:13:52.676240 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 12:13:52.676240 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 12:13:52.676240 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 12:13:52.676240 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 12:13:52.676240 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 12:13:52.676240 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 16 12:13:52.676240 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jun 16 12:13:52.686878 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 315/619] 10.222.0.44 () {56 vars in 1093 bytes} [Thu Jun 16 12:13:52 2022] GET /identity/v3/users/nova => generated 82 bytes in 394 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 12:13:52.689236 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a459037-2bcc-422a-b4f3-5b07a66a52e1 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:52.745176 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:13:52.780977 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cceaead5-3ceb-4393-aed9-54ab9536eaaf None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:52.804925 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a459037-2bcc-422a-b4f3-5b07a66a52e1 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:52.840478 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27de252-4e86-4556-81cf-5dfbb02a0a94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:52.841304 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27de252-4e86-4556-81cf-5dfbb02a0a94 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:52.841587 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27de252-4e86-4556-81cf-5dfbb02a0a94 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:52.841864 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27de252-4e86-4556-81cf-5dfbb02a0a94 None admin] PATH_INFO: `/v3/domains` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:52.842320 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e068aaa-3a0f-41ed-bc23-63268a6b78b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:52.842592 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27de252-4e86-4556-81cf-5dfbb02a0a94 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:13:52.842900 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27de252-4e86-4556-81cf-5dfbb02a0a94 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:13:52.843626 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e068aaa-3a0f-41ed-bc23-63268a6b78b2 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:52.844104 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e068aaa-3a0f-41ed-bc23-63268a6b78b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:52.844284 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27de252-4e86-4556-81cf-5dfbb02a0a94 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:13:52.844769 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e068aaa-3a0f-41ed-bc23-63268a6b78b2 None admin] PATH_INFO: `/v3/users` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:52.845895 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e068aaa-3a0f-41ed-bc23-63268a6b78b2 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:13:52.846414 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e068aaa-3a0f-41ed-bc23-63268a6b78b2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:13:52.848065 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e068aaa-3a0f-41ed-bc23-63268a6b78b2 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:13:52.862096 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 305/620] 10.222.0.44 () {56 vars in 1109 bytes} [Thu Jun 16 12:13:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:13:52.872047 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 316/621] 10.222.0.44 () {56 vars in 1133 bytes} [Thu Jun 16 12:13:52 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:13:52.872808 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27de252-4e86-4556-81cf-5dfbb02a0a94 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:52.879987 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e068aaa-3a0f-41ed-bc23-63268a6b78b2 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:52.893124 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:13:53.065642 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e068aaa-3a0f-41ed-bc23-63268a6b78b2 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:53.081402 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27de252-4e86-4556-81cf-5dfbb02a0a94 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:53.085069 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:13:53.134915 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a05de9-8033-4d14-991e-f1d98aefe07c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:53.135570 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a05de9-8033-4d14-991e-f1d98aefe07c None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:53.135850 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a05de9-8033-4d14-991e-f1d98aefe07c None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:53.136125 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a05de9-8033-4d14-991e-f1d98aefe07c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:53.144571 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7247b5eb-6413-4790-9579-4b8be4e86c51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:53.145399 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7247b5eb-6413-4790-9579-4b8be4e86c51 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:53.145688 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7247b5eb-6413-4790-9579-4b8be4e86c51 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:53.145998 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7247b5eb-6413-4790-9579-4b8be4e86c51 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:53.165031 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7247b5eb-6413-4790-9579-4b8be4e86c51 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:13:53.166521 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7247b5eb-6413-4790-9579-4b8be4e86c51 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:13:53.206424 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application [None req-7247b5eb-6413-4790-9579-4b8be4e86c51 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 16 12:13:53.206424 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 12:13:53.206424 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 12:13:53.206424 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 12:13:53.206424 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 12:13:53.206424 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 12:13:53.206424 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 12:13:53.206424 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 12:13:53.206424 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 12:13:53.206424 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 12:13:53.206424 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 12:13:53.206424 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 12:13:53.206424 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 12:13:53.206424 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 12:13:53.206424 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 12:13:53.206424 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 12:13:53.207412 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 12:13:53.207412 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 12:13:53.207412 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 12:13:53.207412 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 12:13:53.207412 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 12:13:53.207412 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 12:13:53.207412 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 12:13:53.207412 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 12:13:53.207412 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 12:13:53.207412 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 12:13:53.207412 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 12:13:53.207412 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application with Lock( Jun 16 12:13:53.207412 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 12:13:53.207412 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._enter() Jun 16 12:13:53.207412 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 12:13:53.207412 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 12:13:53.207412 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 12:13:53.207412 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.creator() Jun 16 12:13:53.208388 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 12:13:53.208388 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application created_value = creator( Jun 16 12:13:53.208388 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 12:13:53.208388 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 12:13:53.208388 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 12:13:53.208388 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 12:13:53.208388 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 12:13:53.208388 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 12:13:53.208388 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 16 12:13:53.208388 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application Jun 16 12:13:53.208388 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 306/622] 10.222.0.44 () {56 vars in 1096 bytes} [Thu Jun 16 12:13:52 2022] GET /identity/v3/users/swift => generated 83 bytes in 335 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 12:13:53.225473 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7247b5eb-6413-4790-9579-4b8be4e86c51 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:53.260341 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a05de9-8033-4d14-991e-f1d98aefe07c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:13:53.261843 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a05de9-8033-4d14-991e-f1d98aefe07c None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:13:53.325111 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:13:53.334207 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7247b5eb-6413-4790-9579-4b8be4e86c51 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:53.367594 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 317/623] 10.222.0.44 () {58 vars in 1282 bytes} [Thu Jun 16 12:13:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 488 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 16 12:13:53.369080 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa3726c-f2da-4987-8a55-22d4c9696412 None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:53.369371 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa3726c-f2da-4987-8a55-22d4c9696412 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:53.369650 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa3726c-f2da-4987-8a55-22d4c9696412 None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:53.371230 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 318/624] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 12:13:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 12:13:53.372843 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa3726c-f2da-4987-8a55-22d4c9696412 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:53.375972 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:13:53.384106 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b3f1b4-e5e4-4930-b93e-5fa082401c45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:53.384805 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b3f1b4-e5e4-4930-b93e-5fa082401c45 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:53.385089 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b3f1b4-e5e4-4930-b93e-5fa082401c45 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:53.385361 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b3f1b4-e5e4-4930-b93e-5fa082401c45 None admin] PATH_INFO: `/v3/users` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:53.386209 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b3f1b4-e5e4-4930-b93e-5fa082401c45 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:13:53.386525 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b3f1b4-e5e4-4930-b93e-5fa082401c45 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:13:53.387951 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b3f1b4-e5e4-4930-b93e-5fa082401c45 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:13:53.406475 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 307/625] 10.222.0.44 () {56 vars in 1135 bytes} [Thu Jun 16 12:13:53 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 12:13:53.407750 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592db6fb-600f-4e83-855f-35ec6b9adc4a None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:53.408039 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592db6fb-600f-4e83-855f-35ec6b9adc4a None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:53.408319 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592db6fb-600f-4e83-855f-35ec6b9adc4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:53.425729 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-592db6fb-600f-4e83-855f-35ec6b9adc4a None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:13:53.426926 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-592db6fb-600f-4e83-855f-35ec6b9adc4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:13:53.481403 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa3726c-f2da-4987-8a55-22d4c9696412 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:53.498749 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 308/626] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 12:13:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 12:13:53.499640 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592db6fb-600f-4e83-855f-35ec6b9adc4a None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:53.530951 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd0adc4-a71e-4c77-b859-92da30d1dd90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:53.531773 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd0adc4-a71e-4c77-b859-92da30d1dd90 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:53.532056 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd0adc4-a71e-4c77-b859-92da30d1dd90 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:53.532330 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd0adc4-a71e-4c77-b859-92da30d1dd90 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:53.545688 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd0adc4-a71e-4c77-b859-92da30d1dd90 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:13:53.547173 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd0adc4-a71e-4c77-b859-92da30d1dd90 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:13:53.562810 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:13:53.566248 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-1cd0adc4-a71e-4c77-b859-92da30d1dd90 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 12:13:53.566248 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 12:13:53.566248 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 12:13:53.566248 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 12:13:53.566248 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 12:13:53.566248 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 12:13:53.566248 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 12:13:53.566248 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 12:13:53.566248 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 12:13:53.566248 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 12:13:53.566248 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 12:13:53.566248 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 12:13:53.566248 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 12:13:53.566248 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 12:13:53.566248 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 12:13:53.567219 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 12:13:53.567219 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 12:13:53.567219 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 12:13:53.567219 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 12:13:53.567219 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 12:13:53.567219 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 12:13:53.567219 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 12:13:53.567219 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 12:13:53.567219 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jun 16 12:13:53.567219 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 12:13:53.567219 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jun 16 12:13:53.567219 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 12:13:53.567219 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 12:13:53.567219 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 12:13:53.567219 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jun 16 12:13:53.567219 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 12:13:53.567219 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jun 16 12:13:53.568131 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 12:13:53.568131 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 12:13:53.568131 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 12:13:53.568131 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jun 16 12:13:53.573076 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 319/627] 10.222.0.44 () {56 vars in 1108 bytes} [Thu Jun 16 12:13:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 12:13:53.573076 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd0adc4-a71e-4c77-b859-92da30d1dd90 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:53.618724 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592db6fb-600f-4e83-855f-35ec6b9adc4a None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:53.633875 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:13:53.654152 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc84035a-e70a-41dc-8823-6803372e4f67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:53.654956 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc84035a-e70a-41dc-8823-6803372e4f67 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:53.655653 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc84035a-e70a-41dc-8823-6803372e4f67 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:53.655936 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc84035a-e70a-41dc-8823-6803372e4f67 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:53.667653 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc84035a-e70a-41dc-8823-6803372e4f67 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:13:53.669788 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc84035a-e70a-41dc-8823-6803372e4f67 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:13:53.681366 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd0adc4-a71e-4c77-b859-92da30d1dd90 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:53.688380 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application [None req-dc84035a-e70a-41dc-8823-6803372e4f67 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 12:13:53.688380 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 12:13:53.688380 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 12:13:53.688380 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 12:13:53.688380 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 12:13:53.688380 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 12:13:53.688380 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 12:13:53.688380 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 12:13:53.688380 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 12:13:53.688380 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 12:13:53.688380 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 12:13:53.688380 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 12:13:53.688380 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 12:13:53.688380 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 12:13:53.688380 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 12:13:53.689370 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 12:13:53.689370 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 12:13:53.689370 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 12:13:53.689370 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 12:13:53.689370 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 12:13:53.689370 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 12:13:53.689370 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 12:13:53.689370 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 12:13:53.689370 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application with Lock( Jun 16 12:13:53.689370 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 12:13:53.689370 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._enter() Jun 16 12:13:53.689370 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 12:13:53.689370 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 12:13:53.689370 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 12:13:53.689370 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.creator() Jun 16 12:13:53.689370 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 12:13:53.689370 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application created_value = creator( Jun 16 12:13:53.690236 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 12:13:53.690236 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 12:13:53.690236 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 12:13:53.690236 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application Jun 16 12:13:53.690236 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 309/628] 10.222.0.44 () {56 vars in 1108 bytes} [Thu Jun 16 12:13:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 12:13:53.690501 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc84035a-e70a-41dc-8823-6803372e4f67 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:53.722489 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b857390f-618d-4d2b-aab6-c348131e975b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:53.723695 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b857390f-618d-4d2b-aab6-c348131e975b None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:53.724698 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b857390f-618d-4d2b-aab6-c348131e975b None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:53.725142 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b857390f-618d-4d2b-aab6-c348131e975b None admin] PATH_INFO: `/v3/roles/service` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:53.736334 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b857390f-618d-4d2b-aab6-c348131e975b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 12:13:53.745152 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-b857390f-618d-4d2b-aab6-c348131e975b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 16 12:13:53.745152 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 12:13:53.745152 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 12:13:53.745152 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 12:13:53.745152 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 12:13:53.745152 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 12:13:53.745152 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 12:13:53.745152 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 12:13:53.745152 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 12:13:53.745152 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 12:13:53.745152 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 12:13:53.745152 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 12:13:53.745152 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 12:13:53.745152 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 12:13:53.745152 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 12:13:53.745152 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 12:13:53.746262 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 12:13:53.746262 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 12:13:53.746262 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 12:13:53.746262 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 12:13:53.746262 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 12:13:53.746262 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 12:13:53.746262 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 12:13:53.746262 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 12:13:53.746262 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 12:13:53.746262 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 12:13:53.746262 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 12:13:53.746262 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jun 16 12:13:53.746262 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 12:13:53.746262 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jun 16 12:13:53.746262 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 12:13:53.746262 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 12:13:53.747121 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 12:13:53.747121 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jun 16 12:13:53.747121 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 12:13:53.747121 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jun 16 12:13:53.747121 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 12:13:53.747121 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 12:13:53.747121 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 12:13:53.747121 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 12:13:53.747121 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 12:13:53.747121 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 12:13:53.747121 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 16 12:13:53.747121 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jun 16 12:13:53.747751 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 320/629] 10.222.0.44 () {56 vars in 1102 bytes} [Thu Jun 16 12:13:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 12:13:53.749142 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a031e95-9349-4397-9904-f3d565304b43 None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:53.749428 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a031e95-9349-4397-9904-f3d565304b43 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:53.749706 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a031e95-9349-4397-9904-f3d565304b43 None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:53.751910 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 321/630] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 12:13:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 12:13:53.752695 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a031e95-9349-4397-9904-f3d565304b43 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:53.796515 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc84035a-e70a-41dc-8823-6803372e4f67 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:53.803691 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:13:53.837343 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fb38fc-200a-4597-b541-4032c2fa009b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:53.838031 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fb38fc-200a-4597-b541-4032c2fa009b None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:53.838319 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fb38fc-200a-4597-b541-4032c2fa009b None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:53.838586 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fb38fc-200a-4597-b541-4032c2fa009b None admin] PATH_INFO: `/v3/domains` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:53.839329 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fb38fc-200a-4597-b541-4032c2fa009b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:13:53.839637 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fb38fc-200a-4597-b541-4032c2fa009b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:13:53.841069 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fb38fc-200a-4597-b541-4032c2fa009b None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:13:53.858056 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 310/631] 10.222.0.44 () {56 vars in 1109 bytes} [Thu Jun 16 12:13:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:13:53.858056 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b50fe6-b37b-41de-9d82-146888ebc0db None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:53.858056 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b50fe6-b37b-41de-9d82-146888ebc0db None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:53.858056 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b50fe6-b37b-41de-9d82-146888ebc0db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:53.872843 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-75b50fe6-b37b-41de-9d82-146888ebc0db None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:13:53.872999 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a031e95-9349-4397-9904-f3d565304b43 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:53.873954 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-75b50fe6-b37b-41de-9d82-146888ebc0db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:13:53.889580 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:13:53.909867 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53c7a88-2438-42d3-ac60-29e7216ff05d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:53.910529 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53c7a88-2438-42d3-ac60-29e7216ff05d None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:53.910808 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53c7a88-2438-42d3-ac60-29e7216ff05d None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:53.911111 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53c7a88-2438-42d3-ac60-29e7216ff05d None admin] PATH_INFO: `/v3/domains` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:53.911823 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53c7a88-2438-42d3-ac60-29e7216ff05d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:13:53.912127 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53c7a88-2438-42d3-ac60-29e7216ff05d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:13:53.913536 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53c7a88-2438-42d3-ac60-29e7216ff05d None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:13:53.925472 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 322/632] 10.222.0.44 () {56 vars in 1109 bytes} [Thu Jun 16 12:13:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:13:53.926274 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53c7a88-2438-42d3-ac60-29e7216ff05d None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:53.949528 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 311/633] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 12:13:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 12:13:53.950368 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b50fe6-b37b-41de-9d82-146888ebc0db None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:54.023387 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53c7a88-2438-42d3-ac60-29e7216ff05d None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:54.047047 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:13:54.054066 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b50fe6-b37b-41de-9d82-146888ebc0db None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:54.056921 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886c1d93-07c0-433e-a455-d7575613813c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:54.057586 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886c1d93-07c0-433e-a455-d7575613813c None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:54.057859 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886c1d93-07c0-433e-a455-d7575613813c None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:54.058127 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886c1d93-07c0-433e-a455-d7575613813c None admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:54.058869 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886c1d93-07c0-433e-a455-d7575613813c None admin] RBAC: Adding query filter params (name=service) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:13:54.059166 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886c1d93-07c0-433e-a455-d7575613813c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:13:54.060526 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886c1d93-07c0-433e-a455-d7575613813c None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:13:54.068956 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 323/634] 10.222.0.44 () {56 vars in 1103 bytes} [Thu Jun 16 12:13:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:13:54.069988 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0438f2c-747a-4e4d-b847-cb4702e0ae33 None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:54.070270 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0438f2c-747a-4e4d-b847-cb4702e0ae33 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:54.070540 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0438f2c-747a-4e4d-b847-cb4702e0ae33 None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:54.071742 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 324/635] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 12:13:54 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 12:13:54.072417 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0438f2c-747a-4e4d-b847-cb4702e0ae33 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:54.092336 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e761146a-87d9-465a-8af9-9e2ed5cfb017 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:54.093166 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e761146a-87d9-465a-8af9-9e2ed5cfb017 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:54.093454 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e761146a-87d9-465a-8af9-9e2ed5cfb017 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:54.093726 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e761146a-87d9-465a-8af9-9e2ed5cfb017 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:54.100738 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e761146a-87d9-465a-8af9-9e2ed5cfb017 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:13:54.102189 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e761146a-87d9-465a-8af9-9e2ed5cfb017 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:13:54.107683 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:13:54.116299 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application [None req-e761146a-87d9-465a-8af9-9e2ed5cfb017 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 12:13:54.116299 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 12:13:54.116299 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 12:13:54.116299 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 12:13:54.116299 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 12:13:54.116299 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 12:13:54.116299 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 12:13:54.116299 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 12:13:54.116299 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 12:13:54.116299 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 12:13:54.116299 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 12:13:54.116299 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 12:13:54.116299 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 12:13:54.116299 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 12:13:54.116299 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 12:13:54.117262 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 12:13:54.117262 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 12:13:54.117262 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 12:13:54.117262 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 12:13:54.117262 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 12:13:54.117262 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 12:13:54.117262 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 12:13:54.117262 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 12:13:54.117262 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application with Lock( Jun 16 12:13:54.117262 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 12:13:54.117262 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._enter() Jun 16 12:13:54.117262 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 12:13:54.117262 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 12:13:54.117262 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 12:13:54.117262 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.creator() Jun 16 12:13:54.117262 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 12:13:54.117262 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application created_value = creator( Jun 16 12:13:54.118173 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 12:13:54.118173 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 12:13:54.118173 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 12:13:54.118173 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 12:13:54.118173 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 12:13:54.118173 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 12:13:54.118173 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 12:13:54.118173 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application Jun 16 12:13:54.118173 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 312/636] 10.222.0.44 () {56 vars in 1111 bytes} [Thu Jun 16 12:13:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 12:13:54.118689 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e761146a-87d9-465a-8af9-9e2ed5cfb017 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:54.172466 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0438f2c-747a-4e4d-b847-cb4702e0ae33 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:54.205598 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd35d0e-4405-40a8-abe7-6c93bc356b4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:54.206384 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd35d0e-4405-40a8-abe7-6c93bc356b4b None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:54.206661 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd35d0e-4405-40a8-abe7-6c93bc356b4b None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:54.206934 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd35d0e-4405-40a8-abe7-6c93bc356b4b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:54.213643 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd35d0e-4405-40a8-abe7-6c93bc356b4b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:13:54.215141 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd35d0e-4405-40a8-abe7-6c93bc356b4b None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:13:54.218238 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e761146a-87d9-465a-8af9-9e2ed5cfb017 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:54.230549 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-dcd35d0e-4405-40a8-abe7-6c93bc356b4b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 12:13:54.230549 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 12:13:54.230549 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 12:13:54.230549 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 12:13:54.230549 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 12:13:54.230549 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 12:13:54.230549 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 12:13:54.230549 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 12:13:54.230549 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 12:13:54.230549 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 12:13:54.230549 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 12:13:54.230549 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 12:13:54.230549 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 12:13:54.230549 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 12:13:54.230549 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 12:13:54.231640 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 12:13:54.231640 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 12:13:54.231640 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 12:13:54.231640 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 12:13:54.231640 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 12:13:54.231640 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 12:13:54.231640 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 12:13:54.231640 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 12:13:54.231640 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jun 16 12:13:54.231640 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 12:13:54.231640 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jun 16 12:13:54.231640 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 12:13:54.231640 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 12:13:54.231640 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 12:13:54.231640 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jun 16 12:13:54.231640 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 12:13:54.231640 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jun 16 12:13:54.232976 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 12:13:54.232976 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 12:13:54.232976 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 12:13:54.232976 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 12:13:54.232976 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 12:13:54.232976 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 12:13:54.232976 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 12:13:54.232976 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jun 16 12:13:54.232976 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 325/637] 10.222.0.44 () {56 vars in 1111 bytes} [Thu Jun 16 12:13:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 12:13:54.232976 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd35d0e-4405-40a8-abe7-6c93bc356b4b None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:54.255865 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76a6324-baae-4a47-a2f9-3cbef6b3dd33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:54.256661 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76a6324-baae-4a47-a2f9-3cbef6b3dd33 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:54.256977 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76a6324-baae-4a47-a2f9-3cbef6b3dd33 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:54.257252 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76a6324-baae-4a47-a2f9-3cbef6b3dd33 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:54.267336 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76a6324-baae-4a47-a2f9-3cbef6b3dd33 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 12:13:54.275083 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application [None req-a76a6324-baae-4a47-a2f9-3cbef6b3dd33 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 16 12:13:54.275083 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 12:13:54.275083 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 12:13:54.275083 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 12:13:54.275083 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 12:13:54.275083 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 12:13:54.275083 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 12:13:54.275083 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 12:13:54.275083 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 12:13:54.275083 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 12:13:54.275083 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 12:13:54.275083 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 12:13:54.275083 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 12:13:54.275083 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 12:13:54.275083 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 12:13:54.275083 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 12:13:54.276154 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 12:13:54.276154 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 12:13:54.276154 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 12:13:54.276154 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 12:13:54.276154 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 12:13:54.276154 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 12:13:54.276154 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 12:13:54.276154 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 12:13:54.276154 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 12:13:54.276154 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 12:13:54.276154 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 12:13:54.276154 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application with Lock( Jun 16 12:13:54.276154 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 12:13:54.276154 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._enter() Jun 16 12:13:54.276154 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 12:13:54.276154 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 12:13:54.277011 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 12:13:54.277011 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.creator() Jun 16 12:13:54.277011 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 12:13:54.277011 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application created_value = creator( Jun 16 12:13:54.277011 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 12:13:54.277011 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 12:13:54.277011 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 12:13:54.277011 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 12:13:54.277011 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 12:13:54.277011 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 12:13:54.277011 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 16 12:13:54.277011 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application Jun 16 12:13:54.277011 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 313/638] 10.222.0.44 () {56 vars in 1102 bytes} [Thu Jun 16 12:13:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 12:13:54.277684 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9019de-6f07-4c4b-be78-bc450b90ad1c None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:54.277684 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9019de-6f07-4c4b-be78-bc450b90ad1c None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:54.278069 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9019de-6f07-4c4b-be78-bc450b90ad1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:54.294128 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-bf9019de-6f07-4c4b-be78-bc450b90ad1c None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:13:54.295290 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-bf9019de-6f07-4c4b-be78-bc450b90ad1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:13:54.306635 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:13:54.328264 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:13:54.334531 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd35d0e-4405-40a8-abe7-6c93bc356b4b None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:54.363231 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 314/639] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 12:13:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 12:13:54.364074 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9019de-6f07-4c4b-be78-bc450b90ad1c None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:54.369118 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba7cd48-7810-4eb3-a890-1de7b32976d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:54.369908 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba7cd48-7810-4eb3-a890-1de7b32976d4 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:54.370184 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba7cd48-7810-4eb3-a890-1de7b32976d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:54.370452 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba7cd48-7810-4eb3-a890-1de7b32976d4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:54.381884 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba7cd48-7810-4eb3-a890-1de7b32976d4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:13:54.383334 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba7cd48-7810-4eb3-a890-1de7b32976d4 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:13:54.400940 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-cba7cd48-7810-4eb3-a890-1de7b32976d4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 12:13:54.400940 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 12:13:54.400940 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 12:13:54.400940 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 12:13:54.400940 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 12:13:54.400940 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 12:13:54.400940 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 12:13:54.400940 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 12:13:54.400940 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 12:13:54.400940 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 12:13:54.400940 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 12:13:54.400940 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 12:13:54.400940 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 12:13:54.400940 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 12:13:54.400940 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 12:13:54.402067 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 12:13:54.402067 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 12:13:54.402067 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 12:13:54.402067 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 12:13:54.402067 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 12:13:54.402067 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 12:13:54.402067 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 12:13:54.402067 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 12:13:54.402067 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jun 16 12:13:54.402067 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 12:13:54.402067 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jun 16 12:13:54.402067 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 12:13:54.402067 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 12:13:54.402067 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 12:13:54.402067 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jun 16 12:13:54.402067 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 12:13:54.402067 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jun 16 12:13:54.402964 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 12:13:54.402964 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 12:13:54.402964 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 12:13:54.402964 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jun 16 12:13:54.402964 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 326/640] 10.222.0.44 () {56 vars in 1108 bytes} [Thu Jun 16 12:13:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 12:13:54.403250 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba7cd48-7810-4eb3-a890-1de7b32976d4 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:54.466562 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9019de-6f07-4c4b-be78-bc450b90ad1c None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:54.499958 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4064aa09-3558-4113-a50c-2a51dc327757 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:54.500507 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba7cd48-7810-4eb3-a890-1de7b32976d4 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:54.500613 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4064aa09-3558-4113-a50c-2a51dc327757 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:54.500912 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4064aa09-3558-4113-a50c-2a51dc327757 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:54.501182 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4064aa09-3558-4113-a50c-2a51dc327757 None admin] PATH_INFO: `/v3/projects` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:54.501966 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4064aa09-3558-4113-a50c-2a51dc327757 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:13:54.502268 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4064aa09-3558-4113-a50c-2a51dc327757 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:13:54.503695 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4064aa09-3558-4113-a50c-2a51dc327757 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:13:54.514751 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 315/641] 10.222.0.44 () {56 vars in 1148 bytes} [Thu Jun 16 12:13:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:13:54.515519 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4064aa09-3558-4113-a50c-2a51dc327757 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:54.527527 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:13:54.535765 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94463c36-d84c-4f02-8cb5-92e4b03de7db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:54.537004 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94463c36-d84c-4f02-8cb5-92e4b03de7db None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:54.537292 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94463c36-d84c-4f02-8cb5-92e4b03de7db None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:54.537563 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94463c36-d84c-4f02-8cb5-92e4b03de7db None admin] PATH_INFO: `/v3/projects` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:54.538346 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94463c36-d84c-4f02-8cb5-92e4b03de7db None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:13:54.538653 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94463c36-d84c-4f02-8cb5-92e4b03de7db None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:13:54.540072 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94463c36-d84c-4f02-8cb5-92e4b03de7db None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:13:54.551642 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 327/642] 10.222.0.44 () {56 vars in 1148 bytes} [Thu Jun 16 12:13:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:13:54.552447 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94463c36-d84c-4f02-8cb5-92e4b03de7db None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:54.562815 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:13:54.621642 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4064aa09-3558-4113-a50c-2a51dc327757 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:54.649675 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94463c36-d84c-4f02-8cb5-92e4b03de7db None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:54.654160 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e4fd71-3652-4360-a6ef-3aaac5095d99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:54.654819 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e4fd71-3652-4360-a6ef-3aaac5095d99 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:54.655097 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e4fd71-3652-4360-a6ef-3aaac5095d99 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:54.655369 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e4fd71-3652-4360-a6ef-3aaac5095d99 None admin] PATH_INFO: `/v3/roles` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:54.656107 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e4fd71-3652-4360-a6ef-3aaac5095d99 None admin] RBAC: Adding query filter params (name=service) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:13:54.656408 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e4fd71-3652-4360-a6ef-3aaac5095d99 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:13:54.657799 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e4fd71-3652-4360-a6ef-3aaac5095d99 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:13:54.666292 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 316/643] 10.222.0.44 () {56 vars in 1103 bytes} [Thu Jun 16 12:13:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:13:54.667061 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e4fd71-3652-4360-a6ef-3aaac5095d99 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:54.684077 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e03f82-e2b6-468e-a13b-7aabe05ab505 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:54.684964 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e03f82-e2b6-468e-a13b-7aabe05ab505 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:54.685244 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e03f82-e2b6-468e-a13b-7aabe05ab505 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:54.685513 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e03f82-e2b6-468e-a13b-7aabe05ab505 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:54.695729 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e03f82-e2b6-468e-a13b-7aabe05ab505 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 12:13:54.703513 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-c6e03f82-e2b6-468e-a13b-7aabe05ab505 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 16 12:13:54.703513 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 12:13:54.703513 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 12:13:54.703513 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 12:13:54.703513 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 12:13:54.703513 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 12:13:54.703513 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 12:13:54.703513 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 12:13:54.703513 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 12:13:54.703513 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 12:13:54.703513 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 12:13:54.703513 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 12:13:54.703513 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 12:13:54.703513 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 12:13:54.703513 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 12:13:54.703513 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 12:13:54.704607 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 12:13:54.704607 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 12:13:54.704607 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 12:13:54.704607 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 12:13:54.704607 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 12:13:54.704607 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 12:13:54.704607 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 12:13:54.704607 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 12:13:54.704607 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 12:13:54.704607 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 12:13:54.704607 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 12:13:54.704607 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jun 16 12:13:54.704607 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 12:13:54.704607 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jun 16 12:13:54.704607 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 12:13:54.704607 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 12:13:54.705536 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 12:13:54.705536 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jun 16 12:13:54.705536 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 12:13:54.705536 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jun 16 12:13:54.705536 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 12:13:54.705536 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 12:13:54.705536 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 12:13:54.705536 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 12:13:54.705536 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 12:13:54.705536 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 12:13:54.705536 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 16 12:13:54.705536 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jun 16 12:13:54.705536 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 328/644] 10.222.0.44 () {56 vars in 1102 bytes} [Thu Jun 16 12:13:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 12:13:54.706335 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e03f82-e2b6-468e-a13b-7aabe05ab505 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:54.737149 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:13:54.770310 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:13:54.771169 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e4fd71-3652-4360-a6ef-3aaac5095d99 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:54.804568 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0450d0-98b6-4ad6-99ed-877b0a4af19e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:54.805310 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0450d0-98b6-4ad6-99ed-877b0a4af19e None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:54.805512 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e03f82-e2b6-468e-a13b-7aabe05ab505 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:54.805613 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0450d0-98b6-4ad6-99ed-877b0a4af19e None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:54.805861 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0450d0-98b6-4ad6-99ed-877b0a4af19e None admin] PATH_INFO: `/v3/domains` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:54.806580 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0450d0-98b6-4ad6-99ed-877b0a4af19e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:13:54.806882 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0450d0-98b6-4ad6-99ed-877b0a4af19e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:13:54.808235 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0450d0-98b6-4ad6-99ed-877b0a4af19e None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:13:54.820077 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 317/645] 10.222.0.44 () {56 vars in 1109 bytes} [Thu Jun 16 12:13:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:13:54.820859 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0450d0-98b6-4ad6-99ed-877b0a4af19e None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:54.839101 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34822df-5b14-4f75-98e4-228dcac2558a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:54.839748 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34822df-5b14-4f75-98e4-228dcac2558a None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:54.840027 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34822df-5b14-4f75-98e4-228dcac2558a None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:54.840298 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34822df-5b14-4f75-98e4-228dcac2558a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:54.841151 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34822df-5b14-4f75-98e4-228dcac2558a None admin] RBAC: Adding query filter params (role.id=a5c06bc21d39451285def24673456ff6, scope.project.id=601361df39e34fcca71175aa94e425c4, user.id=edfb12d445e74136b90800e93941f468) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:13:54.841457 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34822df-5b14-4f75-98e4-228dcac2558a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:13:54.842876 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34822df-5b14-4f75-98e4-228dcac2558a None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:13:54.848517 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 329/646] 10.222.0.44 () {56 vars in 1374 bytes} [Thu Jun 16 12:13:54 2022] GET /identity/v3/role_assignments?user.id=edfb12d445e74136b90800e93941f468&scope.project.id=601361df39e34fcca71175aa94e425c4&role.id=a5c06bc21d39451285def24673456ff6 => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:13:54.849343 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34822df-5b14-4f75-98e4-228dcac2558a None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:54.939073 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0450d0-98b6-4ad6-99ed-877b0a4af19e None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:54.969250 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:13:54.969498 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34822df-5b14-4f75-98e4-228dcac2558a None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:54.978795 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2b4ef3-6c5a-4d57-93bf-8cef995b5e0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:54.979702 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2b4ef3-6c5a-4d57-93bf-8cef995b5e0a None admin] REQUEST_METHOD: `PUT` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:54.979980 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2b4ef3-6c5a-4d57-93bf-8cef995b5e0a None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:54.980634 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2b4ef3-6c5a-4d57-93bf-8cef995b5e0a None admin] PATH_INFO: `/v3/projects/601361df39e34fcca71175aa94e425c4/users/c159f79c1921496487101aac5d530ae5/roles/a5c06bc21d39451285def24673456ff6` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:54.997390 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2b4ef3-6c5a-4d57-93bf-8cef995b5e0a None admin] RBAC: Authorizing `identity:create_grant(project_id=601361df39e34fcca71175aa94e425c4, user_id=c159f79c1921496487101aac5d530ae5, role_id=a5c06bc21d39451285def24673456ff6)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:13:54.998868 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2b4ef3-6c5a-4d57-93bf-8cef995b5e0a None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:13:55.004823 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:13:55.010222 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d717e0c-6671-4d5d-8b32-2b3e8e32d289 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:55.011030 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d717e0c-6671-4d5d-8b32-2b3e8e32d289 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:55.011294 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d717e0c-6671-4d5d-8b32-2b3e8e32d289 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:55.011565 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d717e0c-6671-4d5d-8b32-2b3e8e32d289 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:55.022839 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 318/647] 10.222.0.44 () {58 vars in 1439 bytes} [Thu Jun 16 12:13:54 2022] PUT /identity/v3/projects/601361df39e34fcca71175aa94e425c4/users/c159f79c1921496487101aac5d530ae5/roles/a5c06bc21d39451285def24673456ff6 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:13:55.024174 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2b4ef3-6c5a-4d57-93bf-8cef995b5e0a None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:55.030284 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d717e0c-6671-4d5d-8b32-2b3e8e32d289 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:13:55.032740 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d717e0c-6671-4d5d-8b32-2b3e8e32d289 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:13:55.052665 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-1d717e0c-6671-4d5d-8b32-2b3e8e32d289 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 12:13:55.052665 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 12:13:55.052665 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 12:13:55.052665 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 12:13:55.052665 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 12:13:55.052665 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 12:13:55.052665 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 12:13:55.052665 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 12:13:55.052665 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 12:13:55.052665 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 12:13:55.052665 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 12:13:55.052665 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 12:13:55.052665 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 12:13:55.052665 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 12:13:55.052665 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 12:13:55.053654 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 12:13:55.053654 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 12:13:55.053654 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 12:13:55.053654 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 12:13:55.053654 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 12:13:55.053654 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 12:13:55.053654 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 12:13:55.053654 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 12:13:55.053654 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jun 16 12:13:55.053654 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 12:13:55.053654 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jun 16 12:13:55.053654 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 12:13:55.053654 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 12:13:55.053654 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 12:13:55.053654 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jun 16 12:13:55.053654 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 12:13:55.053654 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jun 16 12:13:55.054502 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 12:13:55.054502 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 12:13:55.054502 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 12:13:55.054502 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jun 16 12:13:55.054502 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 330/648] 10.222.0.44 () {56 vars in 1108 bytes} [Thu Jun 16 12:13:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 12:13:55.055238 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d717e0c-6671-4d5d-8b32-2b3e8e32d289 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:55.155728 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2b4ef3-6c5a-4d57-93bf-8cef995b5e0a None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:55.200866 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d717e0c-6671-4d5d-8b32-2b3e8e32d289 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:55.205325 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cd6b96-7f7c-4310-a42b-84a9a5f26c87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:55.206005 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cd6b96-7f7c-4310-a42b-84a9a5f26c87 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:55.206284 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cd6b96-7f7c-4310-a42b-84a9a5f26c87 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:55.206580 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cd6b96-7f7c-4310-a42b-84a9a5f26c87 None admin] PATH_INFO: `/v3/roles` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:55.207301 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cd6b96-7f7c-4310-a42b-84a9a5f26c87 None admin] RBAC: Adding query filter params (name=service) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:13:55.207603 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cd6b96-7f7c-4310-a42b-84a9a5f26c87 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:13:55.209580 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cd6b96-7f7c-4310-a42b-84a9a5f26c87 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:13:55.219745 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 319/649] 10.222.0.44 () {56 vars in 1103 bytes} [Thu Jun 16 12:13:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:13:55.220667 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cd6b96-7f7c-4310-a42b-84a9a5f26c87 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:55.244554 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ed7fa2-051b-4779-a17d-92a9b5413d92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:55.245389 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ed7fa2-051b-4779-a17d-92a9b5413d92 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:55.245664 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ed7fa2-051b-4779-a17d-92a9b5413d92 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:55.245933 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ed7fa2-051b-4779-a17d-92a9b5413d92 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:55.254756 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ed7fa2-051b-4779-a17d-92a9b5413d92 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:13:55.256772 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ed7fa2-051b-4779-a17d-92a9b5413d92 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:13:55.271617 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-38ed7fa2-051b-4779-a17d-92a9b5413d92 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 16 12:13:55.271617 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 12:13:55.271617 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 12:13:55.271617 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 12:13:55.271617 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 12:13:55.271617 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 12:13:55.271617 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 12:13:55.271617 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 12:13:55.271617 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 12:13:55.271617 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 12:13:55.271617 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 12:13:55.271617 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 12:13:55.271617 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 12:13:55.271617 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 12:13:55.271617 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 12:13:55.271617 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 12:13:55.272573 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 12:13:55.272573 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 12:13:55.272573 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 12:13:55.272573 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 12:13:55.272573 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 12:13:55.272573 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 12:13:55.272573 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 12:13:55.272573 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 12:13:55.272573 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 12:13:55.272573 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 12:13:55.272573 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 12:13:55.272573 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jun 16 12:13:55.272573 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 12:13:55.272573 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jun 16 12:13:55.272573 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 12:13:55.272573 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 12:13:55.272573 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 12:13:55.272573 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jun 16 12:13:55.274323 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 12:13:55.274323 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jun 16 12:13:55.274323 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 12:13:55.274323 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 12:13:55.274323 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 12:13:55.274323 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 12:13:55.274323 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 12:13:55.274323 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 12:13:55.274323 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 16 12:13:55.274323 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jun 16 12:13:55.274858 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:13:55.274939 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 331/650] 10.222.0.44 () {56 vars in 1099 bytes} [Thu Jun 16 12:13:55 2022] GET /identity/v3/users/glance => generated 84 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 12:13:55.274939 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ed7fa2-051b-4779-a17d-92a9b5413d92 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:55.337718 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:13:55.351009 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cd6b96-7f7c-4310-a42b-84a9a5f26c87 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:55.405268 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db152bbb-2e36-40c3-9b40-8c47bccceae0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:55.406485 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ed7fa2-051b-4779-a17d-92a9b5413d92 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:55.406936 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db152bbb-2e36-40c3-9b40-8c47bccceae0 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:55.407437 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db152bbb-2e36-40c3-9b40-8c47bccceae0 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:55.408179 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db152bbb-2e36-40c3-9b40-8c47bccceae0 None admin] PATH_INFO: `/v3/domains` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:55.410090 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db152bbb-2e36-40c3-9b40-8c47bccceae0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:13:55.410609 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db152bbb-2e36-40c3-9b40-8c47bccceae0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:13:55.412244 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db152bbb-2e36-40c3-9b40-8c47bccceae0 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:13:55.430832 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 320/651] 10.222.0.44 () {56 vars in 1109 bytes} [Thu Jun 16 12:13:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:13:55.432818 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db152bbb-2e36-40c3-9b40-8c47bccceae0 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:55.443999 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f42c39c-7267-44a1-819d-c87d0cca152f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:55.444553 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f42c39c-7267-44a1-819d-c87d0cca152f None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:55.444867 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f42c39c-7267-44a1-819d-c87d0cca152f None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:55.445142 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f42c39c-7267-44a1-819d-c87d0cca152f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:55.456570 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f42c39c-7267-44a1-819d-c87d0cca152f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:13:55.458718 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f42c39c-7267-44a1-819d-c87d0cca152f None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:13:55.477035 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-7f42c39c-7267-44a1-819d-c87d0cca152f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 12:13:55.477035 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 12:13:55.477035 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 12:13:55.477035 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 12:13:55.477035 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 12:13:55.477035 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 12:13:55.477035 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 12:13:55.477035 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 12:13:55.477035 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 12:13:55.477035 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 12:13:55.477035 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 12:13:55.477035 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 12:13:55.477035 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 12:13:55.477035 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 12:13:55.477035 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 12:13:55.477945 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 12:13:55.477945 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 12:13:55.477945 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 12:13:55.477945 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 12:13:55.477945 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 12:13:55.477945 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 12:13:55.477945 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 12:13:55.477945 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 12:13:55.477945 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jun 16 12:13:55.477945 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 12:13:55.477945 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jun 16 12:13:55.477945 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 12:13:55.477945 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 12:13:55.477945 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 12:13:55.477945 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jun 16 12:13:55.477945 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 12:13:55.477945 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jun 16 12:13:55.478824 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 12:13:55.478824 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 12:13:55.478824 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 12:13:55.478824 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jun 16 12:13:55.482782 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 332/652] 10.222.0.44 () {56 vars in 1108 bytes} [Thu Jun 16 12:13:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 12:13:55.483621 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f42c39c-7267-44a1-819d-c87d0cca152f None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:55.570667 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:13:55.575673 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db152bbb-2e36-40c3-9b40-8c47bccceae0 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:55.589837 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:13:55.597209 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f42c39c-7267-44a1-819d-c87d0cca152f None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:55.626400 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa82fd0-c765-4f48-a33e-e71b0d13dd4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:55.627580 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa82fd0-c765-4f48-a33e-e71b0d13dd4a None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:55.628044 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa82fd0-c765-4f48-a33e-e71b0d13dd4a None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:55.628675 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa82fd0-c765-4f48-a33e-e71b0d13dd4a None admin] PATH_INFO: `/v3/users` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:55.630901 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa82fd0-c765-4f48-a33e-e71b0d13dd4a None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:13:55.631380 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa82fd0-c765-4f48-a33e-e71b0d13dd4a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:13:55.633001 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa82fd0-c765-4f48-a33e-e71b0d13dd4a None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:13:55.634906 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f949ec74-84de-4a0f-9fea-d665a1033cfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:55.635796 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f949ec74-84de-4a0f-9fea-d665a1033cfb None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:55.636787 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f949ec74-84de-4a0f-9fea-d665a1033cfb None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:55.636787 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f949ec74-84de-4a0f-9fea-d665a1033cfb None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:55.644773 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f949ec74-84de-4a0f-9fea-d665a1033cfb None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:13:55.646696 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f949ec74-84de-4a0f-9fea-d665a1033cfb None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:13:55.655473 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 321/653] 10.222.0.44 () {56 vars in 1137 bytes} [Thu Jun 16 12:13:55 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:13:55.656582 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa82fd0-c765-4f48-a33e-e71b0d13dd4a None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:55.662270 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-f949ec74-84de-4a0f-9fea-d665a1033cfb None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 16 12:13:55.662270 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 12:13:55.662270 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 12:13:55.662270 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 12:13:55.662270 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 12:13:55.662270 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 12:13:55.662270 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 12:13:55.662270 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 12:13:55.662270 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 12:13:55.662270 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 12:13:55.662270 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 12:13:55.662270 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 12:13:55.662270 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 12:13:55.662270 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 12:13:55.662270 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 12:13:55.662270 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 12:13:55.663411 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 12:13:55.663411 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 12:13:55.663411 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 12:13:55.663411 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 12:13:55.663411 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 12:13:55.663411 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 12:13:55.663411 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 12:13:55.663411 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 12:13:55.663411 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 12:13:55.663411 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 12:13:55.663411 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 12:13:55.663411 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jun 16 12:13:55.663411 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 12:13:55.663411 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jun 16 12:13:55.663411 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 12:13:55.663411 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 12:13:55.663411 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 12:13:55.663411 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jun 16 12:13:55.664601 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 12:13:55.664601 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jun 16 12:13:55.664601 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 12:13:55.664601 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 12:13:55.664601 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 12:13:55.664601 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 12:13:55.664601 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 12:13:55.664601 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 12:13:55.664601 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 16 12:13:55.664601 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jun 16 12:13:55.666464 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 333/654] 10.222.0.44 () {56 vars in 1099 bytes} [Thu Jun 16 12:13:55 2022] GET /identity/v3/users/cinder => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 12:13:55.667312 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f949ec74-84de-4a0f-9fea-d665a1033cfb None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:55.778694 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f949ec74-84de-4a0f-9fea-d665a1033cfb None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:55.794122 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa82fd0-c765-4f48-a33e-e71b0d13dd4a None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:55.813929 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaeafc83-cd50-4943-90a1-d43969e34569 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:55.814692 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaeafc83-cd50-4943-90a1-d43969e34569 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:55.815070 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaeafc83-cd50-4943-90a1-d43969e34569 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:55.815462 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaeafc83-cd50-4943-90a1-d43969e34569 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:55.838528 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a71369-7630-4d93-8708-681fa3f217f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:55.839402 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a71369-7630-4d93-8708-681fa3f217f7 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:55.839840 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a71369-7630-4d93-8708-681fa3f217f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:55.840652 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a71369-7630-4d93-8708-681fa3f217f7 None admin] PATH_INFO: `/v3/domains` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:55.841920 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a71369-7630-4d93-8708-681fa3f217f7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:13:55.842375 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a71369-7630-4d93-8708-681fa3f217f7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:13:55.843798 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:13:55.844227 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a71369-7630-4d93-8708-681fa3f217f7 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:13:55.859752 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 322/655] 10.222.0.44 () {56 vars in 1109 bytes} [Thu Jun 16 12:13:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:13:55.860848 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a71369-7630-4d93-8708-681fa3f217f7 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:55.885306 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:13:55.909629 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaeafc83-cd50-4943-90a1-d43969e34569 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:13:55.911340 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaeafc83-cd50-4943-90a1-d43969e34569 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:13:56.027444 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a71369-7630-4d93-8708-681fa3f217f7 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:56.031692 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 334/656] 10.222.0.44 () {58 vars in 1282 bytes} [Thu Jun 16 12:13:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 12:13:56.032709 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaeafc83-cd50-4943-90a1-d43969e34569 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:56.083460 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd83775d-f67b-4c15-845e-c348fe8d3d40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:56.084316 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd83775d-f67b-4c15-845e-c348fe8d3d40 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:56.084687 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd83775d-f67b-4c15-845e-c348fe8d3d40 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:56.085071 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd83775d-f67b-4c15-845e-c348fe8d3d40 None admin] PATH_INFO: `/v3/users` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:56.086011 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd83775d-f67b-4c15-845e-c348fe8d3d40 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:13:56.086415 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd83775d-f67b-4c15-845e-c348fe8d3d40 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:13:56.087918 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd83775d-f67b-4c15-845e-c348fe8d3d40 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:13:56.110248 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 323/657] 10.222.0.44 () {56 vars in 1137 bytes} [Thu Jun 16 12:13:55 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:13:56.111168 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd83775d-f67b-4c15-845e-c348fe8d3d40 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:56.113562 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:13:56.171219 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaeafc83-cd50-4943-90a1-d43969e34569 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:56.227680 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:13:56.235726 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ef4a37-9a4c-48f4-9a1d-cbfaddb357be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:56.237133 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ef4a37-9a4c-48f4-9a1d-cbfaddb357be None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:56.237512 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ef4a37-9a4c-48f4-9a1d-cbfaddb357be None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:56.237880 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ef4a37-9a4c-48f4-9a1d-cbfaddb357be None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:56.248277 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ef4a37-9a4c-48f4-9a1d-cbfaddb357be None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:13:56.250001 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ef4a37-9a4c-48f4-9a1d-cbfaddb357be None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:13:56.262112 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd83775d-f67b-4c15-845e-c348fe8d3d40 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:56.266842 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-73ef4a37-9a4c-48f4-9a1d-cbfaddb357be None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 16 12:13:56.266842 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 12:13:56.266842 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 12:13:56.266842 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 12:13:56.266842 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 12:13:56.266842 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 12:13:56.266842 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 12:13:56.266842 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 12:13:56.266842 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 12:13:56.266842 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 12:13:56.266842 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 12:13:56.266842 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 12:13:56.266842 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 12:13:56.266842 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 12:13:56.266842 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 12:13:56.266842 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 12:13:56.267772 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 12:13:56.267772 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 12:13:56.267772 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 12:13:56.267772 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 12:13:56.267772 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 12:13:56.267772 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 12:13:56.267772 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 12:13:56.267772 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 12:13:56.267772 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 12:13:56.267772 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 12:13:56.267772 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 12:13:56.267772 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jun 16 12:13:56.267772 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 12:13:56.267772 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jun 16 12:13:56.267772 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 12:13:56.267772 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 12:13:56.267772 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 12:13:56.267772 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jun 16 12:13:56.268730 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 12:13:56.268730 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jun 16 12:13:56.268730 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 12:13:56.268730 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 12:13:56.268730 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 12:13:56.268730 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 12:13:56.268730 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 12:13:56.268730 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 12:13:56.268730 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 16 12:13:56.268730 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jun 16 12:13:56.268730 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 335/658] 10.222.0.44 () {56 vars in 1102 bytes} [Thu Jun 16 12:13:56 2022] GET /identity/v3/users/neutron => generated 85 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 12:13:56.269850 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ef4a37-9a4c-48f4-9a1d-cbfaddb357be None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:56.303643 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32470ab8-55b9-490b-bebf-047ce1312c5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:56.304541 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32470ab8-55b9-490b-bebf-047ce1312c5d None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:56.304914 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32470ab8-55b9-490b-bebf-047ce1312c5d None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:56.308105 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32470ab8-55b9-490b-bebf-047ce1312c5d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:56.315917 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32470ab8-55b9-490b-bebf-047ce1312c5d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:13:56.317443 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32470ab8-55b9-490b-bebf-047ce1312c5d None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:13:56.336294 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application [None req-32470ab8-55b9-490b-bebf-047ce1312c5d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 12:13:56.336294 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 12:13:56.336294 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 12:13:56.336294 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 12:13:56.336294 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 12:13:56.336294 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 12:13:56.336294 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 12:13:56.336294 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 12:13:56.336294 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 12:13:56.336294 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 12:13:56.336294 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 12:13:56.336294 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 12:13:56.336294 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 12:13:56.336294 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 12:13:56.336294 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 12:13:56.338467 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 12:13:56.338467 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 12:13:56.338467 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 12:13:56.338467 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 12:13:56.338467 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 12:13:56.338467 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 12:13:56.338467 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 12:13:56.338467 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 12:13:56.338467 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application with Lock( Jun 16 12:13:56.338467 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 12:13:56.338467 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._enter() Jun 16 12:13:56.338467 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 12:13:56.338467 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 12:13:56.338467 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 12:13:56.338467 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.creator() Jun 16 12:13:56.338467 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 12:13:56.338467 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application created_value = creator( Jun 16 12:13:56.340634 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 12:13:56.340634 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 12:13:56.340634 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 12:13:56.340634 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application Jun 16 12:13:56.348135 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 324/659] 10.222.0.44 () {56 vars in 1108 bytes} [Thu Jun 16 12:13:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 12:13:56.348135 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32470ab8-55b9-490b-bebf-047ce1312c5d None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:56.461392 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32470ab8-55b9-490b-bebf-047ce1312c5d None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:56.470401 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ef4a37-9a4c-48f4-9a1d-cbfaddb357be None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:56.488591 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:13:56.498476 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9db13a-6709-4850-8d64-002a27aefee0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:56.499406 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9db13a-6709-4850-8d64-002a27aefee0 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:56.499886 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9db13a-6709-4850-8d64-002a27aefee0 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:56.500355 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9db13a-6709-4850-8d64-002a27aefee0 None admin] PATH_INFO: `/v3/users` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:56.501813 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9db13a-6709-4850-8d64-002a27aefee0 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:13:56.504063 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9db13a-6709-4850-8d64-002a27aefee0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:13:56.509594 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:13:56.510722 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9db13a-6709-4850-8d64-002a27aefee0 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:13:56.532153 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 325/660] 10.222.0.44 () {56 vars in 1139 bytes} [Thu Jun 16 12:13:56 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:13:56.533430 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9db13a-6709-4850-8d64-002a27aefee0 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:56.560312 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c395ed-934f-4f3f-8c53-1153741dd5e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:56.561012 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c395ed-934f-4f3f-8c53-1153741dd5e5 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:56.561292 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c395ed-934f-4f3f-8c53-1153741dd5e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:56.561567 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c395ed-934f-4f3f-8c53-1153741dd5e5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:56.647123 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9db13a-6709-4850-8d64-002a27aefee0 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:56.657388 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c395ed-934f-4f3f-8c53-1153741dd5e5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:13:56.658855 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c395ed-934f-4f3f-8c53-1153741dd5e5 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:13:56.687470 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728f3f4d-5c24-4172-83fb-9dd57953d4ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:56.688470 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728f3f4d-5c24-4172-83fb-9dd57953d4ad None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:56.688986 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728f3f4d-5c24-4172-83fb-9dd57953d4ad None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:56.689576 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728f3f4d-5c24-4172-83fb-9dd57953d4ad None admin] PATH_INFO: `/v3/domains` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:56.690588 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728f3f4d-5c24-4172-83fb-9dd57953d4ad None admin] RBAC: Adding query filter params (name=Default) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:13:56.691093 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728f3f4d-5c24-4172-83fb-9dd57953d4ad None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:13:56.692717 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728f3f4d-5c24-4172-83fb-9dd57953d4ad None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:13:56.710788 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 326/661] 10.222.0.44 () {56 vars in 1109 bytes} [Thu Jun 16 12:13:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:13:56.712122 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728f3f4d-5c24-4172-83fb-9dd57953d4ad None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:56.765673 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:13:56.767036 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 336/662] 10.222.0.44 () {58 vars in 1282 bytes} [Thu Jun 16 12:13:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 493 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 12:13:56.767958 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c395ed-934f-4f3f-8c53-1153741dd5e5 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:56.786263 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:13:56.830719 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728f3f4d-5c24-4172-83fb-9dd57953d4ad None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:56.867272 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9003512b-84b5-4f9d-9f53-04c3f3a1b1eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:56.868300 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9003512b-84b5-4f9d-9f53-04c3f3a1b1eb None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:56.868726 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9003512b-84b5-4f9d-9f53-04c3f3a1b1eb None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:56.869151 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9003512b-84b5-4f9d-9f53-04c3f3a1b1eb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:56.888590 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c395ed-934f-4f3f-8c53-1153741dd5e5 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:56.934182 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606f37e5-936a-4f2d-a208-523e2ada4112 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:56.934987 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606f37e5-936a-4f2d-a208-523e2ada4112 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:56.935265 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606f37e5-936a-4f2d-a208-523e2ada4112 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:56.935620 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606f37e5-936a-4f2d-a208-523e2ada4112 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:56.944099 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606f37e5-936a-4f2d-a208-523e2ada4112 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:13:56.946285 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606f37e5-936a-4f2d-a208-523e2ada4112 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:13:56.958511 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9003512b-84b5-4f9d-9f53-04c3f3a1b1eb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:13:56.960159 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9003512b-84b5-4f9d-9f53-04c3f3a1b1eb None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:13:56.964458 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-606f37e5-936a-4f2d-a208-523e2ada4112 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 12:13:56.964458 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 12:13:56.964458 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 12:13:56.964458 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 12:13:56.964458 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 12:13:56.964458 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 12:13:56.964458 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 12:13:56.964458 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 12:13:56.964458 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 12:13:56.964458 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 12:13:56.964458 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 12:13:56.964458 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 12:13:56.964458 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 12:13:56.964458 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 12:13:56.964458 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 12:13:56.965549 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 12:13:56.965549 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 12:13:56.965549 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 12:13:56.965549 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 12:13:56.965549 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 12:13:56.965549 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 12:13:56.965549 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 12:13:56.965549 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 12:13:56.965549 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jun 16 12:13:56.965549 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 12:13:56.965549 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jun 16 12:13:56.965549 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 12:13:56.965549 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 12:13:56.965549 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 12:13:56.965549 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jun 16 12:13:56.965549 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 12:13:56.965549 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jun 16 12:13:56.966640 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 12:13:56.966640 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 12:13:56.966640 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 12:13:56.966640 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 12:13:56.966640 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 12:13:56.966640 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 12:13:56.966640 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 12:13:56.966640 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jun 16 12:13:56.967425 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 337/663] 10.222.0.44 () {56 vars in 1111 bytes} [Thu Jun 16 12:13:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 12:13:56.968276 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606f37e5-936a-4f2d-a208-523e2ada4112 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:57.017442 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:13:57.067207 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:13:57.090129 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 327/664] 10.222.0.44 () {58 vars in 1282 bytes} [Thu Jun 16 12:13:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 12:13:57.091311 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9003512b-84b5-4f9d-9f53-04c3f3a1b1eb None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:57.101206 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606f37e5-936a-4f2d-a208-523e2ada4112 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:57.142916 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5c5e7d-6fd3-4010-beab-dba83f556816 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:57.144254 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5c5e7d-6fd3-4010-beab-dba83f556816 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:57.144540 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5c5e7d-6fd3-4010-beab-dba83f556816 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:57.144845 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5c5e7d-6fd3-4010-beab-dba83f556816 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:57.160146 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5c5e7d-6fd3-4010-beab-dba83f556816 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:13:57.163220 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5c5e7d-6fd3-4010-beab-dba83f556816 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:13:57.187397 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-6e5c5e7d-6fd3-4010-beab-dba83f556816 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 12:13:57.187397 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 12:13:57.187397 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 12:13:57.187397 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 12:13:57.187397 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 12:13:57.187397 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 12:13:57.187397 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 12:13:57.187397 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 12:13:57.187397 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 12:13:57.187397 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 12:13:57.187397 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 12:13:57.187397 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 12:13:57.187397 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 12:13:57.187397 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 12:13:57.187397 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 12:13:57.188340 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 12:13:57.188340 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 12:13:57.188340 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 12:13:57.188340 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 12:13:57.188340 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 12:13:57.188340 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 12:13:57.188340 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 12:13:57.188340 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 12:13:57.188340 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jun 16 12:13:57.188340 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 12:13:57.188340 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jun 16 12:13:57.188340 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 12:13:57.188340 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 12:13:57.188340 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 12:13:57.188340 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jun 16 12:13:57.188340 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 12:13:57.188340 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jun 16 12:13:57.189296 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 12:13:57.189296 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 12:13:57.189296 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 12:13:57.189296 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jun 16 12:13:57.192820 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 338/665] 10.222.0.44 () {56 vars in 1108 bytes} [Thu Jun 16 12:13:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 12:13:57.193944 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5c5e7d-6fd3-4010-beab-dba83f556816 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:57.225442 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9003512b-84b5-4f9d-9f53-04c3f3a1b1eb None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:57.261251 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6389d06d-3672-4d50-b645-f09529a4483d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:57.261913 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6389d06d-3672-4d50-b645-f09529a4483d None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:57.262192 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6389d06d-3672-4d50-b645-f09529a4483d None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:57.262465 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6389d06d-3672-4d50-b645-f09529a4483d None admin] PATH_INFO: `/v3/projects` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:57.263256 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6389d06d-3672-4d50-b645-f09529a4483d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:13:57.263558 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6389d06d-3672-4d50-b645-f09529a4483d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:13:57.264990 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6389d06d-3672-4d50-b645-f09529a4483d None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:13:57.277083 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 328/666] 10.222.0.44 () {56 vars in 1148 bytes} [Thu Jun 16 12:13:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:13:57.277767 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6389d06d-3672-4d50-b645-f09529a4483d None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:57.288484 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:13:57.310972 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5c5e7d-6fd3-4010-beab-dba83f556816 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:57.336389 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:13:57.344212 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0673065-41c4-4b66-a0d5-b8e9d447e21a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:57.345034 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0673065-41c4-4b66-a0d5-b8e9d447e21a None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:57.345315 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0673065-41c4-4b66-a0d5-b8e9d447e21a None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:57.345588 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0673065-41c4-4b66-a0d5-b8e9d447e21a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:57.356427 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0673065-41c4-4b66-a0d5-b8e9d447e21a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:13:57.357918 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0673065-41c4-4b66-a0d5-b8e9d447e21a None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:13:57.374956 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-a0673065-41c4-4b66-a0d5-b8e9d447e21a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 12:13:57.374956 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 12:13:57.374956 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 12:13:57.374956 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 12:13:57.374956 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 12:13:57.374956 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 12:13:57.374956 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 12:13:57.374956 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 12:13:57.374956 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 12:13:57.374956 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 12:13:57.374956 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 12:13:57.374956 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 12:13:57.374956 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 12:13:57.374956 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 12:13:57.374956 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 12:13:57.375841 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 12:13:57.375841 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 12:13:57.375841 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 12:13:57.375841 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 12:13:57.375841 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 12:13:57.375841 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 12:13:57.375841 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 12:13:57.375841 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 12:13:57.375841 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jun 16 12:13:57.375841 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 12:13:57.375841 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jun 16 12:13:57.375841 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 12:13:57.375841 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 12:13:57.375841 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 12:13:57.375841 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jun 16 12:13:57.375841 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 12:13:57.375841 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jun 16 12:13:57.376716 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 12:13:57.376716 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 12:13:57.376716 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 12:13:57.376716 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jun 16 12:13:57.376716 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 339/667] 10.222.0.44 () {56 vars in 1108 bytes} [Thu Jun 16 12:13:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 12:13:57.377389 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6389d06d-3672-4d50-b645-f09529a4483d None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:57.377463 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6984f954-6064-4652-985b-3e6c1397853a None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:57.377597 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6984f954-6064-4652-985b-3e6c1397853a None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:57.377855 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6984f954-6064-4652-985b-3e6c1397853a None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:57.379287 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 340/668] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 12:13:57 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 12:13:57.380203 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f317959-4187-4aad-8569-2d80d56d6a2c None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:57.380483 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f317959-4187-4aad-8569-2d80d56d6a2c None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:57.380721 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f317959-4187-4aad-8569-2d80d56d6a2c None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:57.381944 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 341/669] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 12:13:57 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 12:13:57.382626 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f317959-4187-4aad-8569-2d80d56d6a2c None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:57.415835 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9164c400-8b9b-4f3f-992a-c86f0ee9f35b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:57.416487 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9164c400-8b9b-4f3f-992a-c86f0ee9f35b None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:57.416774 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9164c400-8b9b-4f3f-992a-c86f0ee9f35b None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:57.417061 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9164c400-8b9b-4f3f-992a-c86f0ee9f35b None admin] PATH_INFO: `/v3/domains` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:57.417766 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9164c400-8b9b-4f3f-992a-c86f0ee9f35b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:13:57.418068 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9164c400-8b9b-4f3f-992a-c86f0ee9f35b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:13:57.419699 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9164c400-8b9b-4f3f-992a-c86f0ee9f35b None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:13:57.431481 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 329/670] 10.222.0.44 () {56 vars in 1109 bytes} [Thu Jun 16 12:13:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:13:57.432260 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9164c400-8b9b-4f3f-992a-c86f0ee9f35b None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:57.486600 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f317959-4187-4aad-8569-2d80d56d6a2c None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:57.494349 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:13:57.518786 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0d14c1-c305-4221-81ab-5fdd11349e5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:57.519427 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0d14c1-c305-4221-81ab-5fdd11349e5f None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:57.519702 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0d14c1-c305-4221-81ab-5fdd11349e5f None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:57.519971 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0d14c1-c305-4221-81ab-5fdd11349e5f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:57.521335 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0d14c1-c305-4221-81ab-5fdd11349e5f None admin] RBAC: Adding query filter params (role.id=a5c06bc21d39451285def24673456ff6, scope.project.id=601361df39e34fcca71175aa94e425c4, user.id=42dedbccc64747d581c862a69ae20941) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:13:57.521639 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0d14c1-c305-4221-81ab-5fdd11349e5f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:13:57.523065 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0d14c1-c305-4221-81ab-5fdd11349e5f None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:13:57.528047 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9164c400-8b9b-4f3f-992a-c86f0ee9f35b None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:57.528840 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 342/671] 10.222.0.44 () {56 vars in 1374 bytes} [Thu Jun 16 12:13:57 2022] GET /identity/v3/role_assignments?user.id=42dedbccc64747d581c862a69ae20941&scope.project.id=601361df39e34fcca71175aa94e425c4&role.id=a5c06bc21d39451285def24673456ff6 => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:13:57.529979 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8b6cc9-86ec-4777-b0be-7ef3328ccea9 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:57.530257 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8b6cc9-86ec-4777-b0be-7ef3328ccea9 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:57.530526 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8b6cc9-86ec-4777-b0be-7ef3328ccea9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:57.548216 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-7e8b6cc9-86ec-4777-b0be-7ef3328ccea9 None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:13:57.549469 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-7e8b6cc9-86ec-4777-b0be-7ef3328ccea9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:13:57.576110 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13aff9b8-e4c3-414f-a6ef-e2200dfb563a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:57.576859 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13aff9b8-e4c3-414f-a6ef-e2200dfb563a None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:57.577137 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13aff9b8-e4c3-414f-a6ef-e2200dfb563a None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:57.577461 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13aff9b8-e4c3-414f-a6ef-e2200dfb563a None admin] PATH_INFO: `/v3/domains` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:57.578473 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13aff9b8-e4c3-414f-a6ef-e2200dfb563a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:13:57.578788 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13aff9b8-e4c3-414f-a6ef-e2200dfb563a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:13:57.580273 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13aff9b8-e4c3-414f-a6ef-e2200dfb563a None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:13:57.597180 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:13:57.598950 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 330/672] 10.222.0.44 () {56 vars in 1109 bytes} [Thu Jun 16 12:13:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:13:57.600359 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca441fc8-4bc7-440c-816d-2c58d8bd43d0 None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:57.600652 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca441fc8-4bc7-440c-816d-2c58d8bd43d0 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:57.600959 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca441fc8-4bc7-440c-816d-2c58d8bd43d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:57.619036 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-ca441fc8-4bc7-440c-816d-2c58d8bd43d0 None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:13:57.620416 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-ca441fc8-4bc7-440c-816d-2c58d8bd43d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:13:57.636776 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 343/673] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 12:13:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 12:13:57.636776 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8b6cc9-86ec-4777-b0be-7ef3328ccea9 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:57.703929 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 331/674] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 12:13:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 12:13:57.703929 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca441fc8-4bc7-440c-816d-2c58d8bd43d0 None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:57.763369 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8b6cc9-86ec-4777-b0be-7ef3328ccea9 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:57.771072 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:13:57.801018 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98fce66-df6e-40cb-91ff-875ef84d58e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:57.802355 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98fce66-df6e-40cb-91ff-875ef84d58e5 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:57.802633 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98fce66-df6e-40cb-91ff-875ef84d58e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:57.802901 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98fce66-df6e-40cb-91ff-875ef84d58e5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:57.809657 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98fce66-df6e-40cb-91ff-875ef84d58e5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:13:57.811128 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98fce66-df6e-40cb-91ff-875ef84d58e5 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:13:57.821364 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca441fc8-4bc7-440c-816d-2c58d8bd43d0 None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:57.825278 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-d98fce66-df6e-40cb-91ff-875ef84d58e5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 12:13:57.825278 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 12:13:57.825278 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 12:13:57.825278 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 12:13:57.825278 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 12:13:57.825278 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 12:13:57.825278 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 12:13:57.825278 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 12:13:57.825278 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 12:13:57.825278 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 12:13:57.825278 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 12:13:57.825278 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 12:13:57.825278 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 12:13:57.825278 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 12:13:57.825278 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 12:13:57.826126 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 12:13:57.826126 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 12:13:57.826126 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 12:13:57.826126 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 12:13:57.826126 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 12:13:57.826126 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 12:13:57.826126 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 12:13:57.826126 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 12:13:57.826126 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jun 16 12:13:57.826126 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 12:13:57.826126 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jun 16 12:13:57.826126 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 12:13:57.826126 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 12:13:57.826126 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 12:13:57.826126 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jun 16 12:13:57.826126 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 12:13:57.826126 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jun 16 12:13:57.827571 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 12:13:57.827571 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 12:13:57.827571 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 12:13:57.827571 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 12:13:57.827571 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 12:13:57.827571 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 12:13:57.827571 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 12:13:57.827571 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jun 16 12:13:57.827571 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 344/675] 10.222.0.44 () {56 vars in 1111 bytes} [Thu Jun 16 12:13:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 12:13:57.828091 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98fce66-df6e-40cb-91ff-875ef84d58e5 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:57.858062 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bdeb77-1bbd-4137-9351-82e5709aa87c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:57.858854 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bdeb77-1bbd-4137-9351-82e5709aa87c None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:57.859131 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bdeb77-1bbd-4137-9351-82e5709aa87c None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:57.859399 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bdeb77-1bbd-4137-9351-82e5709aa87c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:57.865910 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:13:57.866978 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bdeb77-1bbd-4137-9351-82e5709aa87c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:13:57.868301 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bdeb77-1bbd-4137-9351-82e5709aa87c None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:13:57.882179 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application [None req-28bdeb77-1bbd-4137-9351-82e5709aa87c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 12:13:57.882179 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 12:13:57.882179 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 12:13:57.882179 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 12:13:57.882179 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 12:13:57.882179 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 12:13:57.882179 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 12:13:57.882179 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 12:13:57.882179 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 12:13:57.882179 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 12:13:57.882179 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 12:13:57.882179 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 12:13:57.882179 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 12:13:57.882179 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 12:13:57.882179 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 12:13:57.883067 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 12:13:57.883067 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 12:13:57.883067 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 12:13:57.883067 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 12:13:57.883067 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 12:13:57.883067 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 12:13:57.883067 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 12:13:57.883067 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 12:13:57.883067 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application with Lock( Jun 16 12:13:57.883067 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 12:13:57.883067 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._enter() Jun 16 12:13:57.883067 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 12:13:57.883067 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 12:13:57.883067 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 12:13:57.883067 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.creator() Jun 16 12:13:57.883067 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 12:13:57.883067 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application created_value = creator( Jun 16 12:13:57.883959 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 12:13:57.883959 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 12:13:57.883959 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 12:13:57.883959 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 12:13:57.883959 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 12:13:57.883959 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 12:13:57.883959 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 12:13:57.883959 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application Jun 16 12:13:57.888009 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 332/676] 10.222.0.44 () {56 vars in 1111 bytes} [Thu Jun 16 12:13:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 12:13:57.888864 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bdeb77-1bbd-4137-9351-82e5709aa87c None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:57.944242 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98fce66-df6e-40cb-91ff-875ef84d58e5 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:57.979311 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3526b8d3-7bb6-42aa-bf7f-017ae0753a63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:57.980362 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3526b8d3-7bb6-42aa-bf7f-017ae0753a63 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:57.980812 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3526b8d3-7bb6-42aa-bf7f-017ae0753a63 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:57.981252 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3526b8d3-7bb6-42aa-bf7f-017ae0753a63 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:57.993039 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3526b8d3-7bb6-42aa-bf7f-017ae0753a63 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 12:13:57.997159 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bdeb77-1bbd-4137-9351-82e5709aa87c None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:58.002685 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-3526b8d3-7bb6-42aa-bf7f-017ae0753a63 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 12:13:58.002685 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 12:13:58.002685 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 12:13:58.002685 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 12:13:58.002685 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 12:13:58.002685 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 12:13:58.002685 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 12:13:58.002685 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 12:13:58.002685 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 12:13:58.002685 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 12:13:58.002685 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 12:13:58.002685 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 12:13:58.002685 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 12:13:58.002685 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 12:13:58.002685 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 12:13:58.002685 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 12:13:58.003810 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 12:13:58.003810 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 12:13:58.003810 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 12:13:58.003810 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 12:13:58.003810 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 12:13:58.003810 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 12:13:58.003810 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 12:13:58.003810 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 12:13:58.003810 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 12:13:58.003810 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 12:13:58.003810 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 12:13:58.003810 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jun 16 12:13:58.003810 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 12:13:58.003810 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jun 16 12:13:58.003810 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 12:13:58.003810 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 12:13:58.005434 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 12:13:58.005434 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jun 16 12:13:58.005434 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 12:13:58.005434 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jun 16 12:13:58.005434 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 12:13:58.005434 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 12:13:58.005434 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 12:13:58.005434 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 12:13:58.005434 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 12:13:58.005434 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 12:13:58.005434 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 12:13:58.005434 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jun 16 12:13:58.012086 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 345/677] 10.222.0.44 () {56 vars in 1096 bytes} [Thu Jun 16 12:13:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 12:13:58.012086 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3526b8d3-7bb6-42aa-bf7f-017ae0753a63 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:58.019517 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:13:58.039213 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de889501-50a9-470d-8ec6-e73bb08ec632 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:58.040009 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de889501-50a9-470d-8ec6-e73bb08ec632 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:58.040285 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de889501-50a9-470d-8ec6-e73bb08ec632 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:58.040725 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de889501-50a9-470d-8ec6-e73bb08ec632 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:58.051917 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de889501-50a9-470d-8ec6-e73bb08ec632 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 12:13:58.059629 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application [None req-de889501-50a9-470d-8ec6-e73bb08ec632 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 16 12:13:58.059629 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 12:13:58.059629 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 12:13:58.059629 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 12:13:58.059629 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 12:13:58.059629 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 12:13:58.059629 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 12:13:58.059629 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 12:13:58.059629 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 12:13:58.059629 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 12:13:58.059629 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 12:13:58.059629 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 12:13:58.059629 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 12:13:58.059629 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 12:13:58.059629 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 12:13:58.059629 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 12:13:58.060549 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 12:13:58.060549 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 12:13:58.060549 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 12:13:58.060549 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 12:13:58.060549 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 12:13:58.060549 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 12:13:58.060549 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 12:13:58.060549 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 12:13:58.060549 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 12:13:58.060549 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 12:13:58.060549 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 12:13:58.060549 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application with Lock( Jun 16 12:13:58.060549 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 12:13:58.060549 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._enter() Jun 16 12:13:58.060549 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 12:13:58.060549 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 12:13:58.061693 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 12:13:58.061693 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.creator() Jun 16 12:13:58.061693 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 12:13:58.061693 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application created_value = creator( Jun 16 12:13:58.061693 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 12:13:58.061693 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 12:13:58.061693 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 12:13:58.061693 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 12:13:58.061693 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 12:13:58.061693 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 12:13:58.061693 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 16 12:13:58.061693 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application Jun 16 12:13:58.061693 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 333/678] 10.222.0.44 () {56 vars in 1102 bytes} [Thu Jun 16 12:13:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 12:13:58.061693 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de889501-50a9-470d-8ec6-e73bb08ec632 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:58.115015 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:13:58.125930 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3526b8d3-7bb6-42aa-bf7f-017ae0753a63 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:58.160968 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25a0c46-1e12-4cda-932d-a622ac6d7fbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:58.162153 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25a0c46-1e12-4cda-932d-a622ac6d7fbc None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:58.162426 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25a0c46-1e12-4cda-932d-a622ac6d7fbc None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:58.162718 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25a0c46-1e12-4cda-932d-a622ac6d7fbc None admin] PATH_INFO: `/v3/projects` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:58.163489 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25a0c46-1e12-4cda-932d-a622ac6d7fbc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:13:58.163788 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25a0c46-1e12-4cda-932d-a622ac6d7fbc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:13:58.165317 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25a0c46-1e12-4cda-932d-a622ac6d7fbc None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:13:58.170353 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de889501-50a9-470d-8ec6-e73bb08ec632 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:58.182547 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 346/679] 10.222.0.44 () {56 vars in 1148 bytes} [Thu Jun 16 12:13:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:13:58.182547 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25a0c46-1e12-4cda-932d-a622ac6d7fbc None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:58.211576 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8928009a-66bf-4656-8601-42b62fe17215 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:58.212229 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8928009a-66bf-4656-8601-42b62fe17215 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:58.212508 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8928009a-66bf-4656-8601-42b62fe17215 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:58.212806 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8928009a-66bf-4656-8601-42b62fe17215 None admin] PATH_INFO: `/v3/projects` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:58.213590 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8928009a-66bf-4656-8601-42b62fe17215 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:13:58.213897 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8928009a-66bf-4656-8601-42b62fe17215 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:13:58.215576 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8928009a-66bf-4656-8601-42b62fe17215 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:13:58.233716 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 334/680] 10.222.0.44 () {56 vars in 1148 bytes} [Thu Jun 16 12:13:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:13:58.234604 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8928009a-66bf-4656-8601-42b62fe17215 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:58.269832 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:13:58.281051 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25a0c46-1e12-4cda-932d-a622ac6d7fbc None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:58.314634 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82fe0fc-d4bb-4013-a18c-391eba95da83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:58.315301 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82fe0fc-d4bb-4013-a18c-391eba95da83 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:58.315578 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82fe0fc-d4bb-4013-a18c-391eba95da83 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:58.315846 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82fe0fc-d4bb-4013-a18c-391eba95da83 None admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:58.316587 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82fe0fc-d4bb-4013-a18c-391eba95da83 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:13:58.316915 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82fe0fc-d4bb-4013-a18c-391eba95da83 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:13:58.318320 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82fe0fc-d4bb-4013-a18c-391eba95da83 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:13:58.326585 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 347/681] 10.222.0.44 () {56 vars in 1099 bytes} [Thu Jun 16 12:13:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:13:58.327376 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82fe0fc-d4bb-4013-a18c-391eba95da83 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:58.340861 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8928009a-66bf-4656-8601-42b62fe17215 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:58.348460 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:13:58.378388 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47a0a98-3177-4d3a-9e15-98cc6ec0562b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:58.379376 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47a0a98-3177-4d3a-9e15-98cc6ec0562b None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:58.379922 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47a0a98-3177-4d3a-9e15-98cc6ec0562b None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:58.380504 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47a0a98-3177-4d3a-9e15-98cc6ec0562b None admin] PATH_INFO: `/v3/roles` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:58.381355 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47a0a98-3177-4d3a-9e15-98cc6ec0562b None admin] RBAC: Adding query filter params (name=service) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:13:58.381664 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47a0a98-3177-4d3a-9e15-98cc6ec0562b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:13:58.383018 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47a0a98-3177-4d3a-9e15-98cc6ec0562b None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:13:58.392068 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 335/682] 10.222.0.44 () {56 vars in 1103 bytes} [Thu Jun 16 12:13:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:13:58.392780 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47a0a98-3177-4d3a-9e15-98cc6ec0562b None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:58.437344 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82fe0fc-d4bb-4013-a18c-391eba95da83 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:58.471853 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ee4587-76f9-46b3-bbd5-2bff377ab55b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:58.472501 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ee4587-76f9-46b3-bbd5-2bff377ab55b None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:58.472798 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ee4587-76f9-46b3-bbd5-2bff377ab55b None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:58.473075 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ee4587-76f9-46b3-bbd5-2bff377ab55b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:58.474505 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ee4587-76f9-46b3-bbd5-2bff377ab55b None admin] RBAC: Adding query filter params (role.id=a5c06bc21d39451285def24673456ff6, scope.project.id=601361df39e34fcca71175aa94e425c4, user.id=4f96fc14ed89478c8a8c2f11c87511e3) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:13:58.474808 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ee4587-76f9-46b3-bbd5-2bff377ab55b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:13:58.476231 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ee4587-76f9-46b3-bbd5-2bff377ab55b None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:13:58.482170 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 348/683] 10.222.0.44 () {56 vars in 1374 bytes} [Thu Jun 16 12:13:58 2022] GET /identity/v3/role_assignments?user.id=4f96fc14ed89478c8a8c2f11c87511e3&scope.project.id=601361df39e34fcca71175aa94e425c4&role.id=a5c06bc21d39451285def24673456ff6 => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:13:58.482936 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ee4587-76f9-46b3-bbd5-2bff377ab55b None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:58.509550 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:13:58.515012 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47a0a98-3177-4d3a-9e15-98cc6ec0562b None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:58.556943 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9292af-db6b-49cc-b6e8-c48cc1edaa94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:58.557727 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9292af-db6b-49cc-b6e8-c48cc1edaa94 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:58.558091 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9292af-db6b-49cc-b6e8-c48cc1edaa94 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:58.558463 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9292af-db6b-49cc-b6e8-c48cc1edaa94 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:58.559470 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9292af-db6b-49cc-b6e8-c48cc1edaa94 None admin] RBAC: Adding query filter params (role.id=a5c06bc21d39451285def24673456ff6, scope.project.id=601361df39e34fcca71175aa94e425c4, user.id=e1094729b25a4be7b0b394998c9ca681) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:13:58.559877 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9292af-db6b-49cc-b6e8-c48cc1edaa94 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:13:58.561626 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9292af-db6b-49cc-b6e8-c48cc1edaa94 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:13:58.580791 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 336/684] 10.222.0.44 () {56 vars in 1374 bytes} [Thu Jun 16 12:13:58 2022] GET /identity/v3/role_assignments?user.id=e1094729b25a4be7b0b394998c9ca681&scope.project.id=601361df39e34fcca71175aa94e425c4&role.id=a5c06bc21d39451285def24673456ff6 => generated 608 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:13:58.580791 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9292af-db6b-49cc-b6e8-c48cc1edaa94 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:58.623727 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:13:58.667380 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ee4587-76f9-46b3-bbd5-2bff377ab55b None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:58.712282 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b762ac6-67ed-4713-bd17-9c9124953d59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:58.713116 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b762ac6-67ed-4713-bd17-9c9124953d59 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:58.713394 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b762ac6-67ed-4713-bd17-9c9124953d59 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:58.713666 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b762ac6-67ed-4713-bd17-9c9124953d59 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:58.726932 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b762ac6-67ed-4713-bd17-9c9124953d59 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:13:58.728558 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b762ac6-67ed-4713-bd17-9c9124953d59 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:13:58.750645 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9292af-db6b-49cc-b6e8-c48cc1edaa94 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:58.753185 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-9b762ac6-67ed-4713-bd17-9c9124953d59 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 12:13:58.753185 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 12:13:58.753185 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 12:13:58.753185 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 12:13:58.753185 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 12:13:58.753185 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 12:13:58.753185 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 12:13:58.753185 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 12:13:58.753185 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 12:13:58.753185 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 12:13:58.753185 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 12:13:58.753185 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 12:13:58.753185 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 12:13:58.753185 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 12:13:58.753185 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 12:13:58.754221 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 12:13:58.754221 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 12:13:58.754221 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 12:13:58.754221 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 12:13:58.754221 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 12:13:58.754221 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 12:13:58.754221 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 12:13:58.754221 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 12:13:58.754221 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jun 16 12:13:58.754221 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 12:13:58.754221 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jun 16 12:13:58.754221 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 12:13:58.754221 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 12:13:58.754221 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 12:13:58.754221 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jun 16 12:13:58.754221 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 12:13:58.754221 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jun 16 12:13:58.755758 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 12:13:58.755758 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 12:13:58.755758 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 12:13:58.755758 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jun 16 12:13:58.758811 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 349/685] 10.222.0.44 () {56 vars in 1108 bytes} [Thu Jun 16 12:13:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 12:13:58.765976 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b762ac6-67ed-4713-bd17-9c9124953d59 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:58.804305 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9ad18f-c194-437c-97fc-9e3847729bf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:58.805222 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9ad18f-c194-437c-97fc-9e3847729bf9 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:58.805561 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9ad18f-c194-437c-97fc-9e3847729bf9 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:58.805931 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9ad18f-c194-437c-97fc-9e3847729bf9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:58.818264 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9ad18f-c194-437c-97fc-9e3847729bf9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:13:58.819886 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9ad18f-c194-437c-97fc-9e3847729bf9 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:13:58.842299 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application [None req-af9ad18f-c194-437c-97fc-9e3847729bf9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 12:13:58.842299 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 12:13:58.842299 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 12:13:58.842299 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 12:13:58.842299 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 12:13:58.842299 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 12:13:58.842299 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 12:13:58.842299 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 12:13:58.842299 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 12:13:58.842299 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 12:13:58.842299 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 12:13:58.842299 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 12:13:58.842299 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 12:13:58.842299 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 12:13:58.842299 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 12:13:58.843255 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 12:13:58.843255 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 12:13:58.843255 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 12:13:58.843255 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 12:13:58.843255 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 12:13:58.843255 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 12:13:58.843255 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 12:13:58.843255 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 12:13:58.843255 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application with Lock( Jun 16 12:13:58.843255 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 12:13:58.843255 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._enter() Jun 16 12:13:58.843255 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 12:13:58.843255 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 12:13:58.843255 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 12:13:58.843255 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.creator() Jun 16 12:13:58.843255 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 12:13:58.843255 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application created_value = creator( Jun 16 12:13:58.844114 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 12:13:58.844114 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 12:13:58.844114 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 12:13:58.844114 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application Jun 16 12:13:58.848885 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 337/686] 10.222.0.44 () {56 vars in 1108 bytes} [Thu Jun 16 12:13:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 12:13:58.850189 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9ad18f-c194-437c-97fc-9e3847729bf9 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:58.870396 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:13:58.924654 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b762ac6-67ed-4713-bd17-9c9124953d59 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:58.970170 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:13:58.976444 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79321a78-ac79-4b73-bb43-1a82b576fa29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:58.977303 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79321a78-ac79-4b73-bb43-1a82b576fa29 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:58.977303 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79321a78-ac79-4b73-bb43-1a82b576fa29 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:58.977471 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79321a78-ac79-4b73-bb43-1a82b576fa29 None admin] PATH_INFO: `/v3/domains` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:58.978305 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79321a78-ac79-4b73-bb43-1a82b576fa29 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:13:58.978645 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79321a78-ac79-4b73-bb43-1a82b576fa29 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:13:58.980086 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79321a78-ac79-4b73-bb43-1a82b576fa29 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:13:58.996224 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 350/687] 10.222.0.44 () {56 vars in 1109 bytes} [Thu Jun 16 12:13:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:13:58.999183 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9ad18f-c194-437c-97fc-9e3847729bf9 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:59.001056 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79321a78-ac79-4b73-bb43-1a82b576fa29 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:59.054370 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a737c88-b0ba-4615-9faf-48082fed1f25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:59.055315 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a737c88-b0ba-4615-9faf-48082fed1f25 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:59.055737 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a737c88-b0ba-4615-9faf-48082fed1f25 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:59.056138 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a737c88-b0ba-4615-9faf-48082fed1f25 None admin] PATH_INFO: `/v3/domains` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:59.057153 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a737c88-b0ba-4615-9faf-48082fed1f25 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:13:59.057603 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a737c88-b0ba-4615-9faf-48082fed1f25 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:13:59.059127 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a737c88-b0ba-4615-9faf-48082fed1f25 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:13:59.089274 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 338/688] 10.222.0.44 () {56 vars in 1109 bytes} [Thu Jun 16 12:13:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:13:59.096363 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a737c88-b0ba-4615-9faf-48082fed1f25 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:59.119457 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79321a78-ac79-4b73-bb43-1a82b576fa29 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:59.160798 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f8ec23-8865-491a-b0c9-d38dda606030 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:59.160798 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f8ec23-8865-491a-b0c9-d38dda606030 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:59.160798 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f8ec23-8865-491a-b0c9-d38dda606030 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:59.160798 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f8ec23-8865-491a-b0c9-d38dda606030 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:59.167495 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f8ec23-8865-491a-b0c9-d38dda606030 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:13:59.169802 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f8ec23-8865-491a-b0c9-d38dda606030 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:13:59.185472 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-c7f8ec23-8865-491a-b0c9-d38dda606030 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 16 12:13:59.185472 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 12:13:59.185472 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 12:13:59.185472 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 12:13:59.185472 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 12:13:59.185472 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 12:13:59.185472 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 12:13:59.185472 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 12:13:59.185472 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 12:13:59.185472 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 12:13:59.185472 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 12:13:59.185472 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 12:13:59.185472 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 12:13:59.185472 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 12:13:59.185472 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 12:13:59.185472 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 12:13:59.186616 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 12:13:59.186616 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 12:13:59.186616 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 12:13:59.186616 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 12:13:59.186616 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 12:13:59.186616 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 12:13:59.186616 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 12:13:59.186616 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 12:13:59.186616 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 12:13:59.186616 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 12:13:59.186616 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 12:13:59.186616 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jun 16 12:13:59.186616 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 12:13:59.186616 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jun 16 12:13:59.186616 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 12:13:59.186616 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 12:13:59.186616 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 12:13:59.186616 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jun 16 12:13:59.187752 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 12:13:59.187752 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jun 16 12:13:59.187752 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 12:13:59.187752 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 12:13:59.187752 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 12:13:59.187752 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 12:13:59.187752 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 12:13:59.187752 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 12:13:59.187752 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 16 12:13:59.187752 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jun 16 12:13:59.189595 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 351/689] 10.222.0.44 () {56 vars in 1093 bytes} [Thu Jun 16 12:13:59 2022] GET /identity/v3/users/nova => generated 82 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 12:13:59.196773 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f8ec23-8865-491a-b0c9-d38dda606030 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:59.235250 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:13:59.251253 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:13:59.299814 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f8ec23-8865-491a-b0c9-d38dda606030 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:59.310737 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a737c88-b0ba-4615-9faf-48082fed1f25 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:59.351904 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70f6ab1-5010-45bb-a840-fab9a48fc1f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:59.353017 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70f6ab1-5010-45bb-a840-fab9a48fc1f1 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:59.353499 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70f6ab1-5010-45bb-a840-fab9a48fc1f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:59.353994 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70f6ab1-5010-45bb-a840-fab9a48fc1f1 None admin] PATH_INFO: `/v3/users` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:59.355033 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70f6ab1-5010-45bb-a840-fab9a48fc1f1 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:13:59.356240 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70f6ab1-5010-45bb-a840-fab9a48fc1f1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:13:59.358103 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70f6ab1-5010-45bb-a840-fab9a48fc1f1 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:13:59.378003 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd2b85a-e7c2-4037-b0c5-c0f86bbeaf64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:59.379173 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd2b85a-e7c2-4037-b0c5-c0f86bbeaf64 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:59.379712 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd2b85a-e7c2-4037-b0c5-c0f86bbeaf64 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:59.381192 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd2b85a-e7c2-4037-b0c5-c0f86bbeaf64 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:59.391144 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 352/690] 10.222.0.44 () {56 vars in 1133 bytes} [Thu Jun 16 12:13:59 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:13:59.400805 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd2b85a-e7c2-4037-b0c5-c0f86bbeaf64 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:13:59.400805 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd2b85a-e7c2-4037-b0c5-c0f86bbeaf64 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:13:59.402191 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70f6ab1-5010-45bb-a840-fab9a48fc1f1 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:59.416745 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application [None req-2cd2b85a-e7c2-4037-b0c5-c0f86bbeaf64 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 16 12:13:59.416745 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 12:13:59.416745 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 12:13:59.416745 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 12:13:59.416745 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 12:13:59.416745 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 12:13:59.416745 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 12:13:59.416745 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 12:13:59.416745 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 12:13:59.416745 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 12:13:59.416745 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 12:13:59.416745 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 12:13:59.416745 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 12:13:59.416745 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 12:13:59.416745 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 12:13:59.416745 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 12:13:59.417999 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 12:13:59.417999 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 12:13:59.417999 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 12:13:59.417999 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 12:13:59.417999 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 12:13:59.417999 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 12:13:59.417999 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 12:13:59.417999 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 12:13:59.417999 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 12:13:59.417999 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 12:13:59.417999 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 12:13:59.417999 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application with Lock( Jun 16 12:13:59.417999 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 12:13:59.417999 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._enter() Jun 16 12:13:59.417999 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 12:13:59.417999 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 12:13:59.417999 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 12:13:59.417999 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.creator() Jun 16 12:13:59.419531 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 12:13:59.419531 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application created_value = creator( Jun 16 12:13:59.419531 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 12:13:59.419531 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 12:13:59.419531 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 12:13:59.419531 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 12:13:59.419531 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 12:13:59.419531 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 12:13:59.419531 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 16 12:13:59.419531 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application Jun 16 12:13:59.419531 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 339/691] 10.222.0.44 () {56 vars in 1096 bytes} [Thu Jun 16 12:13:59 2022] GET /identity/v3/users/swift => generated 83 bytes in 322 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 12:13:59.429562 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd2b85a-e7c2-4037-b0c5-c0f86bbeaf64 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:59.530050 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70f6ab1-5010-45bb-a840-fab9a48fc1f1 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:59.549077 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:13:59.595465 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc70819c-ffc1-412a-b9b4-2dc30bada71c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:59.596122 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc70819c-ffc1-412a-b9b4-2dc30bada71c None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:59.596400 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc70819c-ffc1-412a-b9b4-2dc30bada71c None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:59.596672 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc70819c-ffc1-412a-b9b4-2dc30bada71c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:59.621192 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd2b85a-e7c2-4037-b0c5-c0f86bbeaf64 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:59.689163 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7af1cf-6f0c-4f22-9814-053a3a08ba1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:59.689833 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7af1cf-6f0c-4f22-9814-053a3a08ba1c None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:59.690113 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7af1cf-6f0c-4f22-9814-053a3a08ba1c None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:59.690388 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7af1cf-6f0c-4f22-9814-053a3a08ba1c None admin] PATH_INFO: `/v3/users` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:59.691229 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7af1cf-6f0c-4f22-9814-053a3a08ba1c None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:13:59.691541 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7af1cf-6f0c-4f22-9814-053a3a08ba1c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:13:59.694487 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7af1cf-6f0c-4f22-9814-053a3a08ba1c None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:13:59.700519 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:13:59.725627 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 340/692] 10.222.0.44 () {56 vars in 1135 bytes} [Thu Jun 16 12:13:59 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 12:13:59.731600 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7af1cf-6f0c-4f22-9814-053a3a08ba1c None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:59.743637 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc70819c-ffc1-412a-b9b4-2dc30bada71c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:13:59.745564 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc70819c-ffc1-412a-b9b4-2dc30bada71c None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:13:59.887300 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 353/693] 10.222.0.44 () {58 vars in 1282 bytes} [Thu Jun 16 12:13:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 485 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 12:13:59.888827 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7af1cf-6f0c-4f22-9814-053a3a08ba1c None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:13:59.889272 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510e1e43-bbac-42d7-85bf-29c57f46fa6f None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:59.889749 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510e1e43-bbac-42d7-85bf-29c57f46fa6f None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:59.890214 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510e1e43-bbac-42d7-85bf-29c57f46fa6f None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:13:59.896292 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 354/694] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 12:13:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 12:13:59.897527 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510e1e43-bbac-42d7-85bf-29c57f46fa6f None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:13:59.914125 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:13:59.927284 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30d708a-2845-4160-8ab4-29bc40cd5e44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:13:59.928031 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30d708a-2845-4160-8ab4-29bc40cd5e44 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:13:59.928408 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30d708a-2845-4160-8ab4-29bc40cd5e44 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:13:59.928786 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30d708a-2845-4160-8ab4-29bc40cd5e44 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:00.008050 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30d708a-2845-4160-8ab4-29bc40cd5e44 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:14:00.012793 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30d708a-2845-4160-8ab4-29bc40cd5e44 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:14:00.012793 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:14:00.040212 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510e1e43-bbac-42d7-85bf-29c57f46fa6f None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:14:00.076955 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb9b0f9-8493-44e1-94b4-4b878c919e47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:14:00.078068 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb9b0f9-8493-44e1-94b4-4b878c919e47 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:00.078549 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb9b0f9-8493-44e1-94b4-4b878c919e47 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:00.079038 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb9b0f9-8493-44e1-94b4-4b878c919e47 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:00.089995 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb9b0f9-8493-44e1-94b4-4b878c919e47 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:14:00.091723 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb9b0f9-8493-44e1-94b4-4b878c919e47 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:14:00.110279 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-beb9b0f9-8493-44e1-94b4-4b878c919e47 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 12:14:00.110279 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 12:14:00.110279 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 12:14:00.110279 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 12:14:00.110279 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 12:14:00.110279 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 12:14:00.110279 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 12:14:00.110279 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 12:14:00.110279 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 12:14:00.110279 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 12:14:00.110279 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 12:14:00.110279 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 12:14:00.110279 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 12:14:00.110279 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 12:14:00.110279 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 12:14:00.111158 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 12:14:00.111158 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 12:14:00.111158 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 12:14:00.111158 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 12:14:00.111158 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 12:14:00.111158 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 12:14:00.111158 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 12:14:00.111158 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 12:14:00.111158 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jun 16 12:14:00.111158 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 12:14:00.111158 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jun 16 12:14:00.111158 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 12:14:00.111158 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 12:14:00.111158 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 12:14:00.111158 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jun 16 12:14:00.111158 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 12:14:00.111158 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jun 16 12:14:00.112043 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 12:14:00.112043 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 12:14:00.112043 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 12:14:00.112043 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jun 16 12:14:00.114830 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 355/695] 10.222.0.44 () {56 vars in 1108 bytes} [Thu Jun 16 12:13:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 12:14:00.116283 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1bd219-a337-4410-957d-9f091a2b18c2 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:00.116793 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1bd219-a337-4410-957d-9f091a2b18c2 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:00.117264 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1bd219-a337-4410-957d-9f091a2b18c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:00.134255 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-3c1bd219-a337-4410-957d-9f091a2b18c2 None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:14:00.135673 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-3c1bd219-a337-4410-957d-9f091a2b18c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:14:00.137536 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 341/696] 10.222.0.44 () {58 vars in 1282 bytes} [Thu Jun 16 12:13:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 16 12:14:00.138610 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30d708a-2845-4160-8ab4-29bc40cd5e44 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:14:00.199848 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:14:00.214455 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 356/697] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 12:14:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 12:14:00.220916 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1bd219-a337-4410-957d-9f091a2b18c2 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:14:00.270056 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:14:00.281173 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30d708a-2845-4160-8ab4-29bc40cd5e44 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:14:00.319785 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005bef1d-68ae-4791-a0d3-546e9b3c0436 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:14:00.320540 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005bef1d-68ae-4791-a0d3-546e9b3c0436 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:00.320837 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005bef1d-68ae-4791-a0d3-546e9b3c0436 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:00.321110 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005bef1d-68ae-4791-a0d3-546e9b3c0436 None admin] PATH_INFO: `/v3/domains` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:00.321823 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005bef1d-68ae-4791-a0d3-546e9b3c0436 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:14:00.322123 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005bef1d-68ae-4791-a0d3-546e9b3c0436 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:14:00.323479 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005bef1d-68ae-4791-a0d3-546e9b3c0436 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:14:00.339533 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 342/698] 10.222.0.44 () {56 vars in 1109 bytes} [Thu Jun 16 12:14:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:14:00.340420 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005bef1d-68ae-4791-a0d3-546e9b3c0436 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:14:00.367334 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1bd219-a337-4410-957d-9f091a2b18c2 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:14:00.415468 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad777e36-53f8-4d64-a500-ad417c196458 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:14:00.416347 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad777e36-53f8-4d64-a500-ad417c196458 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:00.416724 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad777e36-53f8-4d64-a500-ad417c196458 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:00.417121 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad777e36-53f8-4d64-a500-ad417c196458 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:00.433348 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad777e36-53f8-4d64-a500-ad417c196458 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:14:00.435494 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad777e36-53f8-4d64-a500-ad417c196458 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:14:00.451251 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005bef1d-68ae-4791-a0d3-546e9b3c0436 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:14:00.459758 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-ad777e36-53f8-4d64-a500-ad417c196458 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 12:14:00.459758 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 12:14:00.459758 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 12:14:00.459758 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 12:14:00.459758 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 12:14:00.459758 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 12:14:00.459758 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 12:14:00.459758 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 12:14:00.459758 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 12:14:00.459758 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 12:14:00.459758 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 12:14:00.459758 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 12:14:00.459758 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 12:14:00.459758 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 12:14:00.459758 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 12:14:00.460776 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 12:14:00.460776 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 12:14:00.460776 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 12:14:00.460776 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 12:14:00.460776 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 12:14:00.460776 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 12:14:00.460776 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 12:14:00.460776 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 12:14:00.460776 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jun 16 12:14:00.460776 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 12:14:00.460776 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jun 16 12:14:00.460776 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 12:14:00.460776 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 12:14:00.460776 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 12:14:00.460776 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jun 16 12:14:00.460776 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 12:14:00.460776 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jun 16 12:14:00.461749 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 12:14:00.461749 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 12:14:00.461749 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 12:14:00.461749 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jun 16 12:14:00.462983 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 357/699] 10.222.0.44 () {56 vars in 1108 bytes} [Thu Jun 16 12:14:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 12:14:00.463952 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad777e36-53f8-4d64-a500-ad417c196458 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:14:00.496209 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5193e84a-3356-42a9-aac0-1ebc796e35ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:14:00.497176 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5193e84a-3356-42a9-aac0-1ebc796e35ab None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:00.497457 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5193e84a-3356-42a9-aac0-1ebc796e35ab None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:00.497728 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5193e84a-3356-42a9-aac0-1ebc796e35ab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:00.509917 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5193e84a-3356-42a9-aac0-1ebc796e35ab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:14:00.511410 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5193e84a-3356-42a9-aac0-1ebc796e35ab None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:14:00.516204 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:14:00.532960 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application [None req-5193e84a-3356-42a9-aac0-1ebc796e35ab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 12:14:00.532960 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 12:14:00.532960 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 12:14:00.532960 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 12:14:00.532960 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 12:14:00.532960 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 12:14:00.532960 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 12:14:00.532960 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 12:14:00.532960 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 12:14:00.532960 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 12:14:00.532960 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 12:14:00.532960 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 12:14:00.532960 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 12:14:00.532960 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 12:14:00.532960 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 12:14:00.533934 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 12:14:00.533934 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 12:14:00.533934 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 12:14:00.533934 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 12:14:00.533934 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 12:14:00.533934 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 12:14:00.533934 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 12:14:00.533934 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 12:14:00.533934 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application with Lock( Jun 16 12:14:00.533934 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 12:14:00.533934 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._enter() Jun 16 12:14:00.533934 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 12:14:00.533934 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 12:14:00.533934 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 12:14:00.533934 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.creator() Jun 16 12:14:00.533934 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 12:14:00.533934 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application created_value = creator( Jun 16 12:14:00.534835 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 12:14:00.534835 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 12:14:00.534835 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 12:14:00.534835 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application Jun 16 12:14:00.536856 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 343/700] 10.222.0.44 () {56 vars in 1108 bytes} [Thu Jun 16 12:14:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 12:14:00.537685 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5193e84a-3356-42a9-aac0-1ebc796e35ab None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:14:00.542212 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:14:00.596057 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad777e36-53f8-4d64-a500-ad417c196458 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:14:00.633363 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f905dd1e-be78-49f9-a14d-59c62832acf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:14:00.634155 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f905dd1e-be78-49f9-a14d-59c62832acf1 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:00.634430 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f905dd1e-be78-49f9-a14d-59c62832acf1 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:00.634696 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f905dd1e-be78-49f9-a14d-59c62832acf1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:00.643656 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f905dd1e-be78-49f9-a14d-59c62832acf1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:14:00.646737 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f905dd1e-be78-49f9-a14d-59c62832acf1 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:14:00.648125 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5193e84a-3356-42a9-aac0-1ebc796e35ab None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:14:00.665644 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-f905dd1e-be78-49f9-a14d-59c62832acf1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 12:14:00.665644 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 12:14:00.665644 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 12:14:00.665644 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 12:14:00.665644 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 12:14:00.665644 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 12:14:00.665644 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 12:14:00.665644 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 12:14:00.665644 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 12:14:00.665644 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 12:14:00.665644 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 12:14:00.665644 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 12:14:00.665644 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 12:14:00.665644 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 12:14:00.665644 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 12:14:00.666541 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 12:14:00.666541 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 12:14:00.666541 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 12:14:00.666541 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 12:14:00.666541 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 12:14:00.666541 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 12:14:00.666541 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 12:14:00.666541 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 12:14:00.666541 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jun 16 12:14:00.666541 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 12:14:00.666541 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jun 16 12:14:00.666541 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 12:14:00.666541 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 12:14:00.666541 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 12:14:00.666541 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jun 16 12:14:00.666541 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 12:14:00.666541 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jun 16 12:14:00.667417 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 12:14:00.667417 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 12:14:00.667417 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 12:14:00.667417 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 12:14:00.667417 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 12:14:00.667417 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 12:14:00.667417 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 12:14:00.667417 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jun 16 12:14:00.672532 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 358/701] 10.222.0.44 () {56 vars in 1111 bytes} [Thu Jun 16 12:14:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 12:14:00.672532 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f905dd1e-be78-49f9-a14d-59c62832acf1 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:14:00.686234 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33302669-0c57-42a9-b486-c1e9da07b1a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:14:00.686899 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33302669-0c57-42a9-b486-c1e9da07b1a5 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:00.687178 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33302669-0c57-42a9-b486-c1e9da07b1a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:00.687451 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33302669-0c57-42a9-b486-c1e9da07b1a5 None admin] PATH_INFO: `/v3/domains` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:00.688172 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33302669-0c57-42a9-b486-c1e9da07b1a5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:14:00.688475 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33302669-0c57-42a9-b486-c1e9da07b1a5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:14:00.689868 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33302669-0c57-42a9-b486-c1e9da07b1a5 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:14:00.703770 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 344/702] 10.222.0.44 () {56 vars in 1109 bytes} [Thu Jun 16 12:14:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:14:00.704607 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33302669-0c57-42a9-b486-c1e9da07b1a5 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:14:00.788002 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f905dd1e-be78-49f9-a14d-59c62832acf1 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:14:00.791996 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:14:00.794644 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:14:00.829056 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac7c5c5-78e8-4752-9b8d-66f46da7f5ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:14:00.830046 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac7c5c5-78e8-4752-9b8d-66f46da7f5ed None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:00.830399 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac7c5c5-78e8-4752-9b8d-66f46da7f5ed None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:00.830742 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac7c5c5-78e8-4752-9b8d-66f46da7f5ed None admin] PATH_INFO: `/v3/domains` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:00.831565 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac7c5c5-78e8-4752-9b8d-66f46da7f5ed None admin] RBAC: Adding query filter params (name=Default) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:14:00.831968 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac7c5c5-78e8-4752-9b8d-66f46da7f5ed None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:14:00.834117 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac7c5c5-78e8-4752-9b8d-66f46da7f5ed None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:14:00.849320 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 359/703] 10.222.0.44 () {56 vars in 1109 bytes} [Thu Jun 16 12:14:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:14:00.850346 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac7c5c5-78e8-4752-9b8d-66f46da7f5ed None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:14:00.850719 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33302669-0c57-42a9-b486-c1e9da07b1a5 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:14:00.898317 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a7e335-85d5-404e-9f0f-6ed594a49a81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:14:00.899343 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a7e335-85d5-404e-9f0f-6ed594a49a81 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:00.900246 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a7e335-85d5-404e-9f0f-6ed594a49a81 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:00.900714 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a7e335-85d5-404e-9f0f-6ed594a49a81 None admin] PATH_INFO: `/v3/projects` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:00.902104 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a7e335-85d5-404e-9f0f-6ed594a49a81 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:14:00.902885 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a7e335-85d5-404e-9f0f-6ed594a49a81 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:14:00.904810 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a7e335-85d5-404e-9f0f-6ed594a49a81 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:14:00.925149 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 345/704] 10.222.0.44 () {56 vars in 1148 bytes} [Thu Jun 16 12:14:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:14:00.926133 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a7e335-85d5-404e-9f0f-6ed594a49a81 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:14:00.967389 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac7c5c5-78e8-4752-9b8d-66f46da7f5ed None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:14:01.001579 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2f8811-6126-4b5f-8d59-cd16ddd0421d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:14:01.002363 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2f8811-6126-4b5f-8d59-cd16ddd0421d None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:01.002640 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2f8811-6126-4b5f-8d59-cd16ddd0421d None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:01.002908 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2f8811-6126-4b5f-8d59-cd16ddd0421d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:01.010010 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2f8811-6126-4b5f-8d59-cd16ddd0421d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:14:01.011451 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2f8811-6126-4b5f-8d59-cd16ddd0421d None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:14:01.025158 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-fa2f8811-6126-4b5f-8d59-cd16ddd0421d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 12:14:01.025158 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 12:14:01.025158 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 12:14:01.025158 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 12:14:01.025158 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 12:14:01.025158 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 12:14:01.025158 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 12:14:01.025158 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 12:14:01.025158 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 12:14:01.025158 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 12:14:01.025158 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 12:14:01.025158 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 12:14:01.025158 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 12:14:01.025158 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 12:14:01.025158 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 12:14:01.026072 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 12:14:01.026072 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 12:14:01.026072 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 12:14:01.026072 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 12:14:01.026072 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 12:14:01.026072 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 12:14:01.026072 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 12:14:01.026072 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 12:14:01.026072 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jun 16 12:14:01.026072 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 12:14:01.026072 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jun 16 12:14:01.026072 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 12:14:01.026072 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 12:14:01.026072 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 12:14:01.026072 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jun 16 12:14:01.026072 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 12:14:01.026072 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jun 16 12:14:01.026979 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 12:14:01.026979 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 12:14:01.026979 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 12:14:01.026979 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 12:14:01.026979 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 12:14:01.026979 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 12:14:01.026979 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 12:14:01.026979 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jun 16 12:14:01.026979 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 360/705] 10.222.0.44 () {56 vars in 1111 bytes} [Thu Jun 16 12:14:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 12:14:01.028027 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2713b06f-dc49-4f65-bbba-fe48325e44ff None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:01.028027 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2713b06f-dc49-4f65-bbba-fe48325e44ff None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:01.028027 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2713b06f-dc49-4f65-bbba-fe48325e44ff None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:01.032889 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 361/706] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 12:14:01 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 12:14:01.032889 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2713b06f-dc49-4f65-bbba-fe48325e44ff None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:14:01.035938 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a7e335-85d5-404e-9f0f-6ed594a49a81 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:14:01.059595 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:14:01.064830 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:14:01.077231 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afc325d-5f9d-430a-b676-e1429dfdc87f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:14:01.077900 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afc325d-5f9d-430a-b676-e1429dfdc87f None admin] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:01.078177 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afc325d-5f9d-430a-b676-e1429dfdc87f None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:01.078813 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afc325d-5f9d-430a-b676-e1429dfdc87f None admin] PATH_INFO: `/v3/users` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:01.079537 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afc325d-5f9d-430a-b676-e1429dfdc87f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:14:01.081500 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afc325d-5f9d-430a-b676-e1429dfdc87f None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:14:01.108959 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 346/707] 10.222.0.44 () {60 vars in 1132 bytes} [Thu Jun 16 12:14:00 2022] POST /identity/v3/users => generated 254 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 12:14:01.111224 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afc325d-5f9d-430a-b676-e1429dfdc87f None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:14:01.150913 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2713b06f-dc49-4f65-bbba-fe48325e44ff None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:14:01.190599 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab4985e-aea8-40d3-a6ee-80fbc09cd516 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:14:01.191295 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab4985e-aea8-40d3-a6ee-80fbc09cd516 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:01.191580 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab4985e-aea8-40d3-a6ee-80fbc09cd516 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:01.191942 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab4985e-aea8-40d3-a6ee-80fbc09cd516 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:01.193323 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab4985e-aea8-40d3-a6ee-80fbc09cd516 None admin] RBAC: Adding query filter params (role.id=0688968254744e3f9913653cafea3091, scope.project.id=601361df39e34fcca71175aa94e425c4, user.id=edfb12d445e74136b90800e93941f468) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:14:01.193638 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab4985e-aea8-40d3-a6ee-80fbc09cd516 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:14:01.195171 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab4985e-aea8-40d3-a6ee-80fbc09cd516 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:14:01.208168 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 362/708] 10.222.0.44 () {56 vars in 1374 bytes} [Thu Jun 16 12:14:01 2022] GET /identity/v3/role_assignments?user.id=edfb12d445e74136b90800e93941f468&scope.project.id=601361df39e34fcca71175aa94e425c4&role.id=0688968254744e3f9913653cafea3091 => generated 259 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:14:01.209701 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071aaa5e-b899-4531-aec6-169380f2d3db None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:01.209991 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071aaa5e-b899-4531-aec6-169380f2d3db None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:01.210299 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071aaa5e-b899-4531-aec6-169380f2d3db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:01.238089 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afc325d-5f9d-430a-b676-e1429dfdc87f None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:14:01.246075 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-071aaa5e-b899-4531-aec6-169380f2d3db None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:14:01.247472 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-071aaa5e-b899-4531-aec6-169380f2d3db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:14:01.308218 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174aac47-0d8a-4b80-a0ae-7bc80080ae8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:14:01.309362 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174aac47-0d8a-4b80-a0ae-7bc80080ae8d None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:01.310082 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174aac47-0d8a-4b80-a0ae-7bc80080ae8d None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:01.310561 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174aac47-0d8a-4b80-a0ae-7bc80080ae8d None admin] PATH_INFO: `/v3/projects` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:01.312342 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174aac47-0d8a-4b80-a0ae-7bc80080ae8d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:14:01.313260 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174aac47-0d8a-4b80-a0ae-7bc80080ae8d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:14:01.315831 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174aac47-0d8a-4b80-a0ae-7bc80080ae8d None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:14:01.332839 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 347/709] 10.222.0.44 () {56 vars in 1148 bytes} [Thu Jun 16 12:14:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:14:01.333338 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c412d346-d80d-40c0-ac29-97a4d9fa6429 None None] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:01.333625 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c412d346-d80d-40c0-ac29-97a4d9fa6429 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:01.333897 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c412d346-d80d-40c0-ac29-97a4d9fa6429 None None] PATH_INFO: `/` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:01.335402 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 348/710] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 12:14:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 12:14:01.340347 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c412d346-d80d-40c0-ac29-97a4d9fa6429 None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:14:01.342317 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 363/711] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 12:14:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 12:14:01.343862 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bf052d-9b43-4e76-a050-6a848f1c0806 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:01.344317 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bf052d-9b43-4e76-a050-6a848f1c0806 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:01.344658 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bf052d-9b43-4e76-a050-6a848f1c0806 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:01.363667 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-d5bf052d-9b43-4e76-a050-6a848f1c0806 None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:14:01.365703 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-d5bf052d-9b43-4e76-a050-6a848f1c0806 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:14:01.385234 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:14:01.392959 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:14:01.470283 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c412d346-d80d-40c0-ac29-97a4d9fa6429 None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:14:01.478266 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 364/712] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 12:14:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 12:14:01.479241 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bf052d-9b43-4e76-a050-6a848f1c0806 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:14:01.515579 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9893e5b6-6e23-4727-a3e8-9f2e88b0f26f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:14:01.516677 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9893e5b6-6e23-4727-a3e8-9f2e88b0f26f None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:01.517027 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9893e5b6-6e23-4727-a3e8-9f2e88b0f26f None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:01.517302 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9893e5b6-6e23-4727-a3e8-9f2e88b0f26f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:01.518196 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9893e5b6-6e23-4727-a3e8-9f2e88b0f26f None admin] RBAC: Adding query filter params (role.id=a5c06bc21d39451285def24673456ff6, scope.project.id=601361df39e34fcca71175aa94e425c4, user.id=c159f79c1921496487101aac5d530ae5) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:14:01.518507 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9893e5b6-6e23-4727-a3e8-9f2e88b0f26f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:14:01.520315 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9893e5b6-6e23-4727-a3e8-9f2e88b0f26f None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:14:01.527654 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 349/713] 10.222.0.44 () {56 vars in 1374 bytes} [Thu Jun 16 12:14:01 2022] GET /identity/v3/role_assignments?user.id=c159f79c1921496487101aac5d530ae5&scope.project.id=601361df39e34fcca71175aa94e425c4&role.id=a5c06bc21d39451285def24673456ff6 => generated 608 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:14:01.528481 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9893e5b6-6e23-4727-a3e8-9f2e88b0f26f None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:14:01.681632 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bf052d-9b43-4e76-a050-6a848f1c0806 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:14:01.747424 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9893e5b6-6e23-4727-a3e8-9f2e88b0f26f None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:14:01.753186 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:14:01.754074 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9143778c-11ca-4645-b7ad-77343d63c2ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:14:01.755721 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9143778c-11ca-4645-b7ad-77343d63c2ad None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:01.756158 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9143778c-11ca-4645-b7ad-77343d63c2ad None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:01.756571 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9143778c-11ca-4645-b7ad-77343d63c2ad None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:01.757457 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9143778c-11ca-4645-b7ad-77343d63c2ad None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:14:01.759004 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9143778c-11ca-4645-b7ad-77343d63c2ad None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:14:01.778929 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-9143778c-11ca-4645-b7ad-77343d63c2ad None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 16 12:14:01.778929 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 12:14:01.778929 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 12:14:01.778929 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 12:14:01.778929 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 12:14:01.778929 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 12:14:01.778929 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 12:14:01.778929 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 12:14:01.778929 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 16 12:14:01.778929 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jun 16 12:14:01.778929 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 12:14:01.778929 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jun 16 12:14:01.778929 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 12:14:01.778929 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 12:14:01.778929 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 12:14:01.778929 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 12:14:01.780005 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 12:14:01.780005 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 12:14:01.780005 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 12:14:01.780005 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 12:14:01.780005 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 12:14:01.780005 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 12:14:01.780005 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 12:14:01.780005 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 12:14:01.780005 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 12:14:01.780005 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 12:14:01.780005 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 12:14:01.780005 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 12:14:01.780005 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 12:14:01.780005 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 12:14:01.780005 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 12:14:01.780005 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 12:14:01.780870 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 12:14:01.780870 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 12:14:01.780870 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jun 16 12:14:01.780870 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 12:14:01.780870 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jun 16 12:14:01.780870 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 12:14:01.780870 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 12:14:01.780870 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 12:14:01.780870 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jun 16 12:14:01.780870 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 12:14:01.780870 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jun 16 12:14:01.780870 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 12:14:01.780870 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 12:14:01.780870 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 16 12:14:01.780870 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jun 16 12:14:01.784344 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 365/714] 10.222.0.44 () {56 vars in 1129 bytes} [Thu Jun 16 12:14:01 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 12:14:01.788711 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9143778c-11ca-4645-b7ad-77343d63c2ad None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:14:01.807872 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:14:01.810014 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c6e521-3f0e-4f62-845f-792a8f9cc4c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:14:01.811624 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c6e521-3f0e-4f62-845f-792a8f9cc4c5 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:01.811910 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c6e521-3f0e-4f62-845f-792a8f9cc4c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:01.812180 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c6e521-3f0e-4f62-845f-792a8f9cc4c5 None admin] PATH_INFO: `/v3/services/network` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:01.813241 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c6e521-3f0e-4f62-845f-792a8f9cc4c5 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:14:01.814770 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c6e521-3f0e-4f62-845f-792a8f9cc4c5 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:14:01.834415 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application [None req-f2c6e521-3f0e-4f62-845f-792a8f9cc4c5 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 16 12:14:01.834415 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 12:14:01.834415 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 12:14:01.834415 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 12:14:01.834415 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 12:14:01.834415 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 12:14:01.834415 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 12:14:01.834415 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 12:14:01.834415 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 16 12:14:01.834415 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application Jun 16 12:14:01.834415 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 12:14:01.834415 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application Jun 16 12:14:01.834415 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 12:14:01.834415 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 12:14:01.834415 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 12:14:01.834415 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 12:14:01.834415 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 12:14:01.835464 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 12:14:01.835464 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 12:14:01.835464 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 12:14:01.835464 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 12:14:01.835464 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 12:14:01.835464 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 12:14:01.835464 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 12:14:01.835464 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 12:14:01.835464 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 12:14:01.835464 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 12:14:01.835464 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 12:14:01.835464 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 12:14:01.835464 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 12:14:01.835464 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 12:14:01.835464 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 12:14:01.835464 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 12:14:01.836279 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 12:14:01.836279 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application with Lock( Jun 16 12:14:01.836279 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 12:14:01.836279 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._enter() Jun 16 12:14:01.836279 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 12:14:01.836279 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 12:14:01.836279 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 12:14:01.836279 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.creator() Jun 16 12:14:01.836279 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 12:14:01.836279 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application created_value = creator( Jun 16 12:14:01.836279 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 12:14:01.836279 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 12:14:01.836279 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 16 12:14:01.836279 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application Jun 16 12:14:01.837238 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 350/715] 10.222.0.44 () {56 vars in 1111 bytes} [Thu Jun 16 12:14:01 2022] GET /identity/v3/services/network => generated 88 bytes in 308 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 12:14:01.845759 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c6e521-3f0e-4f62-845f-792a8f9cc4c5 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:14:01.931544 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9143778c-11ca-4645-b7ad-77343d63c2ad None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:14:01.978413 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b9e86b-5bde-49f7-88bc-ace40a58319f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:14:01.979201 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b9e86b-5bde-49f7-88bc-ace40a58319f None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:01.979485 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b9e86b-5bde-49f7-88bc-ace40a58319f None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:01.979762 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b9e86b-5bde-49f7-88bc-ace40a58319f None admin] PATH_INFO: `/v3/services` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:01.980737 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b9e86b-5bde-49f7-88bc-ace40a58319f None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:14:01.981098 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b9e86b-5bde-49f7-88bc-ace40a58319f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:14:01.983124 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b9e86b-5bde-49f7-88bc-ace40a58319f None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:14:01.984407 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c6e521-3f0e-4f62-845f-792a8f9cc4c5 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:14:01.989454 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 366/716] 10.222.0.44 () {56 vars in 1124 bytes} [Thu Jun 16 12:14:01 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:14:01.995035 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b9e86b-5bde-49f7-88bc-ace40a58319f None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:14:02.024789 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0958c91-1c79-4841-80a7-e868245ba080 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:14:02.025389 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0958c91-1c79-4841-80a7-e868245ba080 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:02.025719 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0958c91-1c79-4841-80a7-e868245ba080 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:02.025992 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0958c91-1c79-4841-80a7-e868245ba080 None admin] PATH_INFO: `/v3/services` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:02.026703 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0958c91-1c79-4841-80a7-e868245ba080 None admin] RBAC: Adding query filter params (name=network) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:14:02.027099 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0958c91-1c79-4841-80a7-e868245ba080 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:14:02.028622 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0958c91-1c79-4841-80a7-e868245ba080 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:14:02.033964 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 351/717] 10.222.0.44 () {56 vars in 1112 bytes} [Thu Jun 16 12:14:01 2022] GET /identity/v3/services?name=network => generated 124 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:14:02.040911 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0958c91-1c79-4841-80a7-e868245ba080 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:14:02.090640 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:14:02.092025 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:14:02.118436 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b9e86b-5bde-49f7-88bc-ace40a58319f None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:14:02.159253 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f18ebcb-239e-417a-97bf-06be33815805 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:14:02.160213 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f18ebcb-239e-417a-97bf-06be33815805 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:02.160498 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f18ebcb-239e-417a-97bf-06be33815805 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:02.160815 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f18ebcb-239e-417a-97bf-06be33815805 None admin] PATH_INFO: `/v3/services` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:02.161526 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f18ebcb-239e-417a-97bf-06be33815805 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:14:02.161882 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f18ebcb-239e-417a-97bf-06be33815805 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:14:02.163263 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f18ebcb-239e-417a-97bf-06be33815805 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:14:02.170320 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 367/718] 10.222.0.44 () {56 vars in 1124 bytes} [Thu Jun 16 12:14:01 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:14:02.212345 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0958c91-1c79-4841-80a7-e868245ba080 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:14:02.253779 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b483c27-35f0-4bef-a5b8-05e3453704ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:14:02.254462 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b483c27-35f0-4bef-a5b8-05e3453704ef None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:02.255284 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b483c27-35f0-4bef-a5b8-05e3453704ef None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:02.255561 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b483c27-35f0-4bef-a5b8-05e3453704ef None admin] PATH_INFO: `/v3/services` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:02.256282 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b483c27-35f0-4bef-a5b8-05e3453704ef None admin] RBAC: Adding query filter params (type=network) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:14:02.256589 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b483c27-35f0-4bef-a5b8-05e3453704ef None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:14:02.258086 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b483c27-35f0-4bef-a5b8-05e3453704ef None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:14:02.265402 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 352/719] 10.222.0.44 () {56 vars in 1112 bytes} [Thu Jun 16 12:14:02 2022] GET /identity/v3/services?type=network => generated 124 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:14:03.623048 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4beba6a1-7191-4bfa-95b3-3d890514f479 None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:03.623575 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4beba6a1-7191-4bfa-95b3-3d890514f479 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:03.623683 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4beba6a1-7191-4bfa-95b3-3d890514f479 None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:03.625233 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 368/720] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 12:14:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 12:14:03.630835 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3c435b-7202-45c8-b2ce-35fedde22425 None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:03.631329 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3c435b-7202-45c8-b2ce-35fedde22425 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:03.631404 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3c435b-7202-45c8-b2ce-35fedde22425 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:03.657324 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-ec3c435b-7202-45c8-b2ce-35fedde22425 None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:14:03.658574 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-ec3c435b-7202-45c8-b2ce-35fedde22425 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:14:03.710534 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbd42ce-b29c-46c5-817c-7d490377b73e None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:03.710842 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbd42ce-b29c-46c5-817c-7d490377b73e None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:03.711097 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbd42ce-b29c-46c5-817c-7d490377b73e None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:03.713677 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 369/721] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 12:14:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 12:14:03.718306 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e879b04c-d912-4b62-b54f-94ba03878a71 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:03.718587 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e879b04c-d912-4b62-b54f-94ba03878a71 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:03.718855 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e879b04c-d912-4b62-b54f-94ba03878a71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:03.736007 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-e879b04c-d912-4b62-b54f-94ba03878a71 None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:14:03.737255 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-e879b04c-d912-4b62-b54f-94ba03878a71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:14:03.764645 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 353/722] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 12:14:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 12:14:03.796396 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3c435b-7202-45c8-b2ce-35fedde22425 None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:14:03.819769 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 370/723] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 12:14:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 12:14:03.842696 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:14:03.848730 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e879b04c-d912-4b62-b54f-94ba03878a71 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:14:03.981183 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:14:03.991579 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3c435b-7202-45c8-b2ce-35fedde22425 None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:14:04.041553 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e879b04c-d912-4b62-b54f-94ba03878a71 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:14:04.057869 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e889cd6-555a-4c92-b82b-d3a7f43cdf41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:14:04.058677 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e889cd6-555a-4c92-b82b-d3a7f43cdf41 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:04.058957 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e889cd6-555a-4c92-b82b-d3a7f43cdf41 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:04.059233 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e889cd6-555a-4c92-b82b-d3a7f43cdf41 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:04.079605 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e889cd6-555a-4c92-b82b-d3a7f43cdf41 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 12:14:04.089140 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application [None req-0e889cd6-555a-4c92-b82b-d3a7f43cdf41 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 12:14:04.089140 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 12:14:04.089140 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 12:14:04.089140 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 12:14:04.089140 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 12:14:04.089140 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 12:14:04.089140 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 12:14:04.089140 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 12:14:04.089140 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 12:14:04.089140 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 12:14:04.089140 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 12:14:04.089140 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 12:14:04.089140 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 12:14:04.089140 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 12:14:04.089140 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 12:14:04.089140 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 12:14:04.090080 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 12:14:04.090080 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 12:14:04.090080 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 12:14:04.090080 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 12:14:04.090080 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 12:14:04.090080 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 12:14:04.090080 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 12:14:04.090080 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 12:14:04.090080 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 12:14:04.090080 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 12:14:04.090080 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 12:14:04.090080 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application with Lock( Jun 16 12:14:04.090080 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 12:14:04.090080 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._enter() Jun 16 12:14:04.090080 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 12:14:04.090080 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 12:14:04.091333 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 12:14:04.091333 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.creator() Jun 16 12:14:04.091333 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 12:14:04.091333 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application created_value = creator( Jun 16 12:14:04.091333 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 12:14:04.091333 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 12:14:04.091333 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 12:14:04.091333 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 12:14:04.091333 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 12:14:04.091333 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 12:14:04.091333 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 12:14:04.091333 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application Jun 16 12:14:04.091333 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 354/724] 10.222.0.44 () {56 vars in 1096 bytes} [Thu Jun 16 12:14:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 12:14:04.103345 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e889cd6-555a-4c92-b82b-d3a7f43cdf41 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:14:04.117339 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f576b7-e021-430b-aebf-f722cd1ddd81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:14:04.118140 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f576b7-e021-430b-aebf-f722cd1ddd81 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:04.118417 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f576b7-e021-430b-aebf-f722cd1ddd81 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:04.118688 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f576b7-e021-430b-aebf-f722cd1ddd81 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:04.136370 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f576b7-e021-430b-aebf-f722cd1ddd81 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 12:14:04.144250 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-d5f576b7-e021-430b-aebf-f722cd1ddd81 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 16 12:14:04.144250 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 12:14:04.144250 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 12:14:04.144250 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 12:14:04.144250 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 12:14:04.144250 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 12:14:04.144250 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 12:14:04.144250 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 12:14:04.144250 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 12:14:04.144250 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 12:14:04.144250 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 12:14:04.144250 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 12:14:04.144250 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 12:14:04.144250 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 12:14:04.144250 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 12:14:04.144250 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 12:14:04.146536 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 12:14:04.146536 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 12:14:04.146536 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 12:14:04.146536 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 12:14:04.146536 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 12:14:04.146536 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 12:14:04.146536 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 12:14:04.146536 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 12:14:04.146536 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 12:14:04.146536 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 12:14:04.146536 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 12:14:04.146536 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jun 16 12:14:04.146536 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 12:14:04.146536 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jun 16 12:14:04.146536 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 12:14:04.146536 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 12:14:04.148550 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 12:14:04.148550 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jun 16 12:14:04.148550 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 12:14:04.148550 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jun 16 12:14:04.148550 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 12:14:04.148550 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 12:14:04.148550 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 12:14:04.148550 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 12:14:04.148550 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 12:14:04.148550 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 12:14:04.148550 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 16 12:14:04.148550 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jun 16 12:14:04.148550 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 371/725] 10.222.0.44 () {56 vars in 1102 bytes} [Thu Jun 16 12:14:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 12:14:04.166961 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f576b7-e021-430b-aebf-f722cd1ddd81 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:14:04.280628 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f576b7-e021-430b-aebf-f722cd1ddd81 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:14:04.283839 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:14:04.314334 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:14:04.322799 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d40158-2c96-4e10-bab4-3c356f30c852 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:14:04.323894 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d40158-2c96-4e10-bab4-3c356f30c852 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:04.324368 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d40158-2c96-4e10-bab4-3c356f30c852 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:04.325003 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d40158-2c96-4e10-bab4-3c356f30c852 None admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:04.325767 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d40158-2c96-4e10-bab4-3c356f30c852 None admin] RBAC: Adding query filter params (name=service) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:14:04.326082 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d40158-2c96-4e10-bab4-3c356f30c852 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:14:04.327367 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e889cd6-555a-4c92-b82b-d3a7f43cdf41 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:14:04.327555 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d40158-2c96-4e10-bab4-3c356f30c852 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:14:04.338672 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 372/726] 10.222.0.44 () {56 vars in 1103 bytes} [Thu Jun 16 12:14:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:14:04.344004 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d40158-2c96-4e10-bab4-3c356f30c852 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:14:04.422275 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4fd7d5-16b7-41f4-8b7f-f4b3c5c25252 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:14:04.422946 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4fd7d5-16b7-41f4-8b7f-f4b3c5c25252 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:04.423226 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4fd7d5-16b7-41f4-8b7f-f4b3c5c25252 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:04.423497 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4fd7d5-16b7-41f4-8b7f-f4b3c5c25252 None admin] PATH_INFO: `/v3/roles` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:04.424249 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4fd7d5-16b7-41f4-8b7f-f4b3c5c25252 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:14:04.424553 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4fd7d5-16b7-41f4-8b7f-f4b3c5c25252 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:14:04.425965 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4fd7d5-16b7-41f4-8b7f-f4b3c5c25252 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:14:04.452732 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 355/727] 10.222.0.44 () {56 vars in 1099 bytes} [Thu Jun 16 12:14:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 350 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:14:04.453836 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4fd7d5-16b7-41f4-8b7f-f4b3c5c25252 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:14:04.492314 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d40158-2c96-4e10-bab4-3c356f30c852 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:14:04.555363 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bf6e37-ee47-4e46-97e4-191de153d1b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:14:04.556890 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bf6e37-ee47-4e46-97e4-191de153d1b8 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:04.557347 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bf6e37-ee47-4e46-97e4-191de153d1b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:04.557793 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bf6e37-ee47-4e46-97e4-191de153d1b8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:04.573024 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bf6e37-ee47-4e46-97e4-191de153d1b8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:14:04.575504 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bf6e37-ee47-4e46-97e4-191de153d1b8 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:14:04.597700 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-61bf6e37-ee47-4e46-97e4-191de153d1b8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 12:14:04.597700 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 12:14:04.597700 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 12:14:04.597700 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 12:14:04.597700 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 12:14:04.597700 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 12:14:04.597700 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 12:14:04.597700 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 12:14:04.597700 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 12:14:04.597700 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 12:14:04.597700 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 12:14:04.597700 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 12:14:04.597700 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 12:14:04.597700 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 12:14:04.597700 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 12:14:04.599161 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 12:14:04.599161 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 12:14:04.599161 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 12:14:04.599161 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 12:14:04.599161 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 12:14:04.599161 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 12:14:04.599161 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 12:14:04.599161 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 12:14:04.599161 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jun 16 12:14:04.599161 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 12:14:04.599161 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jun 16 12:14:04.599161 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 12:14:04.599161 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 12:14:04.599161 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 12:14:04.599161 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jun 16 12:14:04.599161 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 12:14:04.599161 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jun 16 12:14:04.600041 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 12:14:04.600041 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 12:14:04.600041 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 12:14:04.600041 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jun 16 12:14:04.602832 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 373/728] 10.222.0.44 () {56 vars in 1108 bytes} [Thu Jun 16 12:14:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 12:14:04.604528 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8f58c4-11fd-4b75-aae2-979671b21521 None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:04.605291 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8f58c4-11fd-4b75-aae2-979671b21521 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:04.606022 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8f58c4-11fd-4b75-aae2-979671b21521 None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:04.612378 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 374/729] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 12:14:04 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 12:14:04.612378 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8f58c4-11fd-4b75-aae2-979671b21521 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:14:04.614802 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4fd7d5-16b7-41f4-8b7f-f4b3c5c25252 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:14:04.652832 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7dbc8f-565a-463c-82ef-f04a58550921 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:14:04.653633 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7dbc8f-565a-463c-82ef-f04a58550921 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:04.653914 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7dbc8f-565a-463c-82ef-f04a58550921 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:04.654190 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7dbc8f-565a-463c-82ef-f04a58550921 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:04.666238 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7dbc8f-565a-463c-82ef-f04a58550921 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:14:04.667683 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7dbc8f-565a-463c-82ef-f04a58550921 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:14:04.677473 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:14:04.678745 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:14:04.690359 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application [None req-9e7dbc8f-565a-463c-82ef-f04a58550921 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 12:14:04.690359 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 12:14:04.690359 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 12:14:04.690359 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 12:14:04.690359 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 12:14:04.690359 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 12:14:04.690359 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 12:14:04.690359 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 12:14:04.690359 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 12:14:04.690359 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 12:14:04.690359 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 12:14:04.690359 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 12:14:04.690359 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 12:14:04.690359 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 12:14:04.690359 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 12:14:04.691292 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 12:14:04.691292 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 12:14:04.691292 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 12:14:04.691292 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 12:14:04.691292 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 12:14:04.691292 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 12:14:04.691292 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 12:14:04.691292 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 12:14:04.691292 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application with Lock( Jun 16 12:14:04.691292 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 12:14:04.691292 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._enter() Jun 16 12:14:04.691292 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 12:14:04.691292 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 12:14:04.691292 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 12:14:04.691292 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.creator() Jun 16 12:14:04.691292 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 12:14:04.691292 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application created_value = creator( Jun 16 12:14:04.692800 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 12:14:04.692800 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 12:14:04.692800 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 12:14:04.692800 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application Jun 16 12:14:04.692800 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 356/730] 10.222.0.44 () {56 vars in 1108 bytes} [Thu Jun 16 12:14:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 12:14:04.694584 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ab49b6-23c0-4157-95b6-364216eb55ee None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:04.694979 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ab49b6-23c0-4157-95b6-364216eb55ee None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:04.695348 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ab49b6-23c0-4157-95b6-364216eb55ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:04.714084 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-a3ab49b6-23c0-4157-95b6-364216eb55ee None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:14:04.715400 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-a3ab49b6-23c0-4157-95b6-364216eb55ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:14:04.761556 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8f58c4-11fd-4b75-aae2-979671b21521 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:14:04.800317 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 357/731] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 12:14:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 12:14:04.801431 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ab49b6-23c0-4157-95b6-364216eb55ee None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:14:04.811820 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f730db-d700-422a-a61b-d5c590b61b6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:14:04.812427 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f730db-d700-422a-a61b-d5c590b61b6b None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:04.812772 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f730db-d700-422a-a61b-d5c590b61b6b None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:04.813059 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f730db-d700-422a-a61b-d5c590b61b6b None admin] PATH_INFO: `/v3/domains` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:04.813861 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f730db-d700-422a-a61b-d5c590b61b6b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:14:04.814167 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f730db-d700-422a-a61b-d5c590b61b6b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:14:04.815707 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f730db-d700-422a-a61b-d5c590b61b6b None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:14:04.829513 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 375/732] 10.222.0.44 () {56 vars in 1109 bytes} [Thu Jun 16 12:14:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:14:04.830977 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1629b8a-671c-424f-9f11-ed7a56607b25 None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:04.831428 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1629b8a-671c-424f-9f11-ed7a56607b25 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:04.831705 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1629b8a-671c-424f-9f11-ed7a56607b25 None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:04.834451 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 376/733] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 12:14:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 12:14:04.835163 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1629b8a-671c-424f-9f11-ed7a56607b25 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:14:04.915841 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ab49b6-23c0-4157-95b6-364216eb55ee None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:14:04.953476 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:14:04.958514 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1629b8a-671c-424f-9f11-ed7a56607b25 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:14:04.960806 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9f50f6-8654-4a08-9f47-b315217233e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:14:04.961265 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:14:04.962280 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9f50f6-8654-4a08-9f47-b315217233e6 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:04.962566 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9f50f6-8654-4a08-9f47-b315217233e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:04.962846 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9f50f6-8654-4a08-9f47-b315217233e6 None admin] PATH_INFO: `/v3/domains` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:04.963572 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9f50f6-8654-4a08-9f47-b315217233e6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:14:04.963883 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9f50f6-8654-4a08-9f47-b315217233e6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:14:04.965276 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9f50f6-8654-4a08-9f47-b315217233e6 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:14:04.978584 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 358/734] 10.222.0.44 () {56 vars in 1109 bytes} [Thu Jun 16 12:14:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:14:04.979397 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9f50f6-8654-4a08-9f47-b315217233e6 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:14:04.994190 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25089b7-778b-4b15-a8cf-f1f219b257ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:14:04.994994 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25089b7-778b-4b15-a8cf-f1f219b257ab None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:04.995275 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25089b7-778b-4b15-a8cf-f1f219b257ab None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:04.995547 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25089b7-778b-4b15-a8cf-f1f219b257ab None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:05.006023 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25089b7-778b-4b15-a8cf-f1f219b257ab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 12:14:05.013672 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-c25089b7-778b-4b15-a8cf-f1f219b257ab None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 12:14:05.013672 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 12:14:05.013672 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 12:14:05.013672 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 12:14:05.013672 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 12:14:05.013672 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 12:14:05.013672 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 12:14:05.013672 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 12:14:05.013672 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 12:14:05.013672 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 12:14:05.013672 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 12:14:05.013672 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 12:14:05.013672 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 12:14:05.013672 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 12:14:05.013672 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 12:14:05.013672 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 12:14:05.014596 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 12:14:05.014596 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 12:14:05.014596 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 12:14:05.014596 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 12:14:05.014596 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 12:14:05.014596 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 12:14:05.014596 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 12:14:05.014596 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 12:14:05.014596 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 12:14:05.014596 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 12:14:05.014596 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 12:14:05.014596 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jun 16 12:14:05.014596 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 12:14:05.014596 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jun 16 12:14:05.014596 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 12:14:05.014596 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 12:14:05.015432 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 12:14:05.015432 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jun 16 12:14:05.015432 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 12:14:05.015432 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jun 16 12:14:05.015432 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 12:14:05.015432 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 12:14:05.015432 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 12:14:05.015432 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 12:14:05.015432 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 12:14:05.015432 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 12:14:05.015432 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 12:14:05.015432 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jun 16 12:14:05.015432 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 377/735] 10.222.0.44 () {56 vars in 1096 bytes} [Thu Jun 16 12:14:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 12:14:05.016187 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2224cd24-5c73-4115-afaf-4da0357c5c69 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:05.016731 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2224cd24-5c73-4115-afaf-4da0357c5c69 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:05.016731 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2224cd24-5c73-4115-afaf-4da0357c5c69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:05.032919 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-2224cd24-5c73-4115-afaf-4da0357c5c69 None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:14:05.034101 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-2224cd24-5c73-4115-afaf-4da0357c5c69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:14:05.083819 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9f50f6-8654-4a08-9f47-b315217233e6 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:14:05.098780 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 378/736] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 12:14:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 12:14:05.100064 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5b6a0e-8626-40b2-8192-3d4308a5308a None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:05.100349 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5b6a0e-8626-40b2-8192-3d4308a5308a None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:05.100622 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5b6a0e-8626-40b2-8192-3d4308a5308a None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:05.102076 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 379/737] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 12:14:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 12:14:05.102583 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5b6a0e-8626-40b2-8192-3d4308a5308a None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:14:05.121394 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a55fdc-808f-4a82-8a30-424c5d3647ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:14:05.122454 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a55fdc-808f-4a82-8a30-424c5d3647ba None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:05.122723 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a55fdc-808f-4a82-8a30-424c5d3647ba None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:05.122988 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a55fdc-808f-4a82-8a30-424c5d3647ba None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:05.131129 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a55fdc-808f-4a82-8a30-424c5d3647ba None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:14:05.132563 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a55fdc-808f-4a82-8a30-424c5d3647ba None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:14:05.147271 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application [None req-79a55fdc-808f-4a82-8a30-424c5d3647ba None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 16 12:14:05.147271 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 12:14:05.147271 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 12:14:05.147271 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 12:14:05.147271 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 12:14:05.147271 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 12:14:05.147271 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 12:14:05.147271 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 12:14:05.147271 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 12:14:05.147271 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 12:14:05.147271 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 12:14:05.147271 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 12:14:05.147271 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 12:14:05.147271 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 12:14:05.147271 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 12:14:05.147271 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 12:14:05.148190 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 12:14:05.148190 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 12:14:05.148190 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 12:14:05.148190 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 12:14:05.148190 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 12:14:05.148190 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 12:14:05.148190 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 12:14:05.148190 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 12:14:05.148190 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 12:14:05.148190 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 12:14:05.148190 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 12:14:05.148190 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application with Lock( Jun 16 12:14:05.148190 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 12:14:05.148190 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._enter() Jun 16 12:14:05.148190 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 12:14:05.148190 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 12:14:05.148190 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 12:14:05.148190 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.creator() Jun 16 12:14:05.149150 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 12:14:05.149150 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application created_value = creator( Jun 16 12:14:05.149150 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 12:14:05.149150 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 12:14:05.149150 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 12:14:05.149150 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 12:14:05.149150 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 12:14:05.149150 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 12:14:05.149150 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 16 12:14:05.149150 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application Jun 16 12:14:05.149150 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 359/738] 10.222.0.44 () {56 vars in 1117 bytes} [Thu Jun 16 12:14:04 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 12:14:05.149716 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a55fdc-808f-4a82-8a30-424c5d3647ba None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:14:05.197121 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:14:05.199567 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:14:05.208659 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5b6a0e-8626-40b2-8192-3d4308a5308a None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:14:05.241112 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c795a3-dfce-4897-ab2c-7ffdfdc34e13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:14:05.241894 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c795a3-dfce-4897-ab2c-7ffdfdc34e13 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:05.242172 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c795a3-dfce-4897-ab2c-7ffdfdc34e13 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:05.242440 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c795a3-dfce-4897-ab2c-7ffdfdc34e13 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:05.248482 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a55fdc-808f-4a82-8a30-424c5d3647ba None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:14:05.249260 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c795a3-dfce-4897-ab2c-7ffdfdc34e13 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:14:05.250724 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c795a3-dfce-4897-ab2c-7ffdfdc34e13 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:14:05.266096 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-29c795a3-dfce-4897-ab2c-7ffdfdc34e13 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 16 12:14:05.266096 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 12:14:05.266096 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 12:14:05.266096 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 12:14:05.266096 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 12:14:05.266096 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 12:14:05.266096 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 12:14:05.266096 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 12:14:05.266096 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 12:14:05.266096 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 12:14:05.266096 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 12:14:05.266096 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 12:14:05.266096 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 12:14:05.266096 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 12:14:05.266096 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 12:14:05.266096 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 12:14:05.267221 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 12:14:05.267221 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 12:14:05.267221 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 12:14:05.267221 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 12:14:05.267221 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 12:14:05.267221 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 12:14:05.267221 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 12:14:05.267221 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 12:14:05.267221 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 12:14:05.267221 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 12:14:05.267221 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 12:14:05.267221 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jun 16 12:14:05.267221 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 12:14:05.267221 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jun 16 12:14:05.267221 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 12:14:05.267221 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 12:14:05.267221 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 12:14:05.267221 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jun 16 12:14:05.268156 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 12:14:05.268156 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jun 16 12:14:05.268156 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 12:14:05.268156 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 12:14:05.268156 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 12:14:05.268156 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 12:14:05.268156 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 12:14:05.268156 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 12:14:05.268156 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 16 12:14:05.268156 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jun 16 12:14:05.268156 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 380/739] 10.222.0.44 () {56 vars in 1093 bytes} [Thu Jun 16 12:14:05 2022] GET /identity/v3/users/nova => generated 82 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 12:14:05.268731 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f49312-4939-4710-bf37-db03f3b83b93 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:05.268731 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f49312-4939-4710-bf37-db03f3b83b93 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:05.268933 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f49312-4939-4710-bf37-db03f3b83b93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:05.285149 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-09f49312-4939-4710-bf37-db03f3b83b93 None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:14:05.286065 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ae3afa-51ff-4f82-a879-7ad10d726d2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:14:05.286346 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-09f49312-4939-4710-bf37-db03f3b83b93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:14:05.286723 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ae3afa-51ff-4f82-a879-7ad10d726d2e None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:05.287001 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ae3afa-51ff-4f82-a879-7ad10d726d2e None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:05.287272 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ae3afa-51ff-4f82-a879-7ad10d726d2e None admin] PATH_INFO: `/v3/roles` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:05.288012 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ae3afa-51ff-4f82-a879-7ad10d726d2e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:14:05.288464 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ae3afa-51ff-4f82-a879-7ad10d726d2e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:14:05.289857 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ae3afa-51ff-4f82-a879-7ad10d726d2e None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:14:05.298003 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 360/740] 10.222.0.44 () {56 vars in 1099 bytes} [Thu Jun 16 12:14:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:14:05.298747 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ae3afa-51ff-4f82-a879-7ad10d726d2e None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:14:05.354810 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 381/741] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 12:14:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 12:14:05.355554 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f49312-4939-4710-bf37-db03f3b83b93 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:14:05.399623 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ae3afa-51ff-4f82-a879-7ad10d726d2e None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:14:05.411970 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:14:05.433120 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bb9ab7-030c-4941-88bc-a733d5060b26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:14:05.433774 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bb9ab7-030c-4941-88bc-a733d5060b26 None admin] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:05.434053 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bb9ab7-030c-4941-88bc-a733d5060b26 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:05.434324 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bb9ab7-030c-4941-88bc-a733d5060b26 None admin] PATH_INFO: `/v3/services` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:05.435034 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bb9ab7-030c-4941-88bc-a733d5060b26 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:14:05.436379 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bb9ab7-030c-4941-88bc-a733d5060b26 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:14:05.438167 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:14:05.450797 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 361/742] 10.222.0.44 () {60 vars in 1141 bytes} [Thu Jun 16 12:14:05 2022] POST /identity/v3/services => generated 251 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 12:14:05.451668 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bb9ab7-030c-4941-88bc-a733d5060b26 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:14:05.456436 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f49312-4939-4710-bf37-db03f3b83b93 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:14:05.501660 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eda4cb8-d301-4185-8c9b-0d09f4d5fae7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:14:05.502450 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eda4cb8-d301-4185-8c9b-0d09f4d5fae7 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:05.502827 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eda4cb8-d301-4185-8c9b-0d09f4d5fae7 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:05.503173 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eda4cb8-d301-4185-8c9b-0d09f4d5fae7 None admin] PATH_INFO: `/v3/users` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:05.504109 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eda4cb8-d301-4185-8c9b-0d09f4d5fae7 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:14:05.505105 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eda4cb8-d301-4185-8c9b-0d09f4d5fae7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:14:05.506666 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eda4cb8-d301-4185-8c9b-0d09f4d5fae7 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:14:05.531027 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 382/743] 10.222.0.44 () {56 vars in 1149 bytes} [Thu Jun 16 12:14:05 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:14:05.531027 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eda4cb8-d301-4185-8c9b-0d09f4d5fae7 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:14:05.588776 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bb9ab7-030c-4941-88bc-a733d5060b26 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:14:05.628242 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b8bd12-4b94-4f9c-9885-edb5aef7ff72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:14:05.628983 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b8bd12-4b94-4f9c-9885-edb5aef7ff72 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:05.630716 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b8bd12-4b94-4f9c-9885-edb5aef7ff72 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:05.630716 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b8bd12-4b94-4f9c-9885-edb5aef7ff72 None admin] PATH_INFO: `/v3/users` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:05.631201 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b8bd12-4b94-4f9c-9885-edb5aef7ff72 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:14:05.631573 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b8bd12-4b94-4f9c-9885-edb5aef7ff72 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:14:05.634031 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b8bd12-4b94-4f9c-9885-edb5aef7ff72 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:14:05.640809 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eda4cb8-d301-4185-8c9b-0d09f4d5fae7 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:14:05.651264 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 362/744] 10.222.0.44 () {56 vars in 1133 bytes} [Thu Jun 16 12:14:05 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:14:05.652146 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b8bd12-4b94-4f9c-9885-edb5aef7ff72 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:14:05.677024 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74142151-6506-487b-aa44-608a1afab2ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:14:05.677925 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74142151-6506-487b-aa44-608a1afab2ce None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:05.678263 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74142151-6506-487b-aa44-608a1afab2ce None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:05.678645 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74142151-6506-487b-aa44-608a1afab2ce None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:05.683947 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:14:05.686411 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:14:05.691523 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74142151-6506-487b-aa44-608a1afab2ce None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:14:05.694226 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74142151-6506-487b-aa44-608a1afab2ce None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:14:05.712853 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-74142151-6506-487b-aa44-608a1afab2ce None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 12:14:05.712853 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 12:14:05.712853 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 12:14:05.712853 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 12:14:05.712853 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 12:14:05.712853 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 12:14:05.712853 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 12:14:05.712853 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 12:14:05.712853 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 12:14:05.712853 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 12:14:05.712853 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 12:14:05.712853 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 12:14:05.712853 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 12:14:05.712853 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 12:14:05.712853 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 12:14:05.713944 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 12:14:05.713944 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 12:14:05.713944 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 12:14:05.713944 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 12:14:05.713944 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 12:14:05.713944 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 12:14:05.713944 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 12:14:05.713944 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 12:14:05.713944 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jun 16 12:14:05.713944 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 12:14:05.713944 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jun 16 12:14:05.713944 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 12:14:05.713944 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 12:14:05.713944 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 12:14:05.713944 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jun 16 12:14:05.713944 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 12:14:05.713944 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jun 16 12:14:05.714932 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 12:14:05.714932 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 12:14:05.714932 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 12:14:05.714932 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jun 16 12:14:05.714932 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 383/745] 10.222.0.44 () {56 vars in 1108 bytes} [Thu Jun 16 12:14:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 12:14:05.715499 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74142151-6506-487b-aa44-608a1afab2ce None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:14:05.769053 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b8bd12-4b94-4f9c-9885-edb5aef7ff72 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:14:05.807904 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2888b5-8757-4dce-91ce-58c924077613 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:14:05.808566 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2888b5-8757-4dce-91ce-58c924077613 None admin] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:05.808869 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2888b5-8757-4dce-91ce-58c924077613 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:05.809143 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2888b5-8757-4dce-91ce-58c924077613 None admin] PATH_INFO: `/v3/services` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:05.809859 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2888b5-8757-4dce-91ce-58c924077613 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:14:05.811249 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2888b5-8757-4dce-91ce-58c924077613 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:14:05.823962 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74142151-6506-487b-aa44-608a1afab2ce None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:14:05.828790 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 363/746] 10.222.0.44 () {60 vars in 1141 bytes} [Thu Jun 16 12:14:05 2022] POST /identity/v3/services => generated 240 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 12:14:05.828790 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2888b5-8757-4dce-91ce-58c924077613 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:14:05.895630 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b747707e-50d4-4b79-a8c2-82b1ed0dd604 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:14:05.896592 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b747707e-50d4-4b79-a8c2-82b1ed0dd604 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:05.896977 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b747707e-50d4-4b79-a8c2-82b1ed0dd604 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:05.897317 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b747707e-50d4-4b79-a8c2-82b1ed0dd604 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:05.948559 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:14:05.962001 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2888b5-8757-4dce-91ce-58c924077613 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:14:05.994661 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:14:06.005666 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e444550e-7956-4f4c-a1dc-3607caa675b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:14:06.006208 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e444550e-7956-4f4c-a1dc-3607caa675b0 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:06.006487 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e444550e-7956-4f4c-a1dc-3607caa675b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:06.006762 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e444550e-7956-4f4c-a1dc-3607caa675b0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:06.012436 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b747707e-50d4-4b79-a8c2-82b1ed0dd604 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:14:06.013998 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b747707e-50d4-4b79-a8c2-82b1ed0dd604 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:14:06.020558 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e444550e-7956-4f4c-a1dc-3607caa675b0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:14:06.022311 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e444550e-7956-4f4c-a1dc-3607caa675b0 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:14:06.041749 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application [None req-e444550e-7956-4f4c-a1dc-3607caa675b0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 12:14:06.041749 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 12:14:06.041749 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 12:14:06.041749 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 12:14:06.041749 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 12:14:06.041749 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 12:14:06.041749 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 12:14:06.041749 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 12:14:06.041749 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 12:14:06.041749 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 12:14:06.041749 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 12:14:06.041749 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 12:14:06.041749 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 12:14:06.041749 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 12:14:06.041749 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 12:14:06.042675 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 12:14:06.042675 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 12:14:06.042675 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 12:14:06.042675 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 12:14:06.042675 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 12:14:06.042675 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 12:14:06.042675 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 12:14:06.042675 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 12:14:06.042675 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application with Lock( Jun 16 12:14:06.042675 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 12:14:06.042675 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._enter() Jun 16 12:14:06.042675 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 12:14:06.042675 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 12:14:06.042675 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 12:14:06.042675 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.creator() Jun 16 12:14:06.042675 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 12:14:06.042675 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application created_value = creator( Jun 16 12:14:06.044113 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 12:14:06.044113 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 12:14:06.044113 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 12:14:06.044113 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application Jun 16 12:14:06.044113 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 364/747] 10.222.0.44 () {56 vars in 1108 bytes} [Thu Jun 16 12:14:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 12:14:06.044113 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e444550e-7956-4f4c-a1dc-3607caa675b0 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:14:06.156397 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 384/748] 10.222.0.44 () {58 vars in 1282 bytes} [Thu Jun 16 12:14:05 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 441 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 16 12:14:06.161861 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b747707e-50d4-4b79-a8c2-82b1ed0dd604 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:14:06.162531 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e444550e-7956-4f4c-a1dc-3607caa675b0 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:14:06.207178 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266ca61a-71cb-489e-b6c5-c97b7a33dee1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:14:06.208938 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266ca61a-71cb-489e-b6c5-c97b7a33dee1 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:06.209418 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266ca61a-71cb-489e-b6c5-c97b7a33dee1 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:06.210132 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266ca61a-71cb-489e-b6c5-c97b7a33dee1 None admin] PATH_INFO: `/v3/domains` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:06.211479 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266ca61a-71cb-489e-b6c5-c97b7a33dee1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:14:06.211932 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266ca61a-71cb-489e-b6c5-c97b7a33dee1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:14:06.214007 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266ca61a-71cb-489e-b6c5-c97b7a33dee1 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:14:06.231576 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 365/749] 10.222.0.44 () {56 vars in 1109 bytes} [Thu Jun 16 12:14:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:14:06.232677 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266ca61a-71cb-489e-b6c5-c97b7a33dee1 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:14:06.235411 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:14:06.257552 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:14:06.281022 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b747707e-50d4-4b79-a8c2-82b1ed0dd604 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:14:06.318299 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1da4463-4a92-4c26-b638-b5c6c34c3acc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:14:06.319551 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1da4463-4a92-4c26-b638-b5c6c34c3acc None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:06.320249 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1da4463-4a92-4c26-b638-b5c6c34c3acc None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:06.320635 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1da4463-4a92-4c26-b638-b5c6c34c3acc None admin] PATH_INFO: `/v3/domains` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:06.321766 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1da4463-4a92-4c26-b638-b5c6c34c3acc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:14:06.322174 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1da4463-4a92-4c26-b638-b5c6c34c3acc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:14:06.323707 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1da4463-4a92-4c26-b638-b5c6c34c3acc None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:14:06.339090 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 385/750] 10.222.0.44 () {56 vars in 1109 bytes} [Thu Jun 16 12:14:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:14:06.340382 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1da4463-4a92-4c26-b638-b5c6c34c3acc None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:14:06.371891 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266ca61a-71cb-489e-b6c5-c97b7a33dee1 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:14:06.421719 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a92cde-f2f8-41d2-93a2-ce2c5d38f135 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:14:06.423039 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a92cde-f2f8-41d2-93a2-ce2c5d38f135 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:06.423794 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a92cde-f2f8-41d2-93a2-ce2c5d38f135 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:06.424484 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a92cde-f2f8-41d2-93a2-ce2c5d38f135 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:06.438175 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a92cde-f2f8-41d2-93a2-ce2c5d38f135 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:14:06.440332 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a92cde-f2f8-41d2-93a2-ce2c5d38f135 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:14:06.462944 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application [None req-56a92cde-f2f8-41d2-93a2-ce2c5d38f135 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 12:14:06.462944 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 12:14:06.462944 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 12:14:06.462944 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 12:14:06.462944 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 12:14:06.462944 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 12:14:06.462944 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 12:14:06.462944 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 12:14:06.462944 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 12:14:06.462944 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 12:14:06.462944 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 12:14:06.462944 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 12:14:06.462944 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 12:14:06.462944 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 12:14:06.462944 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 12:14:06.464023 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 12:14:06.464023 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 12:14:06.464023 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 12:14:06.464023 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 12:14:06.464023 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 12:14:06.464023 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 12:14:06.464023 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 12:14:06.464023 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 12:14:06.464023 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application with Lock( Jun 16 12:14:06.464023 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 12:14:06.464023 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._enter() Jun 16 12:14:06.464023 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 12:14:06.464023 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 12:14:06.464023 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 12:14:06.464023 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.creator() Jun 16 12:14:06.464023 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 12:14:06.464023 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application created_value = creator( Jun 16 12:14:06.465166 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 12:14:06.465166 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 12:14:06.465166 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 12:14:06.465166 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application Jun 16 12:14:06.466145 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 366/751] 10.222.0.44 () {56 vars in 1108 bytes} [Thu Jun 16 12:14:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 12:14:06.467090 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a92cde-f2f8-41d2-93a2-ce2c5d38f135 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:14:06.469632 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1da4463-4a92-4c26-b638-b5c6c34c3acc None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:14:06.516661 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b4e4d5-ded5-470c-9dd1-5e1567e55787 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:14:06.519140 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b4e4d5-ded5-470c-9dd1-5e1567e55787 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:06.519628 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b4e4d5-ded5-470c-9dd1-5e1567e55787 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:06.520457 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b4e4d5-ded5-470c-9dd1-5e1567e55787 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:06.526061 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:14:06.532955 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b4e4d5-ded5-470c-9dd1-5e1567e55787 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:14:06.536033 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b4e4d5-ded5-470c-9dd1-5e1567e55787 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:14:06.556419 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-e5b4e4d5-ded5-470c-9dd1-5e1567e55787 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 16 12:14:06.556419 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 12:14:06.556419 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 12:14:06.556419 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 12:14:06.556419 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 12:14:06.556419 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 12:14:06.556419 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 12:14:06.556419 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 12:14:06.556419 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 12:14:06.556419 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 12:14:06.556419 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 12:14:06.556419 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 12:14:06.556419 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 12:14:06.556419 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 12:14:06.556419 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 12:14:06.556419 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 12:14:06.557653 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 12:14:06.557653 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 12:14:06.557653 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 12:14:06.557653 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 12:14:06.557653 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 12:14:06.557653 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 12:14:06.557653 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 12:14:06.557653 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 12:14:06.557653 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 12:14:06.557653 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 12:14:06.557653 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 12:14:06.557653 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jun 16 12:14:06.557653 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 12:14:06.557653 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jun 16 12:14:06.557653 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 12:14:06.557653 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 12:14:06.557653 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 12:14:06.557653 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jun 16 12:14:06.558804 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 12:14:06.558804 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jun 16 12:14:06.558804 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 12:14:06.558804 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 12:14:06.558804 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 12:14:06.558804 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 12:14:06.558804 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 12:14:06.558804 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 12:14:06.558804 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 16 12:14:06.558804 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jun 16 12:14:06.561800 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 386/752] 10.222.0.44 () {56 vars in 1096 bytes} [Thu Jun 16 12:14:06 2022] GET /identity/v3/users/swift => generated 83 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 12:14:06.563455 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b4e4d5-ded5-470c-9dd1-5e1567e55787 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:14:06.577098 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:14:06.580741 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a92cde-f2f8-41d2-93a2-ce2c5d38f135 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:14:06.623542 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf21c9b-3378-478c-b92c-4df0811e31f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:14:06.624698 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf21c9b-3378-478c-b92c-4df0811e31f0 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:06.625105 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf21c9b-3378-478c-b92c-4df0811e31f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:06.625613 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf21c9b-3378-478c-b92c-4df0811e31f0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:06.633534 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf21c9b-3378-478c-b92c-4df0811e31f0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:14:06.635119 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf21c9b-3378-478c-b92c-4df0811e31f0 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:14:06.650286 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application [None req-fcf21c9b-3378-478c-b92c-4df0811e31f0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 12:14:06.650286 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 12:14:06.650286 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 12:14:06.650286 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 12:14:06.650286 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 12:14:06.650286 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 12:14:06.650286 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 12:14:06.650286 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 12:14:06.650286 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 12:14:06.650286 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 12:14:06.650286 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 12:14:06.650286 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 12:14:06.650286 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 12:14:06.650286 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 12:14:06.650286 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 12:14:06.651303 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 12:14:06.651303 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 12:14:06.651303 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 12:14:06.651303 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 12:14:06.651303 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 12:14:06.651303 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 12:14:06.651303 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 12:14:06.651303 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 12:14:06.651303 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application with Lock( Jun 16 12:14:06.651303 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 12:14:06.651303 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._enter() Jun 16 12:14:06.651303 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 12:14:06.651303 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 12:14:06.651303 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 12:14:06.651303 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.creator() Jun 16 12:14:06.651303 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 12:14:06.651303 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application created_value = creator( Jun 16 12:14:06.652163 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 12:14:06.652163 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 12:14:06.652163 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 12:14:06.652163 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 12:14:06.652163 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 12:14:06.652163 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 12:14:06.652163 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 12:14:06.652163 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application Jun 16 12:14:06.656710 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 367/753] 10.222.0.44 () {56 vars in 1111 bytes} [Thu Jun 16 12:14:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 12:14:06.657694 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf21c9b-3378-478c-b92c-4df0811e31f0 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:14:06.687175 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b4e4d5-ded5-470c-9dd1-5e1567e55787 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:14:06.725587 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecd6fde-4361-4293-8cb3-1691c8588846 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:14:06.726549 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecd6fde-4361-4293-8cb3-1691c8588846 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:06.727023 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecd6fde-4361-4293-8cb3-1691c8588846 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:06.727468 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecd6fde-4361-4293-8cb3-1691c8588846 None admin] PATH_INFO: `/v3/domains` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:06.728471 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fecd6fde-4361-4293-8cb3-1691c8588846 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:14:06.729053 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fecd6fde-4361-4293-8cb3-1691c8588846 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:14:06.730678 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fecd6fde-4361-4293-8cb3-1691c8588846 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:14:06.744348 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 387/754] 10.222.0.44 () {56 vars in 1109 bytes} [Thu Jun 16 12:14:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:14:06.745596 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecd6fde-4361-4293-8cb3-1691c8588846 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:14:06.769559 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf21c9b-3378-478c-b92c-4df0811e31f0 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:14:06.784608 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:14:06.808292 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b149ba6d-31ca-40b7-b42f-559ba4524ae9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:14:06.809083 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b149ba6d-31ca-40b7-b42f-559ba4524ae9 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:06.809422 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b149ba6d-31ca-40b7-b42f-559ba4524ae9 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:06.809911 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b149ba6d-31ca-40b7-b42f-559ba4524ae9 None admin] PATH_INFO: `/v3/users` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:06.810989 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b149ba6d-31ca-40b7-b42f-559ba4524ae9 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:14:06.811163 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b149ba6d-31ca-40b7-b42f-559ba4524ae9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:14:06.812709 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b149ba6d-31ca-40b7-b42f-559ba4524ae9 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:14:06.817854 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:14:06.833559 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 368/755] 10.222.0.44 () {56 vars in 1135 bytes} [Thu Jun 16 12:14:06 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:14:06.834690 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b149ba6d-31ca-40b7-b42f-559ba4524ae9 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:14:06.855223 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecd6fde-4361-4293-8cb3-1691c8588846 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:14:06.891272 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51c400b-cf1a-496a-abe7-46c7ce6eb857 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:14:06.892191 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51c400b-cf1a-496a-abe7-46c7ce6eb857 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:06.892646 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51c400b-cf1a-496a-abe7-46c7ce6eb857 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:06.893127 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51c400b-cf1a-496a-abe7-46c7ce6eb857 None admin] PATH_INFO: `/v3/projects` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:06.894179 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51c400b-cf1a-496a-abe7-46c7ce6eb857 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:14:06.894751 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51c400b-cf1a-496a-abe7-46c7ce6eb857 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:14:06.896974 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51c400b-cf1a-496a-abe7-46c7ce6eb857 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:14:06.910414 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 388/756] 10.222.0.44 () {56 vars in 1148 bytes} [Thu Jun 16 12:14:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:14:06.912030 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51c400b-cf1a-496a-abe7-46c7ce6eb857 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:14:06.945134 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b149ba6d-31ca-40b7-b42f-559ba4524ae9 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:14:06.982055 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966a365f-e452-4d44-8f50-4405149ad8e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:14:06.982933 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966a365f-e452-4d44-8f50-4405149ad8e8 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:06.983288 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966a365f-e452-4d44-8f50-4405149ad8e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:06.983633 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966a365f-e452-4d44-8f50-4405149ad8e8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:06.991024 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966a365f-e452-4d44-8f50-4405149ad8e8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:14:06.992700 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966a365f-e452-4d44-8f50-4405149ad8e8 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:14:07.008545 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application [None req-966a365f-e452-4d44-8f50-4405149ad8e8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 12:14:07.008545 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 12:14:07.008545 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 12:14:07.008545 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 12:14:07.008545 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 12:14:07.008545 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 12:14:07.008545 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 12:14:07.008545 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 12:14:07.008545 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 12:14:07.008545 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 12:14:07.008545 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 12:14:07.008545 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 12:14:07.008545 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 12:14:07.008545 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 12:14:07.008545 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 12:14:07.009512 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 12:14:07.009512 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 12:14:07.009512 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 12:14:07.009512 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 12:14:07.009512 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 12:14:07.009512 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 12:14:07.009512 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 12:14:07.009512 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 12:14:07.009512 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application with Lock( Jun 16 12:14:07.009512 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 12:14:07.009512 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._enter() Jun 16 12:14:07.009512 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 12:14:07.009512 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 12:14:07.009512 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 12:14:07.009512 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.creator() Jun 16 12:14:07.009512 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 12:14:07.009512 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application created_value = creator( Jun 16 12:14:07.010867 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 12:14:07.010867 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 12:14:07.010867 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 12:14:07.010867 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 12:14:07.010867 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 12:14:07.010867 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 12:14:07.010867 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 12:14:07.010867 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application Jun 16 12:14:07.010867 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 369/757] 10.222.0.44 () {56 vars in 1111 bytes} [Thu Jun 16 12:14:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 12:14:07.012038 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966a365f-e452-4d44-8f50-4405149ad8e8 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:14:07.030632 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51c400b-cf1a-496a-abe7-46c7ce6eb857 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:14:07.047393 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:14:07.060587 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:14:07.072602 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed4825c-cd84-4bb1-bf02-7fcf4d05c0ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:14:07.074022 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed4825c-cd84-4bb1-bf02-7fcf4d05c0ab None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:07.074445 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed4825c-cd84-4bb1-bf02-7fcf4d05c0ab None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:07.075127 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed4825c-cd84-4bb1-bf02-7fcf4d05c0ab None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:07.128906 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966a365f-e452-4d44-8f50-4405149ad8e8 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:14:07.166660 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed4825c-cd84-4bb1-bf02-7fcf4d05c0ab None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:14:07.169010 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed4825c-cd84-4bb1-bf02-7fcf4d05c0ab None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:14:07.170167 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c976727-2bf2-4ab2-8b12-2dec6b30a8b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:14:07.171208 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c976727-2bf2-4ab2-8b12-2dec6b30a8b2 None admin] REQUEST_METHOD: `PUT` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:07.171637 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c976727-2bf2-4ab2-8b12-2dec6b30a8b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:07.172074 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c976727-2bf2-4ab2-8b12-2dec6b30a8b2 None admin] PATH_INFO: `/v3/projects/601361df39e34fcca71175aa94e425c4/users/edfb12d445e74136b90800e93941f468/roles/0688968254744e3f9913653cafea3091` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:07.174221 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c976727-2bf2-4ab2-8b12-2dec6b30a8b2 None admin] RBAC: Authorizing `identity:create_grant(project_id=601361df39e34fcca71175aa94e425c4, user_id=edfb12d445e74136b90800e93941f468, role_id=0688968254744e3f9913653cafea3091)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:14:07.175766 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c976727-2bf2-4ab2-8b12-2dec6b30a8b2 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:14:07.190981 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 370/758] 10.222.0.44 () {58 vars in 1439 bytes} [Thu Jun 16 12:14:07 2022] PUT /identity/v3/projects/601361df39e34fcca71175aa94e425c4/users/edfb12d445e74136b90800e93941f468/roles/0688968254744e3f9913653cafea3091 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:14:07.192167 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c976727-2bf2-4ab2-8b12-2dec6b30a8b2 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:14:07.376681 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:14:07.387288 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 389/759] 10.222.0.44 () {58 vars in 1282 bytes} [Thu Jun 16 12:14:06 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 475 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 16 12:14:07.389371 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c976727-2bf2-4ab2-8b12-2dec6b30a8b2 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:14:07.392701 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed4825c-cd84-4bb1-bf02-7fcf4d05c0ab None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:14:07.424398 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:14:07.440331 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90af07c-b7bc-4e7e-aa83-ef1292356067 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:14:07.441050 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90af07c-b7bc-4e7e-aa83-ef1292356067 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:07.441336 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90af07c-b7bc-4e7e-aa83-ef1292356067 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:07.441610 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90af07c-b7bc-4e7e-aa83-ef1292356067 None admin] PATH_INFO: `/v3/projects` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:07.442951 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90af07c-b7bc-4e7e-aa83-ef1292356067 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:14:07.443290 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90af07c-b7bc-4e7e-aa83-ef1292356067 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:14:07.445654 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90af07c-b7bc-4e7e-aa83-ef1292356067 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:14:07.461850 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 371/760] 10.222.0.44 () {56 vars in 1148 bytes} [Thu Jun 16 12:14:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:14:07.467671 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90af07c-b7bc-4e7e-aa83-ef1292356067 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:14:07.501506 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed4825c-cd84-4bb1-bf02-7fcf4d05c0ab None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:14:07.537595 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550ebed5-11e7-40e2-b895-1579a4ca14cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:14:07.538827 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550ebed5-11e7-40e2-b895-1579a4ca14cf None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:07.539206 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550ebed5-11e7-40e2-b895-1579a4ca14cf None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:07.539579 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550ebed5-11e7-40e2-b895-1579a4ca14cf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:07.551290 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550ebed5-11e7-40e2-b895-1579a4ca14cf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:14:07.553230 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550ebed5-11e7-40e2-b895-1579a4ca14cf None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:14:07.574233 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-550ebed5-11e7-40e2-b895-1579a4ca14cf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 12:14:07.574233 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 12:14:07.574233 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 12:14:07.574233 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 12:14:07.574233 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 12:14:07.574233 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 12:14:07.574233 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 12:14:07.574233 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 12:14:07.574233 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 12:14:07.574233 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 12:14:07.574233 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 12:14:07.574233 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 12:14:07.574233 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 12:14:07.574233 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 12:14:07.574233 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 12:14:07.575410 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 12:14:07.575410 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 12:14:07.575410 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 12:14:07.575410 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 12:14:07.575410 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 12:14:07.575410 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 12:14:07.575410 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 12:14:07.575410 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 12:14:07.575410 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jun 16 12:14:07.575410 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 12:14:07.575410 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jun 16 12:14:07.575410 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 12:14:07.575410 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 12:14:07.575410 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 12:14:07.575410 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jun 16 12:14:07.575410 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 12:14:07.575410 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jun 16 12:14:07.576485 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 12:14:07.576485 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 12:14:07.576485 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 12:14:07.576485 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jun 16 12:14:07.576485 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 390/761] 10.222.0.44 () {56 vars in 1108 bytes} [Thu Jun 16 12:14:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 12:14:07.584328 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550ebed5-11e7-40e2-b895-1579a4ca14cf None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:14:07.642530 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90af07c-b7bc-4e7e-aa83-ef1292356067 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:14:07.673596 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:14:07.696576 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550ebed5-11e7-40e2-b895-1579a4ca14cf None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:14:07.697699 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc9becf-762b-4380-8849-7193f40cbcf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:14:07.699687 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc9becf-762b-4380-8849-7193f40cbcf8 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:07.700203 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc9becf-762b-4380-8849-7193f40cbcf8 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:07.700675 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc9becf-762b-4380-8849-7193f40cbcf8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:07.701739 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc9becf-762b-4380-8849-7193f40cbcf8 None admin] RBAC: Adding query filter params (role.id=a5c06bc21d39451285def24673456ff6, scope.project.id=601361df39e34fcca71175aa94e425c4, user.id=222b53cae3d64412b9b0a89d162311f4) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:14:07.702247 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc9becf-762b-4380-8849-7193f40cbcf8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:14:07.703877 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc9becf-762b-4380-8849-7193f40cbcf8 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:14:07.713614 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 372/762] 10.222.0.44 () {56 vars in 1374 bytes} [Thu Jun 16 12:14:07 2022] GET /identity/v3/role_assignments?user.id=222b53cae3d64412b9b0a89d162311f4&scope.project.id=601361df39e34fcca71175aa94e425c4&role.id=a5c06bc21d39451285def24673456ff6 => generated 259 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 12:14:07.715497 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3173d185-a900-443b-8b51-dd345197c6e0 None None] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:07.716404 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3173d185-a900-443b-8b51-dd345197c6e0 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:07.716941 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3173d185-a900-443b-8b51-dd345197c6e0 None None] PATH_INFO: `/` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:07.719568 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 373/763] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 12:14:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 12:14:07.724943 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f710ee-017b-4307-b759-2a7adce2c6da None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:07.725237 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f710ee-017b-4307-b759-2a7adce2c6da None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:07.725513 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f710ee-017b-4307-b759-2a7adce2c6da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:07.740982 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bbc00a-e559-4de1-a333-d9cdda2c52c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:14:07.742050 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bbc00a-e559-4de1-a333-d9cdda2c52c2 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:07.742591 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bbc00a-e559-4de1-a333-d9cdda2c52c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:07.743057 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bbc00a-e559-4de1-a333-d9cdda2c52c2 None admin] PATH_INFO: `/v3/domains` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:07.744050 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65bbc00a-e559-4de1-a333-d9cdda2c52c2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:14:07.744561 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65bbc00a-e559-4de1-a333-d9cdda2c52c2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:14:07.745814 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-55f710ee-017b-4307-b759-2a7adce2c6da None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:14:07.746520 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65bbc00a-e559-4de1-a333-d9cdda2c52c2 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:14:07.747026 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-55f710ee-017b-4307-b759-2a7adce2c6da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:14:07.765061 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 391/764] 10.222.0.44 () {56 vars in 1109 bytes} [Thu Jun 16 12:14:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:14:07.765267 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:14:07.766976 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bbc00a-e559-4de1-a333-d9cdda2c52c2 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:14:07.913394 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bbc00a-e559-4de1-a333-d9cdda2c52c2 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:14:07.985676 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79ba615-9027-4025-bccf-52a5d56e7b00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:14:07.986752 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79ba615-9027-4025-bccf-52a5d56e7b00 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:07.987196 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79ba615-9027-4025-bccf-52a5d56e7b00 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:07.987610 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79ba615-9027-4025-bccf-52a5d56e7b00 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:07.995499 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79ba615-9027-4025-bccf-52a5d56e7b00 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:14:07.997216 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79ba615-9027-4025-bccf-52a5d56e7b00 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:14:08.005671 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:14:08.018174 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-d79ba615-9027-4025-bccf-52a5d56e7b00 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 12:14:08.018174 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 12:14:08.018174 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 12:14:08.018174 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 12:14:08.018174 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 12:14:08.018174 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 12:14:08.018174 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 12:14:08.018174 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 12:14:08.018174 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 12:14:08.018174 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 12:14:08.018174 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 12:14:08.018174 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 12:14:08.018174 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 12:14:08.018174 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 12:14:08.018174 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 12:14:08.019611 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 12:14:08.019611 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 12:14:08.019611 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 12:14:08.019611 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 12:14:08.019611 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 12:14:08.019611 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 12:14:08.019611 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 12:14:08.019611 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 12:14:08.019611 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jun 16 12:14:08.019611 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 12:14:08.019611 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jun 16 12:14:08.019611 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 12:14:08.019611 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 12:14:08.019611 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 12:14:08.019611 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jun 16 12:14:08.019611 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 12:14:08.019611 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jun 16 12:14:08.021202 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 12:14:08.021202 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 12:14:08.021202 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 12:14:08.021202 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 12:14:08.021202 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 12:14:08.021202 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 12:14:08.021202 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 12:14:08.021202 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jun 16 12:14:08.023311 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 392/765] 10.222.0.44 () {56 vars in 1111 bytes} [Thu Jun 16 12:14:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 12:14:08.028855 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79ba615-9027-4025-bccf-52a5d56e7b00 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:14:08.068686 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 374/766] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 12:14:07 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 345 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 16 12:14:08.118160 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f710ee-017b-4307-b759-2a7adce2c6da None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:14:08.207184 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79ba615-9027-4025-bccf-52a5d56e7b00 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:14:08.240252 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f710ee-017b-4307-b759-2a7adce2c6da None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:14:08.285356 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c67a854-2c14-4248-82ec-820339ce0f99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:14:08.286388 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c67a854-2c14-4248-82ec-820339ce0f99 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:08.286816 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5099a729-d46f-41f5-b51c-128c2549401e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:14:08.287105 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c67a854-2c14-4248-82ec-820339ce0f99 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:08.287566 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c67a854-2c14-4248-82ec-820339ce0f99 None admin] PATH_INFO: `/v3/projects` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:08.287668 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5099a729-d46f-41f5-b51c-128c2549401e None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:08.287899 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5099a729-d46f-41f5-b51c-128c2549401e None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:08.288170 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5099a729-d46f-41f5-b51c-128c2549401e None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:08.288863 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5099a729-d46f-41f5-b51c-128c2549401e None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:14:08.289269 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c67a854-2c14-4248-82ec-820339ce0f99 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:14:08.289762 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c67a854-2c14-4248-82ec-820339ce0f99 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:14:08.290229 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5099a729-d46f-41f5-b51c-128c2549401e None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:14:08.291779 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c67a854-2c14-4248-82ec-820339ce0f99 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:14:08.304376 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 393/767] 10.222.0.44 () {56 vars in 1148 bytes} [Thu Jun 16 12:14:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:14:08.304827 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application [None req-5099a729-d46f-41f5-b51c-128c2549401e None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 16 12:14:08.304827 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 12:14:08.304827 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 12:14:08.304827 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 12:14:08.304827 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 12:14:08.304827 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 12:14:08.304827 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 12:14:08.304827 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 12:14:08.304827 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 16 12:14:08.304827 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application Jun 16 12:14:08.304827 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 12:14:08.304827 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application Jun 16 12:14:08.304827 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 12:14:08.304827 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 12:14:08.304827 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 12:14:08.304827 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 12:14:08.305717 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 12:14:08.305717 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 12:14:08.305717 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 12:14:08.305717 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 12:14:08.305717 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 12:14:08.305717 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 12:14:08.305717 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 12:14:08.305717 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 12:14:08.305717 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 12:14:08.305717 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 12:14:08.305717 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 12:14:08.305717 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 12:14:08.305717 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 12:14:08.305717 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 12:14:08.305717 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 12:14:08.305717 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 12:14:08.306527 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 12:14:08.306527 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 12:14:08.306527 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application with Lock( Jun 16 12:14:08.306527 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 12:14:08.306527 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._enter() Jun 16 12:14:08.306527 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 12:14:08.306527 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 12:14:08.306527 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 12:14:08.306527 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.creator() Jun 16 12:14:08.306527 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 12:14:08.306527 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application created_value = creator( Jun 16 12:14:08.306527 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 12:14:08.306527 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 12:14:08.306527 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 16 12:14:08.306527 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application Jun 16 12:14:08.306527 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 375/768] 10.222.0.44 () {56 vars in 1129 bytes} [Thu Jun 16 12:14:08 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 12:14:08.309143 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27453d05-b2c2-4d98-bd0a-d94cce4f4be3 None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:08.309630 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27453d05-b2c2-4d98-bd0a-d94cce4f4be3 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:08.310104 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27453d05-b2c2-4d98-bd0a-d94cce4f4be3 None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:08.311765 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 394/769] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 12:14:08 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 12:14:08.313640 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5099a729-d46f-41f5-b51c-128c2549401e None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:14:08.314510 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27453d05-b2c2-4d98-bd0a-d94cce4f4be3 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:14:08.332965 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:14:08.383338 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:14:08.424820 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5099a729-d46f-41f5-b51c-128c2549401e None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:14:08.433289 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27453d05-b2c2-4d98-bd0a-d94cce4f4be3 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:14:08.461521 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750e8f51-51d7-492f-8538-0f99aab82e45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:14:08.462203 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750e8f51-51d7-492f-8538-0f99aab82e45 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:08.462486 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750e8f51-51d7-492f-8538-0f99aab82e45 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:08.462761 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750e8f51-51d7-492f-8538-0f99aab82e45 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:08.463589 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750e8f51-51d7-492f-8538-0f99aab82e45 None admin] RBAC: Adding query filter params (role.id=0688968254744e3f9913653cafea3091, scope.project.id=601361df39e34fcca71175aa94e425c4, user.id=c159f79c1921496487101aac5d530ae5) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:14:08.463928 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750e8f51-51d7-492f-8538-0f99aab82e45 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:14:08.465536 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750e8f51-51d7-492f-8538-0f99aab82e45 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:14:08.469791 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946e9af6-d9b8-42f9-93ba-9e26920e40b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:14:08.470459 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946e9af6-d9b8-42f9-93ba-9e26920e40b8 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:08.470791 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946e9af6-d9b8-42f9-93ba-9e26920e40b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:08.471069 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946e9af6-d9b8-42f9-93ba-9e26920e40b8 None admin] PATH_INFO: `/v3/services` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:08.471397 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 376/770] 10.222.0.44 () {56 vars in 1374 bytes} [Thu Jun 16 12:14:08 2022] GET /identity/v3/role_assignments?user.id=c159f79c1921496487101aac5d530ae5&scope.project.id=601361df39e34fcca71175aa94e425c4&role.id=0688968254744e3f9913653cafea3091 => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:14:08.471832 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946e9af6-d9b8-42f9-93ba-9e26920e40b8 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:14:08.472144 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946e9af6-d9b8-42f9-93ba-9e26920e40b8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:14:08.472604 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357f5109-5f5a-4964-a7ea-d8343067a891 None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:08.472947 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357f5109-5f5a-4964-a7ea-d8343067a891 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:08.473227 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357f5109-5f5a-4964-a7ea-d8343067a891 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:08.473640 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946e9af6-d9b8-42f9-93ba-9e26920e40b8 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:14:08.479825 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 395/771] 10.222.0.44 () {56 vars in 1124 bytes} [Thu Jun 16 12:14:08 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:14:08.485710 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946e9af6-d9b8-42f9-93ba-9e26920e40b8 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:14:08.495671 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-357f5109-5f5a-4964-a7ea-d8343067a891 None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:14:08.502730 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-357f5109-5f5a-4964-a7ea-d8343067a891 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:14:08.640435 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 377/772] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 12:14:08 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 12:14:08.694791 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357f5109-5f5a-4964-a7ea-d8343067a891 None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:14:08.698226 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:14:08.704634 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946e9af6-d9b8-42f9-93ba-9e26920e40b8 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:14:08.729284 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:14:08.743695 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed57b137-89d7-45b8-a7eb-3344c92282d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:14:08.744365 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed57b137-89d7-45b8-a7eb-3344c92282d1 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:08.744644 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed57b137-89d7-45b8-a7eb-3344c92282d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:08.747102 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed57b137-89d7-45b8-a7eb-3344c92282d1 None admin] PATH_INFO: `/v3/services` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:08.747825 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed57b137-89d7-45b8-a7eb-3344c92282d1 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:14:08.748137 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed57b137-89d7-45b8-a7eb-3344c92282d1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:14:08.749543 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed57b137-89d7-45b8-a7eb-3344c92282d1 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:14:08.767409 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 396/773] 10.222.0.44 () {56 vars in 1124 bytes} [Thu Jun 16 12:14:08 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 12:14:08.768264 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed57b137-89d7-45b8-a7eb-3344c92282d1 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:14:08.874396 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed57b137-89d7-45b8-a7eb-3344c92282d1 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:14:08.911648 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787d3452-6a8a-44b6-bb80-6b855837940f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:14:08.912319 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787d3452-6a8a-44b6-bb80-6b855837940f None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:08.912603 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787d3452-6a8a-44b6-bb80-6b855837940f None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:08.912914 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787d3452-6a8a-44b6-bb80-6b855837940f None admin] PATH_INFO: `/v3/endpoints` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:08.913716 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787d3452-6a8a-44b6-bb80-6b855837940f None admin] RBAC: Adding query filter params (interface=public, service_id=8ab8699eb58449a48fdd730d1ff5c0d1, region_id=RegionOne) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:14:08.914030 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787d3452-6a8a-44b6-bb80-6b855837940f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:14:08.915534 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787d3452-6a8a-44b6-bb80-6b855837940f None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:14:08.924795 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 397/774] 10.222.0.44 () {56 vars in 1251 bytes} [Thu Jun 16 12:14:08 2022] GET /identity/v3/endpoints?service_id=8ab8699eb58449a48fdd730d1ff5c0d1&interface=public®ion_id=RegionOne => generated 194 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:14:08.929867 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787d3452-6a8a-44b6-bb80-6b855837940f None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:14:08.970519 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357f5109-5f5a-4964-a7ea-d8343067a891 None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:14:08.992993 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:14:09.034184 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb82a96-a68b-47f5-b3e7-d8612fb68bf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:14:09.035339 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb82a96-a68b-47f5-b3e7-d8612fb68bf7 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:09.035628 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb82a96-a68b-47f5-b3e7-d8612fb68bf7 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:09.035897 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb82a96-a68b-47f5-b3e7-d8612fb68bf7 None admin] PATH_INFO: `/v3/services/network` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:09.036858 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb82a96-a68b-47f5-b3e7-d8612fb68bf7 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:14:09.038391 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb82a96-a68b-47f5-b3e7-d8612fb68bf7 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:14:09.061199 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application [None req-fbb82a96-a68b-47f5-b3e7-d8612fb68bf7 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 16 12:14:09.061199 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 12:14:09.061199 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 12:14:09.061199 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 12:14:09.061199 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 12:14:09.061199 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 12:14:09.061199 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 12:14:09.061199 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 12:14:09.061199 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 16 12:14:09.061199 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application Jun 16 12:14:09.061199 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 12:14:09.061199 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application Jun 16 12:14:09.061199 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 12:14:09.061199 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 12:14:09.061199 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 12:14:09.061199 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 12:14:09.061199 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 12:14:09.062198 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 12:14:09.062198 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 12:14:09.062198 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 12:14:09.062198 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 12:14:09.062198 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 12:14:09.062198 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 12:14:09.062198 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 12:14:09.062198 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 12:14:09.062198 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 12:14:09.062198 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 12:14:09.062198 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 12:14:09.062198 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 12:14:09.062198 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 12:14:09.062198 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 12:14:09.062198 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 12:14:09.062198 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 12:14:09.063054 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 12:14:09.063054 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application with Lock( Jun 16 12:14:09.063054 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 12:14:09.063054 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._enter() Jun 16 12:14:09.063054 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 12:14:09.063054 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 12:14:09.063054 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 12:14:09.063054 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.creator() Jun 16 12:14:09.063054 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 12:14:09.063054 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application created_value = creator( Jun 16 12:14:09.063054 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 12:14:09.063054 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 12:14:09.063054 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 16 12:14:09.063054 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application Jun 16 12:14:09.063054 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 378/775] 10.222.0.44 () {56 vars in 1111 bytes} [Thu Jun 16 12:14:08 2022] GET /identity/v3/services/network => generated 88 bytes in 368 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 12:14:09.065147 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787d3452-6a8a-44b6-bb80-6b855837940f None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:14:09.069254 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb82a96-a68b-47f5-b3e7-d8612fb68bf7 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:14:09.114860 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44213be-3e42-4431-8b16-cc7f530b587b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:14:09.115876 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44213be-3e42-4431-8b16-cc7f530b587b None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:09.116358 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44213be-3e42-4431-8b16-cc7f530b587b None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:09.116940 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44213be-3e42-4431-8b16-cc7f530b587b None admin] PATH_INFO: `/v3/services` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:09.117844 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44213be-3e42-4431-8b16-cc7f530b587b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:14:09.119474 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44213be-3e42-4431-8b16-cc7f530b587b None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:14:09.130269 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 398/776] 10.222.0.44 () {56 vars in 1087 bytes} [Thu Jun 16 12:14:08 2022] GET /identity/v3/services => generated 772 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 12:14:09.198563 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:14:09.254767 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb82a96-a68b-47f5-b3e7-d8612fb68bf7 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:14:09.298380 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5407a592-f188-4dbe-bec5-f9cb90a52272 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:14:09.299043 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5407a592-f188-4dbe-bec5-f9cb90a52272 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:09.299320 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5407a592-f188-4dbe-bec5-f9cb90a52272 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:09.299590 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5407a592-f188-4dbe-bec5-f9cb90a52272 None admin] PATH_INFO: `/v3/services` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:09.300297 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5407a592-f188-4dbe-bec5-f9cb90a52272 None admin] RBAC: Adding query filter params (name=network) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:14:09.300599 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5407a592-f188-4dbe-bec5-f9cb90a52272 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:14:09.302517 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5407a592-f188-4dbe-bec5-f9cb90a52272 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:14:09.307923 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 379/777] 10.222.0.44 () {56 vars in 1112 bytes} [Thu Jun 16 12:14:09 2022] GET /identity/v3/services?name=network => generated 124 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:14:09.313084 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44213be-3e42-4431-8b16-cc7f530b587b None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:14:09.421721 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44213be-3e42-4431-8b16-cc7f530b587b None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:14:09.436422 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:14:09.460358 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a43c6c-b692-4ac0-a692-409333f35f51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:14:09.461059 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a43c6c-b692-4ac0-a692-409333f35f51 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:09.461337 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a43c6c-b692-4ac0-a692-409333f35f51 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:09.461609 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a43c6c-b692-4ac0-a692-409333f35f51 None admin] PATH_INFO: `/v3/services` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:09.462313 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a43c6c-b692-4ac0-a692-409333f35f51 None admin] RBAC: Adding query filter params (type=network) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:14:09.462614 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a43c6c-b692-4ac0-a692-409333f35f51 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:14:09.464000 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a43c6c-b692-4ac0-a692-409333f35f51 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:14:09.469656 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 399/778] 10.222.0.44 () {56 vars in 1112 bytes} [Thu Jun 16 12:14:09 2022] GET /identity/v3/services?type=network => generated 350 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 12:14:09.477891 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5407a592-f188-4dbe-bec5-f9cb90a52272 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:14:09.600061 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5407a592-f188-4dbe-bec5-f9cb90a52272 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:14:09.634191 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479646f4-d788-4880-9bb2-0af018c0e817 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:14:09.634859 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479646f4-d788-4880-9bb2-0af018c0e817 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:09.635140 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479646f4-d788-4880-9bb2-0af018c0e817 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:09.635413 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479646f4-d788-4880-9bb2-0af018c0e817 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:09.636204 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479646f4-d788-4880-9bb2-0af018c0e817 None admin] RBAC: Adding query filter params (interface=public, service_id=8a88f68627ee44a7abf9f7fa4a59e939, region_id=RegionOne) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:14:09.636513 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479646f4-d788-4880-9bb2-0af018c0e817 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:14:09.636971 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:14:09.641458 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479646f4-d788-4880-9bb2-0af018c0e817 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:14:09.656630 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 380/779] 10.222.0.44 () {56 vars in 1251 bytes} [Thu Jun 16 12:14:09 2022] GET /identity/v3/endpoints?service_id=8a88f68627ee44a7abf9f7fa4a59e939&interface=public®ion_id=RegionOne => generated 194 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:14:09.662550 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a43c6c-b692-4ac0-a692-409333f35f51 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:14:09.776236 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c470514-12fb-439e-8237-4c9450b1463f None None] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:09.776584 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c470514-12fb-439e-8237-4c9450b1463f None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:09.776833 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c470514-12fb-439e-8237-4c9450b1463f None None] PATH_INFO: `/` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:09.778457 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 381/780] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 12:14:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 12:14:09.783602 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f66fc5e-6e89-4b06-a0a1-29142a435ebc None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:09.783886 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f66fc5e-6e89-4b06-a0a1-29142a435ebc None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:09.784164 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f66fc5e-6e89-4b06-a0a1-29142a435ebc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:09.801215 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-0f66fc5e-6e89-4b06-a0a1-29142a435ebc None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:14:09.802406 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-0f66fc5e-6e89-4b06-a0a1-29142a435ebc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:14:09.823608 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a43c6c-b692-4ac0-a692-409333f35f51 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:14:09.888862 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fcf713-c8c8-4035-bbc1-677f29eece39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:14:09.889458 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fcf713-c8c8-4035-bbc1-677f29eece39 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:09.889741 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fcf713-c8c8-4035-bbc1-677f29eece39 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:09.890017 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fcf713-c8c8-4035-bbc1-677f29eece39 None admin] PATH_INFO: `/v3/services` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:09.890685 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fcf713-c8c8-4035-bbc1-677f29eece39 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:14:09.892049 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fcf713-c8c8-4035-bbc1-677f29eece39 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:14:09.904240 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 400/781] 10.222.0.44 () {56 vars in 1087 bytes} [Thu Jun 16 12:14:09 2022] GET /identity/v3/services => generated 772 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:14:09.947638 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 382/782] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 12:14:09 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 16 12:14:09.986644 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fcf713-c8c8-4035-bbc1-677f29eece39 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:14:10.047147 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:14:10.106635 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fcf713-c8c8-4035-bbc1-677f29eece39 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:14:10.140843 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2de2961-91ea-457f-9915-178e24b44038 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:14:10.141576 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2de2961-91ea-457f-9915-178e24b44038 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:10.141857 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2de2961-91ea-457f-9915-178e24b44038 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:10.142122 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2de2961-91ea-457f-9915-178e24b44038 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:10.152597 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2de2961-91ea-457f-9915-178e24b44038 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 12:14:10.160225 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-e2de2961-91ea-457f-9915-178e24b44038 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 12:14:10.160225 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 12:14:10.160225 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 12:14:10.160225 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 12:14:10.160225 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 12:14:10.160225 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 12:14:10.160225 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 12:14:10.160225 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 12:14:10.160225 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 12:14:10.160225 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 12:14:10.160225 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 12:14:10.160225 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 12:14:10.160225 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 12:14:10.160225 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 12:14:10.160225 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 12:14:10.160225 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 12:14:10.161158 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 12:14:10.161158 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 12:14:10.161158 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 12:14:10.161158 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 12:14:10.161158 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 12:14:10.161158 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 12:14:10.161158 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 12:14:10.161158 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 12:14:10.161158 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 12:14:10.161158 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 12:14:10.161158 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 12:14:10.161158 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jun 16 12:14:10.161158 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 12:14:10.161158 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jun 16 12:14:10.161158 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 12:14:10.161158 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 12:14:10.162122 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 12:14:10.162122 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jun 16 12:14:10.162122 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 12:14:10.162122 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jun 16 12:14:10.162122 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 12:14:10.162122 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 12:14:10.162122 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 12:14:10.162122 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 12:14:10.162122 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 12:14:10.162122 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 12:14:10.162122 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 12:14:10.162122 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jun 16 12:14:10.162122 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 401/783] 10.222.0.44 () {56 vars in 1096 bytes} [Thu Jun 16 12:14:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 12:14:10.167226 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f66fc5e-6e89-4b06-a0a1-29142a435ebc None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:14:10.274437 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f66fc5e-6e89-4b06-a0a1-29142a435ebc None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:14:10.309441 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:14:10.319575 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1c5c6e-0195-415d-af8d-fbbcf25a40bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:14:10.320242 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1c5c6e-0195-415d-af8d-fbbcf25a40bf None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:10.320517 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1c5c6e-0195-415d-af8d-fbbcf25a40bf None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:10.320808 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1c5c6e-0195-415d-af8d-fbbcf25a40bf None admin] PATH_INFO: `/v3/roles` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:10.321555 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1c5c6e-0195-415d-af8d-fbbcf25a40bf None admin] RBAC: Adding query filter params (name=admin) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:14:10.321857 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1c5c6e-0195-415d-af8d-fbbcf25a40bf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:14:10.323214 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1c5c6e-0195-415d-af8d-fbbcf25a40bf None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:14:10.335875 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 383/784] 10.222.0.44 () {56 vars in 1099 bytes} [Thu Jun 16 12:14:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 12:14:10.341406 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2de2961-91ea-457f-9915-178e24b44038 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:14:10.363206 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd9001e-e542-489f-9ec7-e62f4d66091c None None] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:10.364067 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd9001e-e542-489f-9ec7-e62f4d66091c None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:10.364477 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd9001e-e542-489f-9ec7-e62f4d66091c None None] PATH_INFO: `/` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:10.366114 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 384/785] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 12:14:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 12:14:10.374488 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d376d476-5190-46a4-b594-a15e1651949d None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:10.374766 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d376d476-5190-46a4-b594-a15e1651949d None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:10.375045 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d376d476-5190-46a4-b594-a15e1651949d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:10.399187 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-d376d476-5190-46a4-b594-a15e1651949d None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:14:10.400304 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-d376d476-5190-46a4-b594-a15e1651949d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:14:10.510401 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 385/786] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 12:14:10 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 16 12:14:10.526523 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2de2961-91ea-457f-9915-178e24b44038 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:14:10.529079 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:14:10.556083 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d376d476-5190-46a4-b594-a15e1651949d None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:14:10.588589 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fc9c8f-0b88-4fec-970c-1040087c18ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:14:10.589421 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fc9c8f-0b88-4fec-970c-1040087c18ca None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:10.589697 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fc9c8f-0b88-4fec-970c-1040087c18ca None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:10.589967 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fc9c8f-0b88-4fec-970c-1040087c18ca None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:10.606633 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7fc9c8f-0b88-4fec-970c-1040087c18ca None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:14:10.608086 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7fc9c8f-0b88-4fec-970c-1040087c18ca None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:14:10.628783 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-b7fc9c8f-0b88-4fec-970c-1040087c18ca None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 12:14:10.628783 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 12:14:10.628783 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 12:14:10.628783 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 12:14:10.628783 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 12:14:10.628783 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 12:14:10.628783 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 12:14:10.628783 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 12:14:10.628783 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 12:14:10.628783 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 12:14:10.628783 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 12:14:10.628783 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 12:14:10.628783 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 12:14:10.628783 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 12:14:10.628783 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 12:14:10.629717 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 12:14:10.629717 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 12:14:10.629717 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 12:14:10.629717 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 12:14:10.629717 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 12:14:10.629717 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 12:14:10.629717 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 12:14:10.629717 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 12:14:10.629717 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jun 16 12:14:10.629717 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 12:14:10.629717 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jun 16 12:14:10.629717 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 12:14:10.629717 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 12:14:10.629717 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 12:14:10.629717 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jun 16 12:14:10.629717 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 12:14:10.629717 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jun 16 12:14:10.631188 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 12:14:10.631188 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 12:14:10.631188 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 12:14:10.631188 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jun 16 12:14:10.631188 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 402/787] 10.222.0.44 () {56 vars in 1108 bytes} [Thu Jun 16 12:14:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 12:14:10.635777 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fc9c8f-0b88-4fec-970c-1040087c18ca None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:14:10.700660 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d376d476-5190-46a4-b594-a15e1651949d None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:14:10.742238 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:14:10.767756 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fc9c8f-0b88-4fec-970c-1040087c18ca None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:14:10.804722 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b017f08-14dc-42c5-bf52-d084756d34a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:14:10.805511 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b017f08-14dc-42c5-bf52-d084756d34a5 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:10.805877 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b017f08-14dc-42c5-bf52-d084756d34a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:10.806154 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b017f08-14dc-42c5-bf52-d084756d34a5 None admin] PATH_INFO: `/v3/domains` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:10.806871 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b017f08-14dc-42c5-bf52-d084756d34a5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:14:10.807173 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b017f08-14dc-42c5-bf52-d084756d34a5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:14:10.808547 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b017f08-14dc-42c5-bf52-d084756d34a5 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:14:10.810039 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a095ecf4-d579-4026-992e-c9e99a5c5763 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:14:10.810848 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a095ecf4-d579-4026-992e-c9e99a5c5763 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:10.811132 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a095ecf4-d579-4026-992e-c9e99a5c5763 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:10.811401 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a095ecf4-d579-4026-992e-c9e99a5c5763 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:10.826749 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 403/788] 10.222.0.44 () {56 vars in 1109 bytes} [Thu Jun 16 12:14:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:14:10.832130 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b017f08-14dc-42c5-bf52-d084756d34a5 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:14:10.835299 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a095ecf4-d579-4026-992e-c9e99a5c5763 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 12:14:10.851362 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application [None req-a095ecf4-d579-4026-992e-c9e99a5c5763 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 16 12:14:10.851362 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 12:14:10.851362 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 12:14:10.851362 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 12:14:10.851362 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 12:14:10.851362 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 12:14:10.851362 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 12:14:10.851362 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 12:14:10.851362 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 12:14:10.851362 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 12:14:10.851362 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 12:14:10.851362 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 12:14:10.851362 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 12:14:10.851362 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 12:14:10.851362 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 12:14:10.851362 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 12:14:10.852291 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 12:14:10.852291 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 12:14:10.852291 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 12:14:10.852291 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 12:14:10.852291 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 12:14:10.852291 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 12:14:10.852291 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 12:14:10.852291 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 12:14:10.852291 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 12:14:10.852291 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 12:14:10.852291 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 12:14:10.852291 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application with Lock( Jun 16 12:14:10.852291 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 12:14:10.852291 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._enter() Jun 16 12:14:10.852291 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 12:14:10.852291 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 12:14:10.853152 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 12:14:10.853152 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.creator() Jun 16 12:14:10.853152 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 12:14:10.853152 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application created_value = creator( Jun 16 12:14:10.853152 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 12:14:10.853152 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 12:14:10.853152 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 12:14:10.853152 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 12:14:10.853152 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 12:14:10.853152 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 12:14:10.853152 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 16 12:14:10.853152 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application Jun 16 12:14:10.857856 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 386/789] 10.222.0.44 () {56 vars in 1102 bytes} [Thu Jun 16 12:14:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 12:14:10.862625 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:14:10.862962 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a095ecf4-d579-4026-992e-c9e99a5c5763 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:14:10.981383 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a095ecf4-d579-4026-992e-c9e99a5c5763 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:14:11.009165 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b017f08-14dc-42c5-bf52-d084756d34a5 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:14:11.016383 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46507e5c-4f69-47f1-ad0b-84081c8caba0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:14:11.017076 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46507e5c-4f69-47f1-ad0b-84081c8caba0 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:11.017366 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46507e5c-4f69-47f1-ad0b-84081c8caba0 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:11.017618 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46507e5c-4f69-47f1-ad0b-84081c8caba0 None admin] PATH_INFO: `/v3/roles` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:11.018360 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46507e5c-4f69-47f1-ad0b-84081c8caba0 None admin] RBAC: Adding query filter params (name=service) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:14:11.018662 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46507e5c-4f69-47f1-ad0b-84081c8caba0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:14:11.020146 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46507e5c-4f69-47f1-ad0b-84081c8caba0 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:14:11.028656 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 387/790] 10.222.0.44 () {56 vars in 1103 bytes} [Thu Jun 16 12:14:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 12:14:11.029932 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79a1ee1-9c18-405e-b7ca-e25a2fb619af None None] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:11.030212 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79a1ee1-9c18-405e-b7ca-e25a2fb619af None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:11.030482 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79a1ee1-9c18-405e-b7ca-e25a2fb619af None None] PATH_INFO: `/` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:11.031931 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 388/791] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 12:14:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 12:14:11.033521 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79a1ee1-9c18-405e-b7ca-e25a2fb619af None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:14:11.049872 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3bfc3a-be29-4763-a9c5-0079e4d0f957 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:14:11.050723 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3bfc3a-be29-4763-a9c5-0079e4d0f957 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:11.051548 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3bfc3a-be29-4763-a9c5-0079e4d0f957 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:11.051821 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3bfc3a-be29-4763-a9c5-0079e4d0f957 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:11.060111 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3bfc3a-be29-4763-a9c5-0079e4d0f957 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:14:11.061645 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3bfc3a-be29-4763-a9c5-0079e4d0f957 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:14:11.076636 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-6b3bfc3a-be29-4763-a9c5-0079e4d0f957 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 16 12:14:11.076636 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 12:14:11.076636 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 12:14:11.076636 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 12:14:11.076636 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 12:14:11.076636 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 12:14:11.076636 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 12:14:11.076636 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 12:14:11.076636 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 12:14:11.076636 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 12:14:11.076636 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 12:14:11.076636 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 12:14:11.076636 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 12:14:11.076636 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 12:14:11.076636 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 12:14:11.076636 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 12:14:11.077614 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 12:14:11.077614 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 12:14:11.077614 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 12:14:11.077614 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 12:14:11.077614 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 12:14:11.077614 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 12:14:11.077614 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 12:14:11.077614 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 12:14:11.077614 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 12:14:11.077614 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 12:14:11.077614 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 12:14:11.077614 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jun 16 12:14:11.077614 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 12:14:11.077614 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jun 16 12:14:11.077614 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 12:14:11.077614 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 12:14:11.077614 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 12:14:11.077614 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jun 16 12:14:11.078547 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 12:14:11.078547 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jun 16 12:14:11.078547 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 12:14:11.078547 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 12:14:11.078547 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 12:14:11.078547 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 12:14:11.078547 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 12:14:11.078547 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 12:14:11.078547 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 16 12:14:11.078547 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jun 16 12:14:11.078547 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 404/792] 10.222.0.44 () {56 vars in 1093 bytes} [Thu Jun 16 12:14:10 2022] GET /identity/v3/users/nova => generated 82 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 12:14:11.079602 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9bd289-f24d-4e71-9792-81b2c6192756 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:11.079774 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9bd289-f24d-4e71-9792-81b2c6192756 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:11.079920 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9bd289-f24d-4e71-9792-81b2c6192756 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:11.080121 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:14:11.099147 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-6a9bd289-f24d-4e71-9792-81b2c6192756 None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:14:11.100569 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-6a9bd289-f24d-4e71-9792-81b2c6192756 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:14:11.146760 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79a1ee1-9c18-405e-b7ca-e25a2fb619af None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:14:11.180876 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 405/793] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 12:14:11 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 12:14:11.182011 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9bd289-f24d-4e71-9792-81b2c6192756 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:14:11.186596 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b086bec-d81b-42a7-81c3-c19d6d94baf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:14:11.187980 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b086bec-d81b-42a7-81c3-c19d6d94baf2 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:11.188397 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b086bec-d81b-42a7-81c3-c19d6d94baf2 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:11.188850 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b086bec-d81b-42a7-81c3-c19d6d94baf2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:11.199691 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b086bec-d81b-42a7-81c3-c19d6d94baf2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:14:11.201383 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b086bec-d81b-42a7-81c3-c19d6d94baf2 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:14:11.203055 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:14:11.222341 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application [None req-2b086bec-d81b-42a7-81c3-c19d6d94baf2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 12:14:11.222341 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 12:14:11.222341 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 12:14:11.222341 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 12:14:11.222341 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 12:14:11.222341 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 12:14:11.222341 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 12:14:11.222341 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 12:14:11.222341 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 12:14:11.222341 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 12:14:11.222341 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 12:14:11.222341 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 12:14:11.222341 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 12:14:11.222341 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 12:14:11.222341 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 12:14:11.223923 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 12:14:11.223923 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 12:14:11.223923 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 12:14:11.223923 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 12:14:11.223923 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 12:14:11.223923 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 12:14:11.223923 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 12:14:11.223923 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 12:14:11.223923 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application with Lock( Jun 16 12:14:11.223923 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 12:14:11.223923 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._enter() Jun 16 12:14:11.223923 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 12:14:11.223923 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 12:14:11.223923 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 12:14:11.223923 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.creator() Jun 16 12:14:11.223923 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 12:14:11.223923 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application created_value = creator( Jun 16 12:14:11.224835 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 12:14:11.224835 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 12:14:11.224835 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 12:14:11.224835 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application Jun 16 12:14:11.224835 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 389/794] 10.222.0.44 () {56 vars in 1108 bytes} [Thu Jun 16 12:14:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 12:14:11.229552 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b086bec-d81b-42a7-81c3-c19d6d94baf2 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:14:11.301869 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9bd289-f24d-4e71-9792-81b2c6192756 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:14:11.322522 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:14:11.331591 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b086bec-d81b-42a7-81c3-c19d6d94baf2 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:14:11.339475 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cd1ea7-f94b-4151-859d-d8084e3862f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:14:11.340379 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cd1ea7-f94b-4151-859d-d8084e3862f1 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:11.340850 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cd1ea7-f94b-4151-859d-d8084e3862f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:11.341374 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cd1ea7-f94b-4151-859d-d8084e3862f1 None admin] PATH_INFO: `/v3/users` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:11.342357 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1cd1ea7-f94b-4151-859d-d8084e3862f1 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:14:11.342930 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1cd1ea7-f94b-4151-859d-d8084e3862f1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:14:11.344503 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1cd1ea7-f94b-4151-859d-d8084e3862f1 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:14:11.364936 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 406/795] 10.222.0.44 () {56 vars in 1133 bytes} [Thu Jun 16 12:14:11 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:14:11.366159 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cd1ea7-f94b-4151-859d-d8084e3862f1 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:14:11.367911 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff96da46-8416-441c-b219-8fe63c849845 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:14:11.368797 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff96da46-8416-441c-b219-8fe63c849845 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:11.369409 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff96da46-8416-441c-b219-8fe63c849845 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:11.369588 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff96da46-8416-441c-b219-8fe63c849845 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:11.380607 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff96da46-8416-441c-b219-8fe63c849845 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 12:14:11.388477 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application [None req-ff96da46-8416-441c-b219-8fe63c849845 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 12:14:11.388477 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 12:14:11.388477 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 12:14:11.388477 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 12:14:11.388477 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 12:14:11.388477 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 12:14:11.388477 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 12:14:11.388477 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 12:14:11.388477 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 12:14:11.388477 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 12:14:11.388477 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 12:14:11.388477 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 12:14:11.388477 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 12:14:11.388477 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 12:14:11.388477 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 12:14:11.388477 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 12:14:11.389431 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 12:14:11.389431 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 12:14:11.389431 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 12:14:11.389431 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 12:14:11.389431 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 12:14:11.389431 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 12:14:11.389431 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 12:14:11.389431 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 12:14:11.389431 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 12:14:11.389431 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 12:14:11.389431 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 12:14:11.389431 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application with Lock( Jun 16 12:14:11.389431 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 12:14:11.389431 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._enter() Jun 16 12:14:11.389431 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 12:14:11.389431 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 12:14:11.390667 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 12:14:11.390667 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.creator() Jun 16 12:14:11.390667 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 12:14:11.390667 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application created_value = creator( Jun 16 12:14:11.390667 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 12:14:11.390667 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 12:14:11.390667 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 12:14:11.390667 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 12:14:11.390667 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 12:14:11.390667 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 12:14:11.390667 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 12:14:11.390667 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application Jun 16 12:14:11.395601 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 390/796] 10.222.0.44 () {56 vars in 1096 bytes} [Thu Jun 16 12:14:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 12:14:11.396619 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff96da46-8416-441c-b219-8fe63c849845 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:14:11.445147 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:14:11.480873 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cd1ea7-f94b-4151-859d-d8084e3862f1 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:14:11.506621 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff96da46-8416-441c-b219-8fe63c849845 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:14:11.517930 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e4e849-90d3-40ed-8da5-7cba4a8035dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:14:11.519056 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e4e849-90d3-40ed-8da5-7cba4a8035dc None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:11.520217 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e4e849-90d3-40ed-8da5-7cba4a8035dc None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:11.520697 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e4e849-90d3-40ed-8da5-7cba4a8035dc None admin] PATH_INFO: `/v3/domains` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:11.522026 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e4e849-90d3-40ed-8da5-7cba4a8035dc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:14:11.522535 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e4e849-90d3-40ed-8da5-7cba4a8035dc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:14:11.524219 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e4e849-90d3-40ed-8da5-7cba4a8035dc None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:14:11.537912 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 407/797] 10.222.0.44 () {56 vars in 1109 bytes} [Thu Jun 16 12:14:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:14:11.539122 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e4e849-90d3-40ed-8da5-7cba4a8035dc None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:14:11.554323 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65cde7d-96d1-4067-985e-4810415495a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:14:11.555658 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65cde7d-96d1-4067-985e-4810415495a1 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:11.556160 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65cde7d-96d1-4067-985e-4810415495a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:11.556941 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65cde7d-96d1-4067-985e-4810415495a1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:11.585920 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:14:11.647077 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65cde7d-96d1-4067-985e-4810415495a1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:14:11.648634 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65cde7d-96d1-4067-985e-4810415495a1 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:14:11.653626 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e4e849-90d3-40ed-8da5-7cba4a8035dc None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:14:11.678315 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:14:11.691664 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb33b74f-66f5-4d3c-8015-ff6c9118986c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:14:11.692336 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb33b74f-66f5-4d3c-8015-ff6c9118986c None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:11.692665 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb33b74f-66f5-4d3c-8015-ff6c9118986c None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:11.692988 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb33b74f-66f5-4d3c-8015-ff6c9118986c None admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:11.693728 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb33b74f-66f5-4d3c-8015-ff6c9118986c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:14:11.694041 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb33b74f-66f5-4d3c-8015-ff6c9118986c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:14:11.695534 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb33b74f-66f5-4d3c-8015-ff6c9118986c None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:14:11.704324 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 408/798] 10.222.0.44 () {56 vars in 1099 bytes} [Thu Jun 16 12:14:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:14:11.705162 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb33b74f-66f5-4d3c-8015-ff6c9118986c None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:14:11.781908 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 391/799] 10.222.0.44 () {58 vars in 1282 bytes} [Thu Jun 16 12:14:11 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 16 12:14:11.784015 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65cde7d-96d1-4067-985e-4810415495a1 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:14:11.815670 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb33b74f-66f5-4d3c-8015-ff6c9118986c None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:14:11.849491 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:14:11.853065 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d72c8e-e4e0-458b-9dd1-2215f7dd566b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:14:11.853891 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d72c8e-e4e0-458b-9dd1-2215f7dd566b None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:11.854174 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d72c8e-e4e0-458b-9dd1-2215f7dd566b None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:11.854443 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d72c8e-e4e0-458b-9dd1-2215f7dd566b None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:11.862512 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d72c8e-e4e0-458b-9dd1-2215f7dd566b None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:14:11.863959 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d72c8e-e4e0-458b-9dd1-2215f7dd566b None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:14:11.879450 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-45d72c8e-e4e0-458b-9dd1-2215f7dd566b None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 16 12:14:11.879450 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 12:14:11.879450 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 12:14:11.879450 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 12:14:11.879450 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 12:14:11.879450 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 12:14:11.879450 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 12:14:11.879450 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 12:14:11.879450 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 12:14:11.879450 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 12:14:11.879450 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 12:14:11.879450 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 12:14:11.879450 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 12:14:11.879450 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 12:14:11.879450 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 12:14:11.879450 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 12:14:11.880466 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 12:14:11.880466 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 12:14:11.880466 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 12:14:11.880466 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 12:14:11.880466 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 12:14:11.880466 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 12:14:11.880466 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 12:14:11.880466 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 12:14:11.880466 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 12:14:11.880466 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 12:14:11.880466 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 12:14:11.880466 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jun 16 12:14:11.880466 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 12:14:11.880466 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jun 16 12:14:11.880466 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 12:14:11.880466 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 12:14:11.880466 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 12:14:11.880466 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jun 16 12:14:11.881447 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 12:14:11.881447 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jun 16 12:14:11.881447 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 12:14:11.881447 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 12:14:11.881447 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 12:14:11.881447 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 12:14:11.881447 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 12:14:11.881447 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 12:14:11.881447 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 16 12:14:11.881447 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jun 16 12:14:11.881447 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 409/800] 10.222.0.44 () {56 vars in 1117 bytes} [Thu Jun 16 12:14:11 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 12:14:11.881447 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d72c8e-e4e0-458b-9dd1-2215f7dd566b None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:14:11.906382 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65cde7d-96d1-4067-985e-4810415495a1 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:14:11.934758 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:14:11.950794 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c8bfc9-0792-44ae-a124-423347ab7e90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:14:11.951694 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c8bfc9-0792-44ae-a124-423347ab7e90 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:11.951979 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c8bfc9-0792-44ae-a124-423347ab7e90 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:11.952243 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c8bfc9-0792-44ae-a124-423347ab7e90 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:11.963308 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c8bfc9-0792-44ae-a124-423347ab7e90 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:14:11.964733 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c8bfc9-0792-44ae-a124-423347ab7e90 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:14:11.981976 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application [None req-23c8bfc9-0792-44ae-a124-423347ab7e90 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 12:14:11.981976 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 12:14:11.981976 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 12:14:11.981976 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 12:14:11.981976 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 12:14:11.981976 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 12:14:11.981976 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 12:14:11.981976 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 12:14:11.981976 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 12:14:11.981976 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 12:14:11.981976 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 12:14:11.981976 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 12:14:11.981976 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 12:14:11.981976 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 12:14:11.981976 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 12:14:11.982912 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 12:14:11.982912 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 12:14:11.982912 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 12:14:11.982912 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 12:14:11.982912 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 12:14:11.982912 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 12:14:11.982912 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 12:14:11.982912 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 12:14:11.982912 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application with Lock( Jun 16 12:14:11.982912 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 12:14:11.982912 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._enter() Jun 16 12:14:11.982912 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 12:14:11.982912 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 12:14:11.982912 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 12:14:11.982912 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.creator() Jun 16 12:14:11.982912 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 12:14:11.982912 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application created_value = creator( Jun 16 12:14:11.983767 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 12:14:11.983767 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 12:14:11.983767 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 12:14:11.983767 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application Jun 16 12:14:11.983767 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 392/801] 10.222.0.44 () {56 vars in 1108 bytes} [Thu Jun 16 12:14:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 12:14:11.984897 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f33bae-7ab4-404b-ae35-19ea186ff11d None None] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:11.985079 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f33bae-7ab4-404b-ae35-19ea186ff11d None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:11.985315 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f33bae-7ab4-404b-ae35-19ea186ff11d None None] PATH_INFO: `/` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:11.986761 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 393/802] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 12:14:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 12:14:11.987302 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f33bae-7ab4-404b-ae35-19ea186ff11d None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:14:12.000013 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d72c8e-e4e0-458b-9dd1-2215f7dd566b None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:14:12.037668 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783c9544-5800-48f8-af00-404d46fd3df6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:14:12.038573 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783c9544-5800-48f8-af00-404d46fd3df6 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:12.038966 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783c9544-5800-48f8-af00-404d46fd3df6 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:12.039254 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783c9544-5800-48f8-af00-404d46fd3df6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:12.051059 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783c9544-5800-48f8-af00-404d46fd3df6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:14:12.052611 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783c9544-5800-48f8-af00-404d46fd3df6 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:14:12.071233 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-783c9544-5800-48f8-af00-404d46fd3df6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 12:14:12.071233 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 12:14:12.071233 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 12:14:12.071233 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 12:14:12.071233 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 12:14:12.071233 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 12:14:12.071233 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 12:14:12.071233 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 12:14:12.071233 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 12:14:12.071233 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 12:14:12.071233 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 12:14:12.071233 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 12:14:12.071233 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 12:14:12.071233 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 12:14:12.071233 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 12:14:12.072136 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 12:14:12.072136 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 12:14:12.072136 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 12:14:12.072136 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 12:14:12.072136 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 12:14:12.072136 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 12:14:12.072136 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 12:14:12.072136 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 12:14:12.072136 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jun 16 12:14:12.072136 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 12:14:12.072136 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jun 16 12:14:12.072136 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 12:14:12.072136 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 12:14:12.072136 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 12:14:12.072136 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jun 16 12:14:12.072136 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 12:14:12.072136 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jun 16 12:14:12.073050 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 12:14:12.073050 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 12:14:12.073050 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 12:14:12.073050 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jun 16 12:14:12.073050 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 410/803] 10.222.0.44 () {56 vars in 1108 bytes} [Thu Jun 16 12:14:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 12:14:12.073346 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783c9544-5800-48f8-af00-404d46fd3df6 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:14:12.094203 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f33bae-7ab4-404b-ae35-19ea186ff11d None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:14:12.096491 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:14:12.132095 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fb105b-a629-4834-819a-59f1045d52d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:14:12.132896 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fb105b-a629-4834-819a-59f1045d52d9 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:12.133173 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fb105b-a629-4834-819a-59f1045d52d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:12.133439 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fb105b-a629-4834-819a-59f1045d52d9 None admin] PATH_INFO: `/v3/users` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:12.134270 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fb105b-a629-4834-819a-59f1045d52d9 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:14:12.134577 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fb105b-a629-4834-819a-59f1045d52d9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:14:12.135990 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fb105b-a629-4834-819a-59f1045d52d9 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:14:12.155059 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 394/804] 10.222.0.44 () {56 vars in 1149 bytes} [Thu Jun 16 12:14:11 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:14:12.156163 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3dd5d3-0768-478d-9b02-27297db7fe7c None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:12.156454 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3dd5d3-0768-478d-9b02-27297db7fe7c None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:12.156729 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3dd5d3-0768-478d-9b02-27297db7fe7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:12.174222 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-8c3dd5d3-0768-478d-9b02-27297db7fe7c None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:14:12.175404 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-8c3dd5d3-0768-478d-9b02-27297db7fe7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:14:12.180250 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:14:12.188403 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783c9544-5800-48f8-af00-404d46fd3df6 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:14:12.222731 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429ae6d9-853c-4c15-b12a-dc40174d9006 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:14:12.223383 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429ae6d9-853c-4c15-b12a-dc40174d9006 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:12.223659 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429ae6d9-853c-4c15-b12a-dc40174d9006 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:12.223928 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429ae6d9-853c-4c15-b12a-dc40174d9006 None admin] PATH_INFO: `/v3/domains` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:12.224638 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429ae6d9-853c-4c15-b12a-dc40174d9006 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:14:12.224962 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429ae6d9-853c-4c15-b12a-dc40174d9006 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:14:12.226316 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429ae6d9-853c-4c15-b12a-dc40174d9006 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:14:12.237708 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 411/805] 10.222.0.44 () {56 vars in 1109 bytes} [Thu Jun 16 12:14:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:14:12.239009 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429ae6d9-853c-4c15-b12a-dc40174d9006 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:14:12.250206 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 395/806] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 12:14:12 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 12:14:12.251543 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3dd5d3-0768-478d-9b02-27297db7fe7c None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:14:12.345709 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:14:12.352623 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429ae6d9-853c-4c15-b12a-dc40174d9006 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:14:12.356397 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3dd5d3-0768-478d-9b02-27297db7fe7c None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:14:12.387562 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0fb23b-968d-4308-8e23-bfc94be08d79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:14:12.388226 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0fb23b-968d-4308-8e23-bfc94be08d79 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:12.388508 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0fb23b-968d-4308-8e23-bfc94be08d79 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:12.388811 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0fb23b-968d-4308-8e23-bfc94be08d79 None admin] PATH_INFO: `/v3/domains` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:12.389531 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0fb23b-968d-4308-8e23-bfc94be08d79 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:14:12.389834 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0fb23b-968d-4308-8e23-bfc94be08d79 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:14:12.391260 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0fb23b-968d-4308-8e23-bfc94be08d79 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:14:12.396405 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0700d8-9680-48db-ba6b-fbe596a4fbe7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:14:12.397242 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0700d8-9680-48db-ba6b-fbe596a4fbe7 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:12.397517 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0700d8-9680-48db-ba6b-fbe596a4fbe7 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:12.397779 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0700d8-9680-48db-ba6b-fbe596a4fbe7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:12.403548 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 412/807] 10.222.0.44 () {56 vars in 1109 bytes} [Thu Jun 16 12:14:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:14:12.404428 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0fb23b-968d-4308-8e23-bfc94be08d79 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:14:12.413512 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0700d8-9680-48db-ba6b-fbe596a4fbe7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:14:12.415009 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0700d8-9680-48db-ba6b-fbe596a4fbe7 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:14:12.429966 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:14:12.435536 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application [None req-5b0700d8-9680-48db-ba6b-fbe596a4fbe7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 12:14:12.435536 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 12:14:12.435536 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 12:14:12.435536 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 12:14:12.435536 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 12:14:12.435536 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 12:14:12.435536 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 12:14:12.435536 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 12:14:12.435536 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 12:14:12.435536 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 12:14:12.435536 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 12:14:12.435536 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 12:14:12.435536 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 12:14:12.435536 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 12:14:12.435536 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 12:14:12.436488 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 12:14:12.436488 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 12:14:12.436488 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 12:14:12.436488 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 12:14:12.436488 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 12:14:12.436488 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 12:14:12.436488 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 12:14:12.436488 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 12:14:12.436488 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application with Lock( Jun 16 12:14:12.436488 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 12:14:12.436488 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._enter() Jun 16 12:14:12.436488 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 12:14:12.436488 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 12:14:12.436488 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 12:14:12.436488 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.creator() Jun 16 12:14:12.436488 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 12:14:12.436488 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application created_value = creator( Jun 16 12:14:12.437396 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 12:14:12.437396 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 12:14:12.437396 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 12:14:12.437396 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application Jun 16 12:14:12.437396 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 396/808] 10.222.0.44 () {56 vars in 1108 bytes} [Thu Jun 16 12:14:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 12:14:12.438269 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0700d8-9680-48db-ba6b-fbe596a4fbe7 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:14:12.518873 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0fb23b-968d-4308-8e23-bfc94be08d79 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:14:12.541688 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0700d8-9680-48db-ba6b-fbe596a4fbe7 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:14:12.552542 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b7f952-2aa4-44ec-875d-bdc968c1d69c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:14:12.553356 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b7f952-2aa4-44ec-875d-bdc968c1d69c None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:12.553634 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b7f952-2aa4-44ec-875d-bdc968c1d69c None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:12.553902 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b7f952-2aa4-44ec-875d-bdc968c1d69c None admin] PATH_INFO: `/v3/users/swift` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:12.561903 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b7f952-2aa4-44ec-875d-bdc968c1d69c None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:14:12.563387 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b7f952-2aa4-44ec-875d-bdc968c1d69c None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:14:12.575841 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00107411-5c19-4da5-a8c3-0211538b83d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:14:12.576639 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00107411-5c19-4da5-a8c3-0211538b83d0 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:12.576948 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00107411-5c19-4da5-a8c3-0211538b83d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:12.577221 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00107411-5c19-4da5-a8c3-0211538b83d0 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:12.577863 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00107411-5c19-4da5-a8c3-0211538b83d0 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:14:12.578048 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-45b7f952-2aa4-44ec-875d-bdc968c1d69c None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 16 12:14:12.578048 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 12:14:12.578048 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 12:14:12.578048 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 12:14:12.578048 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 12:14:12.578048 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 12:14:12.578048 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 12:14:12.578048 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 12:14:12.578048 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 12:14:12.578048 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 12:14:12.578048 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 12:14:12.578048 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 12:14:12.578048 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 12:14:12.578048 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 12:14:12.578048 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 12:14:12.578048 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 12:14:12.579032 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 12:14:12.579032 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 12:14:12.579032 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 12:14:12.579032 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 12:14:12.579032 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 12:14:12.579032 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 12:14:12.579032 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 12:14:12.579032 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 12:14:12.579032 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 12:14:12.579032 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 12:14:12.579032 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 12:14:12.579032 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jun 16 12:14:12.579032 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 12:14:12.579032 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jun 16 12:14:12.579032 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 12:14:12.579032 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 12:14:12.579032 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 12:14:12.579032 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jun 16 12:14:12.579932 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 12:14:12.579932 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jun 16 12:14:12.579932 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 12:14:12.579932 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 12:14:12.579932 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 12:14:12.579932 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 12:14:12.579932 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 12:14:12.579932 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 12:14:12.579932 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 16 12:14:12.579932 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jun 16 12:14:12.580443 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00107411-5c19-4da5-a8c3-0211538b83d0 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:14:12.580510 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 413/809] 10.222.0.44 () {56 vars in 1096 bytes} [Thu Jun 16 12:14:12 2022] GET /identity/v3/users/swift => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 12:14:12.580510 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b7f952-2aa4-44ec-875d-bdc968c1d69c None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:14:12.594495 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application [None req-00107411-5c19-4da5-a8c3-0211538b83d0 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 16 12:14:12.594495 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 12:14:12.594495 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 12:14:12.594495 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 12:14:12.594495 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 12:14:12.594495 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 12:14:12.594495 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 12:14:12.594495 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 12:14:12.594495 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 16 12:14:12.594495 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application Jun 16 12:14:12.594495 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 12:14:12.594495 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application Jun 16 12:14:12.594495 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 12:14:12.594495 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 12:14:12.594495 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 12:14:12.594495 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 12:14:12.595427 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 12:14:12.595427 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 12:14:12.595427 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 12:14:12.595427 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 12:14:12.595427 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 12:14:12.595427 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 12:14:12.595427 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 12:14:12.595427 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 12:14:12.595427 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 12:14:12.595427 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 12:14:12.595427 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 12:14:12.595427 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 12:14:12.595427 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 12:14:12.595427 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 12:14:12.595427 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 12:14:12.595427 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 12:14:12.596270 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 12:14:12.596270 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 12:14:12.596270 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application with Lock( Jun 16 12:14:12.596270 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 12:14:12.596270 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._enter() Jun 16 12:14:12.596270 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 12:14:12.596270 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 12:14:12.596270 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 12:14:12.596270 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.creator() Jun 16 12:14:12.596270 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 12:14:12.596270 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application created_value = creator( Jun 16 12:14:12.596270 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 12:14:12.596270 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 12:14:12.596270 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 16 12:14:12.596270 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application Jun 16 12:14:12.596270 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 397/810] 10.222.0.44 () {56 vars in 1129 bytes} [Thu Jun 16 12:14:12 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 12:14:12.597145 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00107411-5c19-4da5-a8c3-0211538b83d0 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:14:12.610823 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:14:12.658028 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:14:12.681809 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b7f952-2aa4-44ec-875d-bdc968c1d69c None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:14:12.698902 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00107411-5c19-4da5-a8c3-0211538b83d0 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:14:12.714569 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b061e969-2a91-49df-8c05-e0264ceb96ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:14:12.715358 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b061e969-2a91-49df-8c05-e0264ceb96ee None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:12.715642 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b061e969-2a91-49df-8c05-e0264ceb96ee None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:12.715912 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b061e969-2a91-49df-8c05-e0264ceb96ee None admin] PATH_INFO: `/v3/projects/service` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:12.722504 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b061e969-2a91-49df-8c05-e0264ceb96ee None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:14:12.724470 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b061e969-2a91-49df-8c05-e0264ceb96ee None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:14:12.732612 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fba455-bd91-435b-bd7f-e6aff5ad6541 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:14:12.733298 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fba455-bd91-435b-bd7f-e6aff5ad6541 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:12.733579 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fba455-bd91-435b-bd7f-e6aff5ad6541 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:12.733851 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fba455-bd91-435b-bd7f-e6aff5ad6541 None admin] PATH_INFO: `/v3/domains` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:12.734563 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fba455-bd91-435b-bd7f-e6aff5ad6541 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:14:12.734865 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fba455-bd91-435b-bd7f-e6aff5ad6541 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:14:12.736195 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fba455-bd91-435b-bd7f-e6aff5ad6541 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:14:12.738975 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-b061e969-2a91-49df-8c05-e0264ceb96ee None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 12:14:12.738975 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 12:14:12.738975 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 12:14:12.738975 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 12:14:12.738975 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 12:14:12.738975 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 12:14:12.738975 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 12:14:12.738975 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 12:14:12.738975 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 12:14:12.738975 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 12:14:12.738975 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 12:14:12.738975 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 12:14:12.738975 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 12:14:12.738975 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 12:14:12.738975 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 12:14:12.739830 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 12:14:12.739830 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 12:14:12.739830 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 12:14:12.739830 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 12:14:12.739830 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 12:14:12.739830 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 12:14:12.739830 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 12:14:12.739830 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 12:14:12.739830 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jun 16 12:14:12.739830 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 12:14:12.739830 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jun 16 12:14:12.739830 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 12:14:12.739830 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 12:14:12.739830 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 12:14:12.739830 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jun 16 12:14:12.739830 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 12:14:12.739830 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jun 16 12:14:12.740708 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 12:14:12.740708 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 12:14:12.740708 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 12:14:12.740708 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 12:14:12.740708 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 12:14:12.740708 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 12:14:12.740708 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 12:14:12.740708 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jun 16 12:14:12.740708 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 414/811] 10.222.0.44 () {56 vars in 1111 bytes} [Thu Jun 16 12:14:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 12:14:12.741570 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573f4c82-86a8-4a36-a0c3-5e51d59d81d8 None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:12.741669 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573f4c82-86a8-4a36-a0c3-5e51d59d81d8 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:12.741874 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573f4c82-86a8-4a36-a0c3-5e51d59d81d8 None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:12.743308 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 415/812] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 12:14:12 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 12:14:12.745170 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573f4c82-86a8-4a36-a0c3-5e51d59d81d8 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:14:12.750353 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 398/813] 10.222.0.44 () {56 vars in 1109 bytes} [Thu Jun 16 12:14:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:14:12.751166 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fba455-bd91-435b-bd7f-e6aff5ad6541 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:14:12.816496 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:14:12.846779 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573f4c82-86a8-4a36-a0c3-5e51d59d81d8 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:14:12.848418 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fba455-bd91-435b-bd7f-e6aff5ad6541 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:14:12.879891 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4442f0da-0dbf-43b1-90b0-84077dce2122 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:14:12.880549 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4442f0da-0dbf-43b1-90b0-84077dce2122 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:12.880860 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4442f0da-0dbf-43b1-90b0-84077dce2122 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:12.881128 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4442f0da-0dbf-43b1-90b0-84077dce2122 None admin] PATH_INFO: `/v3/users` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:12.881347 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9610e1a-5028-4908-ab31-2a22546c8528 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:14:12.881950 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4442f0da-0dbf-43b1-90b0-84077dce2122 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:14:12.882065 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9610e1a-5028-4908-ab31-2a22546c8528 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:12.882254 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4442f0da-0dbf-43b1-90b0-84077dce2122 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:14:12.882347 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9610e1a-5028-4908-ab31-2a22546c8528 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:12.882546 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9610e1a-5028-4908-ab31-2a22546c8528 None admin] PATH_INFO: `/v3/services` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:12.883242 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9610e1a-5028-4908-ab31-2a22546c8528 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:14:12.883547 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9610e1a-5028-4908-ab31-2a22546c8528 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:14:12.883673 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4442f0da-0dbf-43b1-90b0-84077dce2122 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:14:12.884991 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9610e1a-5028-4908-ab31-2a22546c8528 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:14:12.886328 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:14:12.890095 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 399/814] 10.222.0.44 () {56 vars in 1124 bytes} [Thu Jun 16 12:14:12 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:14:12.890937 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9610e1a-5028-4908-ab31-2a22546c8528 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:14:12.905725 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 416/815] 10.222.0.44 () {56 vars in 1135 bytes} [Thu Jun 16 12:14:12 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:14:12.906956 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16d3abc-6c95-4a49-b889-d5c3db2a7d82 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:12.907237 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16d3abc-6c95-4a49-b889-d5c3db2a7d82 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:12.907504 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16d3abc-6c95-4a49-b889-d5c3db2a7d82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:12.923760 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-d16d3abc-6c95-4a49-b889-d5c3db2a7d82 None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:14:12.924971 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-d16d3abc-6c95-4a49-b889-d5c3db2a7d82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:14:12.990012 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 417/816] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 12:14:12 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 12:14:12.990826 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16d3abc-6c95-4a49-b889-d5c3db2a7d82 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:14:12.995352 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9610e1a-5028-4908-ab31-2a22546c8528 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:14:13.026170 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:14:13.031180 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b1a31b-73a4-4b05-ae20-8c67a7639b9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:14:13.031962 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b1a31b-73a4-4b05-ae20-8c67a7639b9c None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:13.032244 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b1a31b-73a4-4b05-ae20-8c67a7639b9c None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:13.032516 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b1a31b-73a4-4b05-ae20-8c67a7639b9c None admin] PATH_INFO: `/v3/projects` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:13.033328 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b1a31b-73a4-4b05-ae20-8c67a7639b9c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:14:13.033638 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b1a31b-73a4-4b05-ae20-8c67a7639b9c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:14:13.035102 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b1a31b-73a4-4b05-ae20-8c67a7639b9c None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:14:13.048894 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 400/817] 10.222.0.44 () {56 vars in 1148 bytes} [Thu Jun 16 12:14:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:14:13.049834 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b1a31b-73a4-4b05-ae20-8c67a7639b9c None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:14:13.100208 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16d3abc-6c95-4a49-b889-d5c3db2a7d82 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:14:13.123173 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:14:13.134181 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f911a3-9a3c-4859-90a7-561e439c4769 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:14:13.134970 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f911a3-9a3c-4859-90a7-561e439c4769 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:13.135252 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f911a3-9a3c-4859-90a7-561e439c4769 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:13.135525 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f911a3-9a3c-4859-90a7-561e439c4769 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:13.142162 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f911a3-9a3c-4859-90a7-561e439c4769 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:14:13.143614 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f911a3-9a3c-4859-90a7-561e439c4769 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:14:13.145817 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b1a31b-73a4-4b05-ae20-8c67a7639b9c None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:14:13.157671 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-49f911a3-9a3c-4859-90a7-561e439c4769 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 12:14:13.157671 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 12:14:13.157671 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 12:14:13.157671 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 12:14:13.157671 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 12:14:13.157671 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 12:14:13.157671 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 12:14:13.157671 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 12:14:13.157671 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 12:14:13.157671 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 12:14:13.157671 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 12:14:13.157671 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 12:14:13.157671 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 12:14:13.157671 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 12:14:13.157671 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 12:14:13.158623 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 12:14:13.158623 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 12:14:13.158623 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 12:14:13.158623 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 12:14:13.158623 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 12:14:13.158623 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 12:14:13.158623 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 12:14:13.158623 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 12:14:13.158623 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jun 16 12:14:13.158623 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 12:14:13.158623 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jun 16 12:14:13.158623 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 12:14:13.158623 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 12:14:13.158623 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 12:14:13.158623 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jun 16 12:14:13.158623 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 12:14:13.158623 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jun 16 12:14:13.159515 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 12:14:13.159515 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 12:14:13.159515 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 12:14:13.159515 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 12:14:13.159515 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 12:14:13.159515 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 12:14:13.159515 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 12:14:13.159515 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jun 16 12:14:13.159515 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 418/818] 10.222.0.44 () {56 vars in 1111 bytes} [Thu Jun 16 12:14:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 12:14:13.160629 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f911a3-9a3c-4859-90a7-561e439c4769 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:14:13.181896 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c024b19-064c-49fc-9654-a7e4d1fd3b7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:14:13.182551 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c024b19-064c-49fc-9654-a7e4d1fd3b7c None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:13.182844 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c024b19-064c-49fc-9654-a7e4d1fd3b7c None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:13.183105 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c024b19-064c-49fc-9654-a7e4d1fd3b7c None admin] PATH_INFO: `/v3/services` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:13.183803 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c024b19-064c-49fc-9654-a7e4d1fd3b7c None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:14:13.184107 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c024b19-064c-49fc-9654-a7e4d1fd3b7c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:14:13.185482 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c024b19-064c-49fc-9654-a7e4d1fd3b7c None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:14:13.190200 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 401/819] 10.222.0.44 () {56 vars in 1124 bytes} [Thu Jun 16 12:14:13 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:14:13.190948 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c024b19-064c-49fc-9654-a7e4d1fd3b7c None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:14:13.248229 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:14:13.265101 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f911a3-9a3c-4859-90a7-561e439c4769 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:14:13.292698 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c024b19-064c-49fc-9654-a7e4d1fd3b7c None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:14:13.297952 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f91a19-ccc3-453a-854d-cfab5bc231fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:14:13.298736 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f91a19-ccc3-453a-854d-cfab5bc231fe None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:13.299014 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f91a19-ccc3-453a-854d-cfab5bc231fe None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:13.299287 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f91a19-ccc3-453a-854d-cfab5bc231fe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:13.310118 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f91a19-ccc3-453a-854d-cfab5bc231fe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:14:13.311573 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f91a19-ccc3-453a-854d-cfab5bc231fe None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:14:13.326366 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43da1e44-4ae7-4329-bc2e-c8a9674e14d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:14:13.327147 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43da1e44-4ae7-4329-bc2e-c8a9674e14d8 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:13.327429 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43da1e44-4ae7-4329-bc2e-c8a9674e14d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:13.327700 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43da1e44-4ae7-4329-bc2e-c8a9674e14d8 None admin] PATH_INFO: `/v3/services/network` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:13.328340 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43da1e44-4ae7-4329-bc2e-c8a9674e14d8 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:14:13.328589 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-47f91a19-ccc3-453a-854d-cfab5bc231fe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 12:14:13.328589 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 12:14:13.328589 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 12:14:13.328589 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 12:14:13.328589 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 12:14:13.328589 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 12:14:13.328589 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 12:14:13.328589 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 12:14:13.328589 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 12:14:13.328589 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 12:14:13.328589 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 12:14:13.328589 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 12:14:13.328589 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 12:14:13.328589 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 12:14:13.328589 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 12:14:13.329662 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 12:14:13.329662 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 12:14:13.329662 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 12:14:13.329662 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 12:14:13.329662 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 12:14:13.329662 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 12:14:13.329662 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 12:14:13.329662 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 12:14:13.329662 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jun 16 12:14:13.329662 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 12:14:13.329662 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jun 16 12:14:13.329662 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 12:14:13.329662 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 12:14:13.329662 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 12:14:13.329662 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jun 16 12:14:13.329662 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 12:14:13.329662 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jun 16 12:14:13.330668 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 12:14:13.330668 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 12:14:13.330668 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 12:14:13.330668 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jun 16 12:14:13.330908 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43da1e44-4ae7-4329-bc2e-c8a9674e14d8 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:14:13.335072 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 419/820] 10.222.0.44 () {56 vars in 1108 bytes} [Thu Jun 16 12:14:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 12:14:13.335814 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f91a19-ccc3-453a-854d-cfab5bc231fe None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:14:13.341897 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application [None req-43da1e44-4ae7-4329-bc2e-c8a9674e14d8 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 16 12:14:13.341897 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 12:14:13.341897 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 12:14:13.341897 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 12:14:13.341897 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 12:14:13.341897 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 12:14:13.341897 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 12:14:13.341897 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 12:14:13.341897 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 16 12:14:13.341897 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application Jun 16 12:14:13.341897 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 12:14:13.341897 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application Jun 16 12:14:13.341897 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 12:14:13.341897 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 12:14:13.341897 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 12:14:13.341897 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 12:14:13.341897 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 12:14:13.343164 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 12:14:13.343164 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 12:14:13.343164 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 12:14:13.343164 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 12:14:13.343164 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 12:14:13.343164 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 12:14:13.343164 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 12:14:13.343164 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 12:14:13.343164 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 12:14:13.343164 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 12:14:13.343164 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 12:14:13.343164 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 12:14:13.343164 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 12:14:13.343164 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 12:14:13.343164 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 12:14:13.343164 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 12:14:13.344648 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 12:14:13.344648 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application with Lock( Jun 16 12:14:13.344648 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 12:14:13.344648 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._enter() Jun 16 12:14:13.344648 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 12:14:13.344648 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 12:14:13.344648 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 12:14:13.344648 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.creator() Jun 16 12:14:13.344648 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 12:14:13.344648 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application created_value = creator( Jun 16 12:14:13.344648 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 12:14:13.344648 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 12:14:13.344648 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 16 12:14:13.344648 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application Jun 16 12:14:13.344648 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 402/821] 10.222.0.44 () {56 vars in 1111 bytes} [Thu Jun 16 12:14:13 2022] GET /identity/v3/services/network => generated 88 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 12:14:13.345661 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43da1e44-4ae7-4329-bc2e-c8a9674e14d8 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:14:13.372898 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:14:13.436485 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f91a19-ccc3-453a-854d-cfab5bc231fe None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:14:13.442649 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43da1e44-4ae7-4329-bc2e-c8a9674e14d8 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:14:13.461792 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:14:13.470288 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb952af-ef04-4f82-b98a-6a26b69840f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:14:13.470940 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb952af-ef04-4f82-b98a-6a26b69840f5 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:13.471218 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb952af-ef04-4f82-b98a-6a26b69840f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:13.471494 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb952af-ef04-4f82-b98a-6a26b69840f5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:13.472321 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb952af-ef04-4f82-b98a-6a26b69840f5 None admin] RBAC: Adding query filter params (role.id=0688968254744e3f9913653cafea3091, scope.project.id=601361df39e34fcca71175aa94e425c4, user.id=edfb12d445e74136b90800e93941f468) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:14:13.472650 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb952af-ef04-4f82-b98a-6a26b69840f5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:14:13.474114 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb952af-ef04-4f82-b98a-6a26b69840f5 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:14:13.476073 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de1865e-ba58-4cf0-bdd2-1d0f87d8559c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:14:13.476714 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de1865e-ba58-4cf0-bdd2-1d0f87d8559c None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:13.477018 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de1865e-ba58-4cf0-bdd2-1d0f87d8559c None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:13.477289 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de1865e-ba58-4cf0-bdd2-1d0f87d8559c None admin] PATH_INFO: `/v3/projects` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:13.478064 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de1865e-ba58-4cf0-bdd2-1d0f87d8559c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:14:13.478364 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de1865e-ba58-4cf0-bdd2-1d0f87d8559c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:14:13.479755 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de1865e-ba58-4cf0-bdd2-1d0f87d8559c None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:14:13.488886 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 420/822] 10.222.0.44 () {56 vars in 1374 bytes} [Thu Jun 16 12:14:13 2022] GET /identity/v3/role_assignments?user.id=edfb12d445e74136b90800e93941f468&scope.project.id=601361df39e34fcca71175aa94e425c4&role.id=0688968254744e3f9913653cafea3091 => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:14:13.488886 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb952af-ef04-4f82-b98a-6a26b69840f5 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:14:13.501225 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 403/823] 10.222.0.44 () {56 vars in 1148 bytes} [Thu Jun 16 12:14:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:14:13.501925 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de1865e-ba58-4cf0-bdd2-1d0f87d8559c None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:14:13.592360 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:14:13.595970 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb952af-ef04-4f82-b98a-6a26b69840f5 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:14:13.624966 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de1865e-ba58-4cf0-bdd2-1d0f87d8559c None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:14:13.634467 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080ad650-79a7-4e9f-ac7a-62ed55499f50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:14:13.635129 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080ad650-79a7-4e9f-ac7a-62ed55499f50 None admin] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:13.635406 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080ad650-79a7-4e9f-ac7a-62ed55499f50 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:13.635681 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080ad650-79a7-4e9f-ac7a-62ed55499f50 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:13.636412 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080ad650-79a7-4e9f-ac7a-62ed55499f50 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:14:13.637817 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080ad650-79a7-4e9f-ac7a-62ed55499f50 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:14:13.661035 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 421/824] 10.222.0.44 () {60 vars in 1144 bytes} [Thu Jun 16 12:14:13 2022] POST /identity/v3/endpoints => generated 346 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 12:14:13.661683 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080ad650-79a7-4e9f-ac7a-62ed55499f50 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:14:13.675338 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a6579b-ee27-4699-bdc8-40ab4a96e8c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:14:13.676557 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a6579b-ee27-4699-bdc8-40ab4a96e8c6 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:13.676897 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a6579b-ee27-4699-bdc8-40ab4a96e8c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:13.677167 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a6579b-ee27-4699-bdc8-40ab4a96e8c6 None admin] PATH_INFO: `/v3/domains` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:13.677904 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a6579b-ee27-4699-bdc8-40ab4a96e8c6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:14:13.678206 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a6579b-ee27-4699-bdc8-40ab4a96e8c6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:14:13.679596 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a6579b-ee27-4699-bdc8-40ab4a96e8c6 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:14:13.700038 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 404/825] 10.222.0.44 () {56 vars in 1109 bytes} [Thu Jun 16 12:14:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:14:13.700038 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a6579b-ee27-4699-bdc8-40ab4a96e8c6 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:14:13.748871 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:14:13.795704 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080ad650-79a7-4e9f-ac7a-62ed55499f50 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:14:13.841424 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3838ce44-04ee-4269-991f-e9d79ace6217 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:14:13.842095 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3838ce44-04ee-4269-991f-e9d79ace6217 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:13.842374 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3838ce44-04ee-4269-991f-e9d79ace6217 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:13.842646 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3838ce44-04ee-4269-991f-e9d79ace6217 None admin] PATH_INFO: `/v3/services` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:13.843348 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3838ce44-04ee-4269-991f-e9d79ace6217 None admin] RBAC: Adding query filter params (name=network) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:14:13.843494 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a6579b-ee27-4699-bdc8-40ab4a96e8c6 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:14:13.843650 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3838ce44-04ee-4269-991f-e9d79ace6217 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:14:13.845938 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3838ce44-04ee-4269-991f-e9d79ace6217 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:14:13.851997 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 422/826] 10.222.0.44 () {56 vars in 1112 bytes} [Thu Jun 16 12:14:13 2022] GET /identity/v3/services?name=network => generated 124 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:14:13.852742 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3838ce44-04ee-4269-991f-e9d79ace6217 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:14:13.877975 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:14:13.888670 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7725707-983e-4b11-9339-1654a33abb7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:14:13.889585 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7725707-983e-4b11-9339-1654a33abb7b None admin] REQUEST_METHOD: `PUT` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:13.889912 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7725707-983e-4b11-9339-1654a33abb7b None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:13.890178 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7725707-983e-4b11-9339-1654a33abb7b None admin] PATH_INFO: `/v3/projects/601361df39e34fcca71175aa94e425c4/users/222b53cae3d64412b9b0a89d162311f4/roles/a5c06bc21d39451285def24673456ff6` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:13.910643 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7725707-983e-4b11-9339-1654a33abb7b None admin] RBAC: Authorizing `identity:create_grant(project_id=601361df39e34fcca71175aa94e425c4, user_id=222b53cae3d64412b9b0a89d162311f4, role_id=a5c06bc21d39451285def24673456ff6)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:14:13.912786 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7725707-983e-4b11-9339-1654a33abb7b None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:14:13.933363 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 405/827] 10.222.0.44 () {58 vars in 1439 bytes} [Thu Jun 16 12:14:13 2022] PUT /identity/v3/projects/601361df39e34fcca71175aa94e425c4/users/222b53cae3d64412b9b0a89d162311f4/roles/a5c06bc21d39451285def24673456ff6 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:14:13.937012 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7725707-983e-4b11-9339-1654a33abb7b None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:14:14.001928 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3838ce44-04ee-4269-991f-e9d79ace6217 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:14:14.070399 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28dc37a-e316-49be-8a61-989ff58c5683 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:14:14.071217 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28dc37a-e316-49be-8a61-989ff58c5683 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:14.071493 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28dc37a-e316-49be-8a61-989ff58c5683 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:14.071761 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28dc37a-e316-49be-8a61-989ff58c5683 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:14.083176 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28dc37a-e316-49be-8a61-989ff58c5683 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:14:14.084676 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28dc37a-e316-49be-8a61-989ff58c5683 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:14:14.100627 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-b28dc37a-e316-49be-8a61-989ff58c5683 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 12:14:14.100627 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 12:14:14.100627 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 12:14:14.100627 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 12:14:14.100627 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 12:14:14.100627 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 12:14:14.100627 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 12:14:14.100627 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 12:14:14.100627 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 12:14:14.100627 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 12:14:14.100627 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 12:14:14.100627 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 12:14:14.100627 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 12:14:14.100627 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 12:14:14.100627 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 12:14:14.101612 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 12:14:14.101612 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 12:14:14.101612 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 12:14:14.101612 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 12:14:14.101612 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 12:14:14.101612 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 12:14:14.101612 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 12:14:14.101612 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 12:14:14.101612 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jun 16 12:14:14.101612 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 12:14:14.101612 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jun 16 12:14:14.101612 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 12:14:14.101612 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 12:14:14.101612 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 12:14:14.101612 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jun 16 12:14:14.101612 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 12:14:14.101612 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jun 16 12:14:14.102503 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 12:14:14.102503 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 12:14:14.102503 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 12:14:14.102503 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 12:14:14.102503 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 12:14:14.102503 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 12:14:14.102503 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 12:14:14.102503 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jun 16 12:14:14.102503 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 423/828] 10.222.0.44 () {56 vars in 1111 bytes} [Thu Jun 16 12:14:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 12:14:14.113931 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28dc37a-e316-49be-8a61-989ff58c5683 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:14:14.125144 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:14:14.151715 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7725707-983e-4b11-9339-1654a33abb7b None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:14:14.203219 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a42046-ca63-4c9b-9df2-09ca260fb987 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:14:14.204066 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a42046-ca63-4c9b-9df2-09ca260fb987 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:14.204595 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a42046-ca63-4c9b-9df2-09ca260fb987 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:14.204915 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a42046-ca63-4c9b-9df2-09ca260fb987 None admin] PATH_INFO: `/v3/services` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:14.206180 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a42046-ca63-4c9b-9df2-09ca260fb987 None admin] RBAC: Adding query filter params (type=network) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:14:14.206653 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a42046-ca63-4c9b-9df2-09ca260fb987 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:14:14.208681 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a42046-ca63-4c9b-9df2-09ca260fb987 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:14:14.215815 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 406/829] 10.222.0.44 () {56 vars in 1112 bytes} [Thu Jun 16 12:14:13 2022] GET /identity/v3/services?type=network => generated 350 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:14:14.222080 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a42046-ca63-4c9b-9df2-09ca260fb987 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:14:14.240032 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:14:14.283940 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28dc37a-e316-49be-8a61-989ff58c5683 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:14:14.347337 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebb613b-f755-45f8-8319-de5cf59e0874 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:14:14.348802 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebb613b-f755-45f8-8319-de5cf59e0874 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:14.350285 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebb613b-f755-45f8-8319-de5cf59e0874 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:14.351364 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebb613b-f755-45f8-8319-de5cf59e0874 None admin] PATH_INFO: `/v3/projects` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:14.352776 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebb613b-f755-45f8-8319-de5cf59e0874 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:14:14.353322 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebb613b-f755-45f8-8319-de5cf59e0874 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:14:14.355229 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a42046-ca63-4c9b-9df2-09ca260fb987 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:14:14.358024 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebb613b-f755-45f8-8319-de5cf59e0874 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:14:14.378303 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 424/830] 10.222.0.44 () {56 vars in 1148 bytes} [Thu Jun 16 12:14:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:14:14.386175 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebb613b-f755-45f8-8319-de5cf59e0874 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:14:14.412042 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4342d140-783c-4ad5-9377-d04d737454c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:14:14.412893 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4342d140-783c-4ad5-9377-d04d737454c4 None admin] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:14.413174 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4342d140-783c-4ad5-9377-d04d737454c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:14.413447 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4342d140-783c-4ad5-9377-d04d737454c4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:14.414681 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4342d140-783c-4ad5-9377-d04d737454c4 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:14:14.416574 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4342d140-783c-4ad5-9377-d04d737454c4 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:14:14.449967 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 407/831] 10.222.0.44 () {60 vars in 1144 bytes} [Thu Jun 16 12:14:14 2022] POST /identity/v3/endpoints => generated 327 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 12:14:14.548388 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebb613b-f755-45f8-8319-de5cf59e0874 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:14:14.602199 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef82b99-1a72-46ae-9b7b-928151fa5bbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:14:14.603119 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef82b99-1a72-46ae-9b7b-928151fa5bbc None admin] REQUEST_METHOD: `PUT` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:14.603396 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef82b99-1a72-46ae-9b7b-928151fa5bbc None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:14.603671 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef82b99-1a72-46ae-9b7b-928151fa5bbc None admin] PATH_INFO: `/v3/projects/601361df39e34fcca71175aa94e425c4/users/c159f79c1921496487101aac5d530ae5/roles/0688968254744e3f9913653cafea3091` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:14.606060 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef82b99-1a72-46ae-9b7b-928151fa5bbc None admin] RBAC: Authorizing `identity:create_grant(project_id=601361df39e34fcca71175aa94e425c4, user_id=c159f79c1921496487101aac5d530ae5, role_id=0688968254744e3f9913653cafea3091)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:14:14.607541 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef82b99-1a72-46ae-9b7b-928151fa5bbc None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:14:14.611060 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:14:14.627933 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 425/832] 10.222.0.44 () {58 vars in 1439 bytes} [Thu Jun 16 12:14:14 2022] PUT /identity/v3/projects/601361df39e34fcca71175aa94e425c4/users/c159f79c1921496487101aac5d530ae5/roles/0688968254744e3f9913653cafea3091 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:14:15.828216 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af773c31-1f42-4bfb-99ed-2737945db589 None None] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:15.828797 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af773c31-1f42-4bfb-99ed-2737945db589 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:15.828797 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af773c31-1f42-4bfb-99ed-2737945db589 None None] PATH_INFO: `/` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:15.830380 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 408/833] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 12:14:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 12:14:15.835806 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e3f2b8-f25f-493c-8335-8090d137fa07 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:15.836261 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e3f2b8-f25f-493c-8335-8090d137fa07 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:15.836340 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e3f2b8-f25f-493c-8335-8090d137fa07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:15.853480 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-57e3f2b8-f25f-493c-8335-8090d137fa07 None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:14:15.854677 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-57e3f2b8-f25f-493c-8335-8090d137fa07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:14:15.927674 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 426/834] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 12:14:15 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 12:14:15.949031 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af773c31-1f42-4bfb-99ed-2737945db589 None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:14:15.959147 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:14:16.063228 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af773c31-1f42-4bfb-99ed-2737945db589 None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:14:16.101089 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3434bd77-65a8-46a2-9088-8b1767f585c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:14:16.101823 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3434bd77-65a8-46a2-9088-8b1767f585c4 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:16.102104 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3434bd77-65a8-46a2-9088-8b1767f585c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:16.102380 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3434bd77-65a8-46a2-9088-8b1767f585c4 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:16.103041 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3434bd77-65a8-46a2-9088-8b1767f585c4 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:14:16.104411 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3434bd77-65a8-46a2-9088-8b1767f585c4 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:14:16.115946 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d990180-8dec-414d-bb9d-31987e6e3841 None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:16.116225 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d990180-8dec-414d-bb9d-31987e6e3841 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:16.116511 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d990180-8dec-414d-bb9d-31987e6e3841 None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:16.118172 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 427/835] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 12:14:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 12:14:16.119752 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application [None req-3434bd77-65a8-46a2-9088-8b1767f585c4 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 16 12:14:16.119752 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 12:14:16.119752 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 12:14:16.119752 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 12:14:16.119752 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 12:14:16.119752 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 12:14:16.119752 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 12:14:16.119752 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 12:14:16.119752 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 16 12:14:16.119752 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application Jun 16 12:14:16.119752 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 12:14:16.119752 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application Jun 16 12:14:16.119752 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 12:14:16.119752 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 12:14:16.119752 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 12:14:16.119752 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 12:14:16.120874 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 12:14:16.120874 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 12:14:16.120874 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 12:14:16.120874 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 12:14:16.120874 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 12:14:16.120874 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 12:14:16.120874 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 12:14:16.120874 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 12:14:16.120874 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 12:14:16.120874 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 12:14:16.120874 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 12:14:16.120874 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 12:14:16.120874 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 12:14:16.120874 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 12:14:16.120874 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 12:14:16.120874 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 12:14:16.121916 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 12:14:16.121916 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 12:14:16.121916 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application with Lock( Jun 16 12:14:16.121916 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 12:14:16.121916 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._enter() Jun 16 12:14:16.121916 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 12:14:16.121916 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 12:14:16.121916 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 12:14:16.121916 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.creator() Jun 16 12:14:16.121916 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 12:14:16.121916 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application created_value = creator( Jun 16 12:14:16.121916 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 12:14:16.121916 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 12:14:16.121916 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 16 12:14:16.121916 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application Jun 16 12:14:16.124116 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 409/836] 10.222.0.44 () {56 vars in 1132 bytes} [Thu Jun 16 12:14:15 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 12:14:16.129484 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b8694d-23fd-414d-809a-b6701c345fde None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:16.129626 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3434bd77-65a8-46a2-9088-8b1767f585c4 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:14:16.130124 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b8694d-23fd-414d-809a-b6701c345fde None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:16.130596 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b8694d-23fd-414d-809a-b6701c345fde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:16.148361 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-75b8694d-23fd-414d-809a-b6701c345fde None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:14:16.149860 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-75b8694d-23fd-414d-809a-b6701c345fde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:14:16.217403 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:14:16.239745 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 428/837] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 12:14:16 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 16 12:14:16.256779 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b8694d-23fd-414d-809a-b6701c345fde None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:14:16.257315 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3434bd77-65a8-46a2-9088-8b1767f585c4 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:14:16.305601 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cd5e63-19bd-42dc-8a9f-806fa23aac81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:14:16.306263 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cd5e63-19bd-42dc-8a9f-806fa23aac81 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:16.306536 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cd5e63-19bd-42dc-8a9f-806fa23aac81 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:16.306817 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cd5e63-19bd-42dc-8a9f-806fa23aac81 None admin] PATH_INFO: `/v3/services` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:16.307534 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82cd5e63-19bd-42dc-8a9f-806fa23aac81 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:14:16.307843 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82cd5e63-19bd-42dc-8a9f-806fa23aac81 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:14:16.309308 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82cd5e63-19bd-42dc-8a9f-806fa23aac81 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:14:16.314389 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 410/838] 10.222.0.44 () {56 vars in 1126 bytes} [Thu Jun 16 12:14:16 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 12:14:16.316795 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43de4389-aded-47b3-a791-2f5217c6153b None None] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:16.316795 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43de4389-aded-47b3-a791-2f5217c6153b None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:16.316795 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43de4389-aded-47b3-a791-2f5217c6153b None None] PATH_INFO: `/` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:16.318084 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 411/839] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 12:14:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 12:14:16.318353 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:14:16.321103 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43de4389-aded-47b3-a791-2f5217c6153b None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:14:16.364233 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b8694d-23fd-414d-809a-b6701c345fde None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:14:16.400501 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf68894-1099-4077-b1e9-5a98dafd8f6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:14:16.401637 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf68894-1099-4077-b1e9-5a98dafd8f6a None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:16.401911 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf68894-1099-4077-b1e9-5a98dafd8f6a None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:16.402180 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf68894-1099-4077-b1e9-5a98dafd8f6a None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:16.402827 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf68894-1099-4077-b1e9-5a98dafd8f6a None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:14:16.404199 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf68894-1099-4077-b1e9-5a98dafd8f6a None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:14:16.417258 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-4bf68894-1099-4077-b1e9-5a98dafd8f6a None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 16 12:14:16.417258 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 12:14:16.417258 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 12:14:16.417258 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 12:14:16.417258 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 12:14:16.417258 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 12:14:16.417258 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 12:14:16.417258 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 12:14:16.417258 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 16 12:14:16.417258 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jun 16 12:14:16.417258 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 12:14:16.417258 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jun 16 12:14:16.417258 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 12:14:16.417258 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 12:14:16.417258 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 12:14:16.417258 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 12:14:16.417258 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 12:14:16.418634 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 12:14:16.418634 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 12:14:16.418634 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 12:14:16.418634 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 12:14:16.418634 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 12:14:16.418634 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 12:14:16.418634 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 12:14:16.418634 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 12:14:16.418634 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 12:14:16.418634 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 12:14:16.418634 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 12:14:16.418634 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 12:14:16.418634 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 12:14:16.418634 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 12:14:16.418634 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 12:14:16.418634 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 12:14:16.424515 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 12:14:16.424515 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jun 16 12:14:16.424515 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 12:14:16.424515 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jun 16 12:14:16.424515 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 12:14:16.424515 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 12:14:16.424515 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 12:14:16.424515 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jun 16 12:14:16.424515 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 12:14:16.424515 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jun 16 12:14:16.424515 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 12:14:16.424515 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 12:14:16.424515 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 16 12:14:16.424515 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jun 16 12:14:16.424515 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 429/840] 10.222.0.44 () {56 vars in 1114 bytes} [Thu Jun 16 12:14:16 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 12:14:16.425327 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6a0498-42d0-4b4b-9d7b-04cc3f5f07fa None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:16.425327 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6a0498-42d0-4b4b-9d7b-04cc3f5f07fa None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:16.425327 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6a0498-42d0-4b4b-9d7b-04cc3f5f07fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:16.439319 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-be6a0498-42d0-4b4b-9d7b-04cc3f5f07fa None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:14:16.440506 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-be6a0498-42d0-4b4b-9d7b-04cc3f5f07fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:14:16.440660 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43de4389-aded-47b3-a791-2f5217c6153b None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:14:16.479035 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b72e4eb-ab51-456e-ab45-984f78dd4810 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:14:16.479699 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b72e4eb-ab51-456e-ab45-984f78dd4810 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:16.479978 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b72e4eb-ab51-456e-ab45-984f78dd4810 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:16.480258 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b72e4eb-ab51-456e-ab45-984f78dd4810 None admin] PATH_INFO: `/v3/services` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:16.480991 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b72e4eb-ab51-456e-ab45-984f78dd4810 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:14:16.481302 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b72e4eb-ab51-456e-ab45-984f78dd4810 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:14:16.482666 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b72e4eb-ab51-456e-ab45-984f78dd4810 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:14:16.483943 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:14:16.496779 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 412/841] 10.222.0.44 () {56 vars in 1126 bytes} [Thu Jun 16 12:14:16 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:14:16.496779 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b72e4eb-ab51-456e-ab45-984f78dd4810 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:14:16.515137 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 430/842] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 12:14:16 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 12:14:16.538828 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6a0498-42d0-4b4b-9d7b-04cc3f5f07fa None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:14:16.628431 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b72e4eb-ab51-456e-ab45-984f78dd4810 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:14:16.630875 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:14:16.667355 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6a0498-42d0-4b4b-9d7b-04cc3f5f07fa None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:14:16.667545 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d1f204-8650-4e9d-ac24-a82b139154cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:14:16.668331 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d1f204-8650-4e9d-ac24-a82b139154cc None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:16.668613 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d1f204-8650-4e9d-ac24-a82b139154cc None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:16.668920 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d1f204-8650-4e9d-ac24-a82b139154cc None admin] PATH_INFO: `/v3/services` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:16.669633 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d1f204-8650-4e9d-ac24-a82b139154cc None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:14:16.669939 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d1f204-8650-4e9d-ac24-a82b139154cc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:14:16.671598 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d1f204-8650-4e9d-ac24-a82b139154cc None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:14:16.677903 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 413/843] 10.222.0.44 () {56 vars in 1114 bytes} [Thu Jun 16 12:14:16 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:14:16.685145 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d1f204-8650-4e9d-ac24-a82b139154cc None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:14:16.715204 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa02e0d3-e936-4f31-90ed-aa60574cf355 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:14:16.716006 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa02e0d3-e936-4f31-90ed-aa60574cf355 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:16.716284 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa02e0d3-e936-4f31-90ed-aa60574cf355 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:16.716557 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa02e0d3-e936-4f31-90ed-aa60574cf355 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:16.727347 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa02e0d3-e936-4f31-90ed-aa60574cf355 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 12:14:16.735203 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-fa02e0d3-e936-4f31-90ed-aa60574cf355 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 16 12:14:16.735203 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 12:14:16.735203 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 12:14:16.735203 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 12:14:16.735203 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 12:14:16.735203 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 12:14:16.735203 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 12:14:16.735203 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 12:14:16.735203 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 12:14:16.735203 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 12:14:16.735203 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 12:14:16.735203 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 12:14:16.735203 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 12:14:16.735203 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 12:14:16.735203 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 12:14:16.735203 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 12:14:16.736142 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 12:14:16.736142 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 12:14:16.736142 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 12:14:16.736142 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 12:14:16.736142 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 12:14:16.736142 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 12:14:16.736142 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 12:14:16.736142 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 12:14:16.736142 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 12:14:16.736142 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 12:14:16.736142 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 12:14:16.736142 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jun 16 12:14:16.736142 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 12:14:16.736142 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jun 16 12:14:16.736142 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 12:14:16.736142 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 12:14:16.736996 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 12:14:16.736996 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jun 16 12:14:16.736996 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 12:14:16.736996 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jun 16 12:14:16.736996 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 12:14:16.736996 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 12:14:16.736996 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 12:14:16.736996 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 12:14:16.736996 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 12:14:16.736996 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 12:14:16.736996 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 16 12:14:16.736996 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jun 16 12:14:16.740865 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 431/844] 10.222.0.44 () {56 vars in 1102 bytes} [Thu Jun 16 12:14:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 12:14:16.743001 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa02e0d3-e936-4f31-90ed-aa60574cf355 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:14:16.764239 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:14:16.811218 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d1f204-8650-4e9d-ac24-a82b139154cc None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:14:16.857071 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977e190a-9f5c-4b5a-8863-28f4212ed8fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:14:16.857887 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977e190a-9f5c-4b5a-8863-28f4212ed8fd None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:16.858021 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977e190a-9f5c-4b5a-8863-28f4212ed8fd None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:16.858304 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977e190a-9f5c-4b5a-8863-28f4212ed8fd None admin] PATH_INFO: `/v3/services` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:16.859047 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977e190a-9f5c-4b5a-8863-28f4212ed8fd None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:14:16.859357 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977e190a-9f5c-4b5a-8863-28f4212ed8fd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:14:16.860820 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977e190a-9f5c-4b5a-8863-28f4212ed8fd None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:14:16.867460 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 414/845] 10.222.0.44 () {56 vars in 1114 bytes} [Thu Jun 16 12:14:16 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:14:16.914540 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a1e5ac-ea7d-43bf-95d7-11f7785b57a6 None None] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:16.914834 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a1e5ac-ea7d-43bf-95d7-11f7785b57a6 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:16.915027 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a1e5ac-ea7d-43bf-95d7-11f7785b57a6 None None] PATH_INFO: `/` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:16.916722 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 415/846] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 12:14:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 12:14:16.923524 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1769e2c9-6bda-48f8-a939-5170bf39b834 None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:16.924050 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1769e2c9-6bda-48f8-a939-5170bf39b834 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:16.924569 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1769e2c9-6bda-48f8-a939-5170bf39b834 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:16.954255 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-1769e2c9-6bda-48f8-a939-5170bf39b834 None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:14:16.956585 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-1769e2c9-6bda-48f8-a939-5170bf39b834 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:14:17.010640 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa02e0d3-e936-4f31-90ed-aa60574cf355 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:14:17.025474 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:14:17.048222 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 416/847] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 12:14:16 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 16 12:14:17.057029 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af37b7d-b8ca-4086-9445-c0d2af5e5b37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:14:17.057791 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af37b7d-b8ca-4086-9445-c0d2af5e5b37 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:17.058148 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af37b7d-b8ca-4086-9445-c0d2af5e5b37 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:17.058494 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af37b7d-b8ca-4086-9445-c0d2af5e5b37 None admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:17.059317 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af37b7d-b8ca-4086-9445-c0d2af5e5b37 None admin] RBAC: Adding query filter params (name=service) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:14:17.059626 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af37b7d-b8ca-4086-9445-c0d2af5e5b37 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:14:17.061084 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af37b7d-b8ca-4086-9445-c0d2af5e5b37 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:14:17.070280 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 432/848] 10.222.0.44 () {56 vars in 1103 bytes} [Thu Jun 16 12:14:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 12:14:17.074200 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1769e2c9-6bda-48f8-a939-5170bf39b834 None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:14:17.078741 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af37b7d-b8ca-4086-9445-c0d2af5e5b37 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:14:17.139468 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:14:17.192466 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1769e2c9-6bda-48f8-a939-5170bf39b834 None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:14:17.195791 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af37b7d-b8ca-4086-9445-c0d2af5e5b37 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:14:17.230711 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87de7d42-46ce-4177-9468-92ec7b61b06c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:14:17.231979 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87de7d42-46ce-4177-9468-92ec7b61b06c None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:17.232168 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4b67c8-71a9-4751-b39f-b6ce71d65a2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:14:17.232691 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87de7d42-46ce-4177-9468-92ec7b61b06c None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:17.232973 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4b67c8-71a9-4751-b39f-b6ce71d65a2d None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:17.233246 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4b67c8-71a9-4751-b39f-b6ce71d65a2d None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:17.233511 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4b67c8-71a9-4751-b39f-b6ce71d65a2d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:17.233842 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87de7d42-46ce-4177-9468-92ec7b61b06c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:17.245308 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4b67c8-71a9-4751-b39f-b6ce71d65a2d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:14:17.246219 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87de7d42-46ce-4177-9468-92ec7b61b06c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 12:14:17.246756 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4b67c8-71a9-4751-b39f-b6ce71d65a2d None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:14:17.254756 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application [None req-87de7d42-46ce-4177-9468-92ec7b61b06c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 12:14:17.254756 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 12:14:17.254756 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 12:14:17.254756 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 12:14:17.254756 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 12:14:17.254756 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 12:14:17.254756 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 12:14:17.254756 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 12:14:17.254756 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 12:14:17.254756 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 12:14:17.254756 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 12:14:17.254756 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 12:14:17.254756 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 12:14:17.254756 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 12:14:17.254756 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 12:14:17.254756 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 12:14:17.255725 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 12:14:17.255725 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 12:14:17.255725 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 12:14:17.255725 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 12:14:17.255725 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 12:14:17.255725 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 12:14:17.255725 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 12:14:17.255725 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 12:14:17.255725 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 12:14:17.255725 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 12:14:17.255725 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 12:14:17.255725 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application with Lock( Jun 16 12:14:17.255725 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 12:14:17.255725 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._enter() Jun 16 12:14:17.255725 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 12:14:17.255725 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 12:14:17.256548 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 12:14:17.256548 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.creator() Jun 16 12:14:17.256548 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 12:14:17.256548 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application created_value = creator( Jun 16 12:14:17.256548 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 12:14:17.256548 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 12:14:17.256548 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 12:14:17.256548 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 12:14:17.256548 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 12:14:17.256548 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 12:14:17.256548 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 12:14:17.256548 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application Jun 16 12:14:17.263837 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 417/849] 10.222.0.44 () {56 vars in 1096 bytes} [Thu Jun 16 12:14:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 12:14:17.264351 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-ee4b67c8-71a9-4751-b39f-b6ce71d65a2d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 12:14:17.264351 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 12:14:17.264351 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 12:14:17.264351 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 12:14:17.264351 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 12:14:17.264351 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 12:14:17.264351 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 12:14:17.264351 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 12:14:17.264351 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 12:14:17.264351 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 12:14:17.264351 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 12:14:17.264351 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 12:14:17.264351 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 12:14:17.264351 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 12:14:17.264351 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 12:14:17.265324 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 12:14:17.265324 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 12:14:17.265324 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 12:14:17.265324 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 12:14:17.265324 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 12:14:17.265324 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 12:14:17.265324 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 12:14:17.265324 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 12:14:17.265324 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jun 16 12:14:17.265324 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 12:14:17.265324 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jun 16 12:14:17.265324 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 12:14:17.265324 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 12:14:17.265324 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 12:14:17.265324 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jun 16 12:14:17.265324 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 12:14:17.265324 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jun 16 12:14:17.266442 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 12:14:17.266442 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 12:14:17.266442 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 12:14:17.266442 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jun 16 12:14:17.267345 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87de7d42-46ce-4177-9468-92ec7b61b06c None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:14:17.268209 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 433/850] 10.222.0.44 () {56 vars in 1108 bytes} [Thu Jun 16 12:14:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 12:14:17.275484 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4b67c8-71a9-4751-b39f-b6ce71d65a2d None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:14:17.304065 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:14:17.376060 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87de7d42-46ce-4177-9468-92ec7b61b06c None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:14:17.387991 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4b67c8-71a9-4751-b39f-b6ce71d65a2d None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:14:17.398300 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:14:17.411988 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9eb846f-635c-4170-a74d-98d17d7f658b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:14:17.412655 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9eb846f-635c-4170-a74d-98d17d7f658b None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:17.412973 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9eb846f-635c-4170-a74d-98d17d7f658b None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:17.413251 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9eb846f-635c-4170-a74d-98d17d7f658b None admin] PATH_INFO: `/v3/roles` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:17.414010 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9eb846f-635c-4170-a74d-98d17d7f658b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:14:17.414323 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9eb846f-635c-4170-a74d-98d17d7f658b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:14:17.415725 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9eb846f-635c-4170-a74d-98d17d7f658b None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:14:17.428790 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 418/851] 10.222.0.44 () {56 vars in 1099 bytes} [Thu Jun 16 12:14:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:14:17.430517 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9eb846f-635c-4170-a74d-98d17d7f658b None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:14:17.431079 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a25cb6-9310-4cb4-8bf2-6dcf374b9d31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:14:17.431723 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a25cb6-9310-4cb4-8bf2-6dcf374b9d31 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:17.432114 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a25cb6-9310-4cb4-8bf2-6dcf374b9d31 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:17.432392 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a25cb6-9310-4cb4-8bf2-6dcf374b9d31 None admin] PATH_INFO: `/v3/domains` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:17.433148 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a25cb6-9310-4cb4-8bf2-6dcf374b9d31 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:14:17.433454 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a25cb6-9310-4cb4-8bf2-6dcf374b9d31 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:14:17.435052 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a25cb6-9310-4cb4-8bf2-6dcf374b9d31 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:14:17.454480 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 434/852] 10.222.0.44 () {56 vars in 1109 bytes} [Thu Jun 16 12:14:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 12:14:17.456415 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a25cb6-9310-4cb4-8bf2-6dcf374b9d31 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:14:17.541160 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9eb846f-635c-4170-a74d-98d17d7f658b None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:14:17.552931 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:14:17.565645 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a25cb6-9310-4cb4-8bf2-6dcf374b9d31 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:14:17.575918 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfb915e-6fb4-46e3-b18e-b836a7c59487 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:14:17.576707 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfb915e-6fb4-46e3-b18e-b836a7c59487 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:17.577013 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfb915e-6fb4-46e3-b18e-b836a7c59487 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:17.577281 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfb915e-6fb4-46e3-b18e-b836a7c59487 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:17.588868 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfb915e-6fb4-46e3-b18e-b836a7c59487 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:14:17.590654 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfb915e-6fb4-46e3-b18e-b836a7c59487 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:14:17.605410 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac844a37-5b80-43a5-968a-0b8f615a42ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:14:17.606444 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac844a37-5b80-43a5-968a-0b8f615a42ee None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:17.606865 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac844a37-5b80-43a5-968a-0b8f615a42ee None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:17.607298 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac844a37-5b80-43a5-968a-0b8f615a42ee None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:17.608879 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application [None req-5cfb915e-6fb4-46e3-b18e-b836a7c59487 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 12:14:17.608879 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 12:14:17.608879 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 12:14:17.608879 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 12:14:17.608879 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 12:14:17.608879 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 12:14:17.608879 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 12:14:17.608879 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 12:14:17.608879 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 12:14:17.608879 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 12:14:17.608879 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 12:14:17.608879 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 12:14:17.608879 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 12:14:17.608879 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 12:14:17.608879 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 12:14:17.609827 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 12:14:17.609827 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 12:14:17.609827 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 12:14:17.609827 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 12:14:17.609827 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 12:14:17.609827 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 12:14:17.609827 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 12:14:17.609827 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 12:14:17.609827 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application with Lock( Jun 16 12:14:17.609827 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 12:14:17.609827 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._enter() Jun 16 12:14:17.609827 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 12:14:17.609827 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 12:14:17.609827 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 12:14:17.609827 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.creator() Jun 16 12:14:17.609827 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 12:14:17.609827 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application created_value = creator( Jun 16 12:14:17.610701 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 12:14:17.610701 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 12:14:17.610701 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 12:14:17.610701 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application Jun 16 12:14:17.615926 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 419/853] 10.222.0.44 () {56 vars in 1108 bytes} [Thu Jun 16 12:14:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 12:14:17.616877 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfb915e-6fb4-46e3-b18e-b836a7c59487 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:14:17.618770 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac844a37-5b80-43a5-968a-0b8f615a42ee None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:14:17.620538 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac844a37-5b80-43a5-968a-0b8f615a42ee None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:14:17.637972 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-ac844a37-5b80-43a5-968a-0b8f615a42ee None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 16 12:14:17.637972 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 12:14:17.637972 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 12:14:17.637972 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 12:14:17.637972 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 12:14:17.637972 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 12:14:17.637972 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 12:14:17.637972 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 12:14:17.637972 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 12:14:17.637972 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 12:14:17.637972 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 12:14:17.637972 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 12:14:17.637972 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 12:14:17.637972 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 12:14:17.637972 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 12:14:17.637972 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 12:14:17.638905 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 12:14:17.638905 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 12:14:17.638905 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 12:14:17.638905 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 12:14:17.638905 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 12:14:17.638905 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 12:14:17.638905 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 12:14:17.638905 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 12:14:17.638905 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 12:14:17.638905 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 12:14:17.638905 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 12:14:17.638905 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jun 16 12:14:17.638905 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 12:14:17.638905 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jun 16 12:14:17.638905 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 12:14:17.638905 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 12:14:17.638905 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 12:14:17.638905 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jun 16 12:14:17.639821 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 12:14:17.639821 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jun 16 12:14:17.639821 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 12:14:17.639821 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 12:14:17.639821 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 12:14:17.639821 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 12:14:17.639821 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 12:14:17.639821 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 12:14:17.639821 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 16 12:14:17.639821 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jun 16 12:14:17.646676 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 435/854] 10.222.0.44 () {56 vars in 1117 bytes} [Thu Jun 16 12:14:17 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 12:14:17.647955 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac844a37-5b80-43a5-968a-0b8f615a42ee None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:14:17.649694 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:14:17.726004 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfb915e-6fb4-46e3-b18e-b836a7c59487 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:14:17.759914 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac844a37-5b80-43a5-968a-0b8f615a42ee None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:14:17.761121 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f07dd17-095d-4c41-bb06-3966fbd4fae1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:14:17.761980 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f07dd17-095d-4c41-bb06-3966fbd4fae1 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:17.762161 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f07dd17-095d-4c41-bb06-3966fbd4fae1 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:17.762573 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f07dd17-095d-4c41-bb06-3966fbd4fae1 None admin] PATH_INFO: `/v3/domains` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:17.763953 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f07dd17-095d-4c41-bb06-3966fbd4fae1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:14:17.763953 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f07dd17-095d-4c41-bb06-3966fbd4fae1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:14:17.765128 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f07dd17-095d-4c41-bb06-3966fbd4fae1 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:14:17.781872 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 420/855] 10.222.0.44 () {56 vars in 1109 bytes} [Thu Jun 16 12:14:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:14:17.783162 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f07dd17-095d-4c41-bb06-3966fbd4fae1 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:14:17.798567 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d0f2c2-8b0e-4f8b-a8c4-f2af7ec0691a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:14:17.799524 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d0f2c2-8b0e-4f8b-a8c4-f2af7ec0691a None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:17.799941 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d0f2c2-8b0e-4f8b-a8c4-f2af7ec0691a None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:17.800951 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d0f2c2-8b0e-4f8b-a8c4-f2af7ec0691a None admin] PATH_INFO: `/v3/users` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:17.801924 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d0f2c2-8b0e-4f8b-a8c4-f2af7ec0691a None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:14:17.802366 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d0f2c2-8b0e-4f8b-a8c4-f2af7ec0691a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:14:17.804139 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d0f2c2-8b0e-4f8b-a8c4-f2af7ec0691a None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:14:17.827518 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 436/856] 10.222.0.44 () {56 vars in 1149 bytes} [Thu Jun 16 12:14:17 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:14:17.828612 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d0f2c2-8b0e-4f8b-a8c4-f2af7ec0691a None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:14:17.831609 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:14:17.880048 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:14:17.890363 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f07dd17-095d-4c41-bb06-3966fbd4fae1 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:14:17.927215 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b33c91-8883-4458-bfe9-7d2f6a6629eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:14:17.928118 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b33c91-8883-4458-bfe9-7d2f6a6629eb None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:17.928503 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b33c91-8883-4458-bfe9-7d2f6a6629eb None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:17.928905 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b33c91-8883-4458-bfe9-7d2f6a6629eb None admin] PATH_INFO: `/v3/users/swift` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:17.936570 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b33c91-8883-4458-bfe9-7d2f6a6629eb None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:14:17.939924 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b33c91-8883-4458-bfe9-7d2f6a6629eb None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:14:17.954369 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d0f2c2-8b0e-4f8b-a8c4-f2af7ec0691a None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:14:17.957528 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application [None req-d0b33c91-8883-4458-bfe9-7d2f6a6629eb None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 16 12:14:17.957528 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 12:14:17.957528 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 12:14:17.957528 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 12:14:17.957528 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 12:14:17.957528 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 12:14:17.957528 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 12:14:17.957528 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 12:14:17.957528 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 12:14:17.957528 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 12:14:17.957528 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 12:14:17.957528 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 12:14:17.957528 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 12:14:17.957528 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 12:14:17.957528 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 12:14:17.957528 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 12:14:17.958427 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 12:14:17.958427 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 12:14:17.958427 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 12:14:17.958427 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 12:14:17.958427 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 12:14:17.958427 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 12:14:17.958427 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 12:14:17.958427 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 12:14:17.958427 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 12:14:17.958427 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 12:14:17.958427 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 12:14:17.958427 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application with Lock( Jun 16 12:14:17.958427 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 12:14:17.958427 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._enter() Jun 16 12:14:17.958427 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 12:14:17.958427 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 12:14:17.958427 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 12:14:17.958427 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.creator() Jun 16 12:14:17.959329 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 12:14:17.959329 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application created_value = creator( Jun 16 12:14:17.959329 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 12:14:17.959329 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 12:14:17.959329 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 12:14:17.959329 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 12:14:17.959329 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 12:14:17.959329 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 12:14:17.959329 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 16 12:14:17.959329 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application Jun 16 12:14:17.962925 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 421/857] 10.222.0.44 () {56 vars in 1096 bytes} [Thu Jun 16 12:14:17 2022] GET /identity/v3/users/swift => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 12:14:17.963730 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b33c91-8883-4458-bfe9-7d2f6a6629eb None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:14:17.995721 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb2e896-015f-4a45-843b-8f4fe1d8babc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:14:17.996857 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb2e896-015f-4a45-843b-8f4fe1d8babc None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:17.997438 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb2e896-015f-4a45-843b-8f4fe1d8babc None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:17.997985 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb2e896-015f-4a45-843b-8f4fe1d8babc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:18.068988 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b33c91-8883-4458-bfe9-7d2f6a6629eb None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:14:18.071939 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb2e896-015f-4a45-843b-8f4fe1d8babc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:14:18.073969 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb2e896-015f-4a45-843b-8f4fe1d8babc None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:14:18.076075 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:14:18.104813 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51083b1d-7b88-4ac8-aa02-682dc4063b96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:14:18.105722 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51083b1d-7b88-4ac8-aa02-682dc4063b96 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:18.105961 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51083b1d-7b88-4ac8-aa02-682dc4063b96 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:18.106238 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51083b1d-7b88-4ac8-aa02-682dc4063b96 None admin] PATH_INFO: `/v3/users` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:18.107080 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51083b1d-7b88-4ac8-aa02-682dc4063b96 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:14:18.107429 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51083b1d-7b88-4ac8-aa02-682dc4063b96 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:14:18.108839 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51083b1d-7b88-4ac8-aa02-682dc4063b96 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:14:18.132165 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 422/858] 10.222.0.44 () {56 vars in 1135 bytes} [Thu Jun 16 12:14:17 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:14:18.133378 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51083b1d-7b88-4ac8-aa02-682dc4063b96 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:14:18.143829 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:14:18.188530 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 437/859] 10.222.0.44 () {58 vars in 1282 bytes} [Thu Jun 16 12:14:17 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 16 12:14:18.189835 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb2e896-015f-4a45-843b-8f4fe1d8babc None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:14:18.237135 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51083b1d-7b88-4ac8-aa02-682dc4063b96 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:14:18.273363 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663b2ea3-9c8a-4664-922e-86518b314211 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:14:18.273934 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663b2ea3-9c8a-4664-922e-86518b314211 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:18.274214 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663b2ea3-9c8a-4664-922e-86518b314211 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:18.274577 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663b2ea3-9c8a-4664-922e-86518b314211 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:18.294967 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb2e896-015f-4a45-843b-8f4fe1d8babc None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:14:18.305052 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:14:18.332301 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60024d50-1245-4905-9073-97f87bf6914b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:14:18.333436 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60024d50-1245-4905-9073-97f87bf6914b None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:18.333925 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60024d50-1245-4905-9073-97f87bf6914b None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:18.334486 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60024d50-1245-4905-9073-97f87bf6914b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:18.344784 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663b2ea3-9c8a-4664-922e-86518b314211 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:14:18.345741 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60024d50-1245-4905-9073-97f87bf6914b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:14:18.346216 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663b2ea3-9c8a-4664-922e-86518b314211 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:14:18.347682 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60024d50-1245-4905-9073-97f87bf6914b None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:14:18.356295 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:14:18.368115 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-60024d50-1245-4905-9073-97f87bf6914b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 12:14:18.368115 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 12:14:18.368115 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 12:14:18.368115 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 12:14:18.368115 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 12:14:18.368115 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 12:14:18.368115 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 12:14:18.368115 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 12:14:18.368115 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 12:14:18.368115 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 12:14:18.368115 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 12:14:18.368115 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 12:14:18.368115 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 12:14:18.368115 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 12:14:18.368115 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 12:14:18.369049 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 12:14:18.369049 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 12:14:18.369049 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 12:14:18.369049 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 12:14:18.369049 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 12:14:18.369049 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 12:14:18.369049 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 12:14:18.369049 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 12:14:18.369049 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jun 16 12:14:18.369049 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 12:14:18.369049 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jun 16 12:14:18.369049 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 12:14:18.369049 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 12:14:18.369049 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 12:14:18.369049 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jun 16 12:14:18.369049 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 12:14:18.369049 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jun 16 12:14:18.369922 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 12:14:18.369922 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 12:14:18.369922 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 12:14:18.369922 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jun 16 12:14:18.376335 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 438/860] 10.222.0.44 () {56 vars in 1108 bytes} [Thu Jun 16 12:14:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 12:14:18.377387 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60024d50-1245-4905-9073-97f87bf6914b None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:14:18.458797 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 423/861] 10.222.0.44 () {58 vars in 1282 bytes} [Thu Jun 16 12:14:18 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 16 12:14:18.459713 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663b2ea3-9c8a-4664-922e-86518b314211 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:14:18.489722 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60024d50-1245-4905-9073-97f87bf6914b None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:14:18.525704 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1eee77-092c-4ed9-a5f9-d4fd6d6e8eeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:14:18.526702 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1eee77-092c-4ed9-a5f9-d4fd6d6e8eeb None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:18.527186 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1eee77-092c-4ed9-a5f9-d4fd6d6e8eeb None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:18.527679 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1eee77-092c-4ed9-a5f9-d4fd6d6e8eeb None admin] PATH_INFO: `/v3/domains` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:18.528601 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1eee77-092c-4ed9-a5f9-d4fd6d6e8eeb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:14:18.529136 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1eee77-092c-4ed9-a5f9-d4fd6d6e8eeb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:14:18.530731 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1eee77-092c-4ed9-a5f9-d4fd6d6e8eeb None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:14:18.548336 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 439/862] 10.222.0.44 () {56 vars in 1109 bytes} [Thu Jun 16 12:14:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:14:18.549584 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1eee77-092c-4ed9-a5f9-d4fd6d6e8eeb None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:14:18.565216 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663b2ea3-9c8a-4664-922e-86518b314211 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:14:18.566791 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:14:18.575482 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:14:18.603444 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab4fb34-b824-4c11-8c27-3d0015f6c5d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:14:18.603977 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab4fb34-b824-4c11-8c27-3d0015f6c5d9 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:18.604307 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab4fb34-b824-4c11-8c27-3d0015f6c5d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:18.604582 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab4fb34-b824-4c11-8c27-3d0015f6c5d9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:18.616293 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab4fb34-b824-4c11-8c27-3d0015f6c5d9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:14:18.617828 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab4fb34-b824-4c11-8c27-3d0015f6c5d9 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:14:18.636360 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application [None req-cab4fb34-b824-4c11-8c27-3d0015f6c5d9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 12:14:18.636360 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 12:14:18.636360 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 12:14:18.636360 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 12:14:18.636360 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 12:14:18.636360 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 12:14:18.636360 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 12:14:18.636360 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 12:14:18.636360 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 12:14:18.636360 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 12:14:18.636360 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 12:14:18.636360 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 12:14:18.636360 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 12:14:18.636360 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 12:14:18.636360 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 12:14:18.637502 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 12:14:18.637502 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 12:14:18.637502 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 12:14:18.637502 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 12:14:18.637502 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 12:14:18.637502 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 12:14:18.637502 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 12:14:18.637502 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 12:14:18.637502 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application with Lock( Jun 16 12:14:18.637502 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 12:14:18.637502 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._enter() Jun 16 12:14:18.637502 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 12:14:18.637502 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 12:14:18.637502 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 12:14:18.637502 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.creator() Jun 16 12:14:18.637502 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 12:14:18.637502 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application created_value = creator( Jun 16 12:14:18.638378 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 12:14:18.638378 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 12:14:18.638378 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 12:14:18.638378 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application Jun 16 12:14:18.642273 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 424/863] 10.222.0.44 () {56 vars in 1108 bytes} [Thu Jun 16 12:14:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 12:14:18.643158 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab4fb34-b824-4c11-8c27-3d0015f6c5d9 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:14:18.667259 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1eee77-092c-4ed9-a5f9-d4fd6d6e8eeb None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:14:18.705768 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d4093a-25d6-4e70-baea-d10e97db7c18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:14:18.707074 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d4093a-25d6-4e70-baea-d10e97db7c18 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:18.707561 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d4093a-25d6-4e70-baea-d10e97db7c18 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:18.708040 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d4093a-25d6-4e70-baea-d10e97db7c18 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:18.715409 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d4093a-25d6-4e70-baea-d10e97db7c18 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:14:18.717136 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d4093a-25d6-4e70-baea-d10e97db7c18 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:14:18.732440 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-24d4093a-25d6-4e70-baea-d10e97db7c18 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 12:14:18.732440 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 12:14:18.732440 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 12:14:18.732440 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 12:14:18.732440 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 12:14:18.732440 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 12:14:18.732440 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 12:14:18.732440 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 12:14:18.732440 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 12:14:18.732440 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 12:14:18.732440 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 12:14:18.732440 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 12:14:18.732440 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 12:14:18.732440 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 12:14:18.732440 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 12:14:18.733533 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 12:14:18.733533 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 12:14:18.733533 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 12:14:18.733533 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 12:14:18.733533 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 12:14:18.733533 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 12:14:18.733533 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 12:14:18.733533 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 12:14:18.733533 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jun 16 12:14:18.733533 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 12:14:18.733533 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jun 16 12:14:18.733533 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 12:14:18.733533 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 12:14:18.733533 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 12:14:18.733533 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jun 16 12:14:18.733533 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 12:14:18.733533 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jun 16 12:14:18.734616 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 12:14:18.734616 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 12:14:18.734616 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 12:14:18.734616 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 12:14:18.734616 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 12:14:18.734616 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 12:14:18.734616 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 12:14:18.734616 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jun 16 12:14:18.736616 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 440/864] 10.222.0.44 () {56 vars in 1111 bytes} [Thu Jun 16 12:14:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 12:14:18.738627 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06b3f74-cb97-49bb-8a48-8d4e2b6e25d2 None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:18.738907 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06b3f74-cb97-49bb-8a48-8d4e2b6e25d2 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:18.739182 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06b3f74-cb97-49bb-8a48-8d4e2b6e25d2 None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:18.740682 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 441/865] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 12:14:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 12:14:18.745890 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ca03c4-83d3-4d43-8595-83530bc5dd21 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:18.747379 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ca03c4-83d3-4d43-8595-83530bc5dd21 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:18.747653 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ca03c4-83d3-4d43-8595-83530bc5dd21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:18.759878 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab4fb34-b824-4c11-8c27-3d0015f6c5d9 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:14:18.764431 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-c5ca03c4-83d3-4d43-8595-83530bc5dd21 None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:14:18.765655 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-c5ca03c4-83d3-4d43-8595-83530bc5dd21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:14:18.795663 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c93def5-794f-4db9-a2b7-25409c9d9904 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:14:18.796247 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c93def5-794f-4db9-a2b7-25409c9d9904 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:18.796526 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c93def5-794f-4db9-a2b7-25409c9d9904 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:18.796830 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c93def5-794f-4db9-a2b7-25409c9d9904 None admin] PATH_INFO: `/v3/domains` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:18.797549 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c93def5-794f-4db9-a2b7-25409c9d9904 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:14:18.797856 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c93def5-794f-4db9-a2b7-25409c9d9904 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:14:18.799209 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c93def5-794f-4db9-a2b7-25409c9d9904 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:14:18.813063 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 425/866] 10.222.0.44 () {56 vars in 1109 bytes} [Thu Jun 16 12:14:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:14:18.813754 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c93def5-794f-4db9-a2b7-25409c9d9904 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:14:18.838272 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:14:18.840545 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 442/867] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 12:14:18 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 16 12:14:18.841959 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ca03c4-83d3-4d43-8595-83530bc5dd21 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:14:18.845915 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:14:18.945583 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c93def5-794f-4db9-a2b7-25409c9d9904 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:14:18.951152 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ca03c4-83d3-4d43-8595-83530bc5dd21 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:14:18.981631 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c359acf0-1a6f-4117-8763-d954cfa30d90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:14:18.982278 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c359acf0-1a6f-4117-8763-d954cfa30d90 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:18.982563 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c359acf0-1a6f-4117-8763-d954cfa30d90 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:18.983092 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c359acf0-1a6f-4117-8763-d954cfa30d90 None admin] PATH_INFO: `/v3/projects` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:18.983701 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c359acf0-1a6f-4117-8763-d954cfa30d90 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:14:18.983960 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c359acf0-1a6f-4117-8763-d954cfa30d90 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:14:18.985479 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c359acf0-1a6f-4117-8763-d954cfa30d90 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:14:18.988256 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262b0417-c89f-4041-926f-2ef7050186d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:14:18.989111 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262b0417-c89f-4041-926f-2ef7050186d5 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:18.989401 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262b0417-c89f-4041-926f-2ef7050186d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:18.989672 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262b0417-c89f-4041-926f-2ef7050186d5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:18.997645 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262b0417-c89f-4041-926f-2ef7050186d5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:14:18.999178 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262b0417-c89f-4041-926f-2ef7050186d5 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:14:19.005164 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 426/868] 10.222.0.44 () {56 vars in 1148 bytes} [Thu Jun 16 12:14:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:14:19.006221 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c359acf0-1a6f-4117-8763-d954cfa30d90 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:14:19.014610 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-262b0417-c89f-4041-926f-2ef7050186d5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 12:14:19.014610 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 12:14:19.014610 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 12:14:19.014610 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 12:14:19.014610 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 12:14:19.014610 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 12:14:19.014610 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 12:14:19.014610 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 12:14:19.014610 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 12:14:19.014610 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 12:14:19.014610 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 12:14:19.014610 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 12:14:19.014610 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 12:14:19.014610 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 12:14:19.014610 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 12:14:19.015614 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 12:14:19.015614 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 12:14:19.015614 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 12:14:19.015614 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 12:14:19.015614 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 12:14:19.015614 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 12:14:19.015614 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 12:14:19.015614 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 12:14:19.015614 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jun 16 12:14:19.015614 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 12:14:19.015614 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jun 16 12:14:19.015614 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 12:14:19.015614 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 12:14:19.015614 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 12:14:19.015614 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jun 16 12:14:19.015614 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 12:14:19.015614 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jun 16 12:14:19.016497 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 12:14:19.016497 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 12:14:19.016497 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 12:14:19.016497 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 12:14:19.016497 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 12:14:19.016497 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 12:14:19.016497 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 12:14:19.016497 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jun 16 12:14:19.016497 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 443/869] 10.222.0.44 () {56 vars in 1111 bytes} [Thu Jun 16 12:14:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 12:14:19.017023 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262b0417-c89f-4041-926f-2ef7050186d5 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:14:19.083335 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:14:19.096807 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:14:19.116170 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c359acf0-1a6f-4117-8763-d954cfa30d90 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:14:19.120729 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262b0417-c89f-4041-926f-2ef7050186d5 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:14:19.150150 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b10b2c-6033-4ccf-b9ec-440cfb8d8e60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:14:19.150804 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b10b2c-6033-4ccf-b9ec-440cfb8d8e60 None admin] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:19.151090 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b10b2c-6033-4ccf-b9ec-440cfb8d8e60 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:19.151361 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b10b2c-6033-4ccf-b9ec-440cfb8d8e60 None admin] PATH_INFO: `/v3/services` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:19.152075 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b10b2c-6033-4ccf-b9ec-440cfb8d8e60 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:14:19.153469 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b10b2c-6033-4ccf-b9ec-440cfb8d8e60 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:14:19.153667 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9d441b-eb2e-4c82-9150-e1a060d05941 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:14:19.154312 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9d441b-eb2e-4c82-9150-e1a060d05941 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:19.154592 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9d441b-eb2e-4c82-9150-e1a060d05941 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:19.154865 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9d441b-eb2e-4c82-9150-e1a060d05941 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:19.155685 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9d441b-eb2e-4c82-9150-e1a060d05941 None admin] RBAC: Adding query filter params (role.id=a5c06bc21d39451285def24673456ff6, scope.project.id=601361df39e34fcca71175aa94e425c4, user.id=222b53cae3d64412b9b0a89d162311f4) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:14:19.155992 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9d441b-eb2e-4c82-9150-e1a060d05941 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:14:19.157504 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9d441b-eb2e-4c82-9150-e1a060d05941 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:14:19.164386 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 444/870] 10.222.0.44 () {56 vars in 1374 bytes} [Thu Jun 16 12:14:19 2022] GET /identity/v3/role_assignments?user.id=222b53cae3d64412b9b0a89d162311f4&scope.project.id=601361df39e34fcca71175aa94e425c4&role.id=a5c06bc21d39451285def24673456ff6 => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:14:19.165275 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9d441b-eb2e-4c82-9150-e1a060d05941 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:14:19.180784 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 427/871] 10.222.0.44 () {60 vars in 1141 bytes} [Thu Jun 16 12:14:19 2022] POST /identity/v3/services => generated 269 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 12:14:19.180784 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d034ce9c-49a2-4309-b5c6-c273cba8f17c None None] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:19.180784 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d034ce9c-49a2-4309-b5c6-c273cba8f17c None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:19.180784 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d034ce9c-49a2-4309-b5c6-c273cba8f17c None None] PATH_INFO: `/` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:19.180784 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 428/872] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 12:14:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 12:14:19.180784 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a43b02-382f-4c4d-8464-6c539ea7e1eb None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:19.181312 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a43b02-382f-4c4d-8464-6c539ea7e1eb None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:19.181312 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a43b02-382f-4c4d-8464-6c539ea7e1eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:19.199959 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-d8a43b02-382f-4c4d-8464-6c539ea7e1eb None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:14:19.201301 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-d8a43b02-382f-4c4d-8464-6c539ea7e1eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:14:19.299047 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9d441b-eb2e-4c82-9150-e1a060d05941 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:14:19.312839 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 429/873] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 12:14:19 2022] POST /identity/v3/auth/tokens => generated 1261 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 12:14:19.336897 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a43b02-382f-4c4d-8464-6c539ea7e1eb None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:14:19.341122 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:14:19.346515 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bf7ad5-b60d-43c7-a3a7-aea248ce985c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:14:19.347335 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bf7ad5-b60d-43c7-a3a7-aea248ce985c None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:19.347621 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bf7ad5-b60d-43c7-a3a7-aea248ce985c None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:19.347893 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bf7ad5-b60d-43c7-a3a7-aea248ce985c None admin] PATH_INFO: `/v3/projects` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:19.348694 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bf7ad5-b60d-43c7-a3a7-aea248ce985c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:14:19.349046 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bf7ad5-b60d-43c7-a3a7-aea248ce985c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:14:19.350514 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bf7ad5-b60d-43c7-a3a7-aea248ce985c None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:14:19.368933 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 445/874] 10.222.0.44 () {56 vars in 1148 bytes} [Thu Jun 16 12:14:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:14:19.371217 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bf7ad5-b60d-43c7-a3a7-aea248ce985c None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:14:19.415820 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:14:19.456313 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a43b02-382f-4c4d-8464-6c539ea7e1eb None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:14:19.495925 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bf7ad5-b60d-43c7-a3a7-aea248ce985c None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:14:19.496937 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c862ab27-8892-4b32-8272-89b07ce7255f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:14:19.497897 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c862ab27-8892-4b32-8272-89b07ce7255f None admin] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:19.499062 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c862ab27-8892-4b32-8272-89b07ce7255f None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:19.499356 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c862ab27-8892-4b32-8272-89b07ce7255f None admin] PATH_INFO: `/v3/services` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:19.500124 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c862ab27-8892-4b32-8272-89b07ce7255f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:14:19.501514 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c862ab27-8892-4b32-8272-89b07ce7255f None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:14:19.521808 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 430/875] 10.222.0.44 () {60 vars in 1141 bytes} [Thu Jun 16 12:14:19 2022] POST /identity/v3/services => generated 251 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 12:14:19.548884 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea324fc4-2132-4d9a-bcda-10f234cd1ab5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:14:19.549565 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea324fc4-2132-4d9a-bcda-10f234cd1ab5 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:19.549846 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea324fc4-2132-4d9a-bcda-10f234cd1ab5 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:19.550128 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea324fc4-2132-4d9a-bcda-10f234cd1ab5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:19.551031 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea324fc4-2132-4d9a-bcda-10f234cd1ab5 None admin] RBAC: Adding query filter params (role.id=0688968254744e3f9913653cafea3091, scope.project.id=601361df39e34fcca71175aa94e425c4, user.id=c159f79c1921496487101aac5d530ae5) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:14:19.551344 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea324fc4-2132-4d9a-bcda-10f234cd1ab5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:14:19.552987 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea324fc4-2132-4d9a-bcda-10f234cd1ab5 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:14:19.560605 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 446/876] 10.222.0.44 () {56 vars in 1374 bytes} [Thu Jun 16 12:14:19 2022] GET /identity/v3/role_assignments?user.id=c159f79c1921496487101aac5d530ae5&scope.project.id=601361df39e34fcca71175aa94e425c4&role.id=0688968254744e3f9913653cafea3091 => generated 608 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 12:14:21.403317 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324ef421-b654-4180-9162-1aa07ccff198 None None] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:21.403890 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324ef421-b654-4180-9162-1aa07ccff198 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:21.403890 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324ef421-b654-4180-9162-1aa07ccff198 None None] PATH_INFO: `/` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:21.405679 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 431/877] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 12:14:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 12:14:21.412229 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d22a9e-03f4-4456-a505-ca7a3f3d9b3d None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:21.412744 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d22a9e-03f4-4456-a505-ca7a3f3d9b3d None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:21.412878 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d22a9e-03f4-4456-a505-ca7a3f3d9b3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:21.430886 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-49d22a9e-03f4-4456-a505-ca7a3f3d9b3d None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:14:21.432080 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-49d22a9e-03f4-4456-a505-ca7a3f3d9b3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:14:21.470318 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a92d26-8b4c-499f-a141-f521cb7df5b9 None None] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:21.470596 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a92d26-8b4c-499f-a141-f521cb7df5b9 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:21.470868 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a92d26-8b4c-499f-a141-f521cb7df5b9 None None] PATH_INFO: `/` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:21.473289 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 432/878] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 12:14:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 12:14:21.479045 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f150e7f-73bf-4eee-8565-c34f40ca4e4a None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:21.479334 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f150e7f-73bf-4eee-8565-c34f40ca4e4a None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:21.479614 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f150e7f-73bf-4eee-8565-c34f40ca4e4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:21.486352 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:14:21.504651 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-8f150e7f-73bf-4eee-8565-c34f40ca4e4a None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:14:21.506184 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-8f150e7f-73bf-4eee-8565-c34f40ca4e4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:14:21.516830 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 447/879] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 12:14:21 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 12:14:21.541270 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d22a9e-03f4-4456-a505-ca7a3f3d9b3d None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:14:21.579803 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 433/880] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 12:14:21 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 16 12:14:21.609591 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f150e7f-73bf-4eee-8565-c34f40ca4e4a None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:14:21.657318 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d22a9e-03f4-4456-a505-ca7a3f3d9b3d None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:14:21.672676 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:14:21.705362 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e4b886-08b1-4af9-a1b2-fcb77c3cdde7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:14:21.707384 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e4b886-08b1-4af9-a1b2-fcb77c3cdde7 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:21.708094 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e4b886-08b1-4af9-a1b2-fcb77c3cdde7 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:21.708612 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e4b886-08b1-4af9-a1b2-fcb77c3cdde7 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:21.709546 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e4b886-08b1-4af9-a1b2-fcb77c3cdde7 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:14:21.711388 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e4b886-08b1-4af9-a1b2-fcb77c3cdde7 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:14:21.726051 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-69e4b886-08b1-4af9-a1b2-fcb77c3cdde7 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 16 12:14:21.726051 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 12:14:21.726051 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 12:14:21.726051 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 12:14:21.726051 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 12:14:21.726051 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 12:14:21.726051 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 12:14:21.726051 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 12:14:21.726051 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 16 12:14:21.726051 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jun 16 12:14:21.726051 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 12:14:21.726051 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jun 16 12:14:21.726051 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 12:14:21.726051 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 12:14:21.726051 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 12:14:21.726051 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 12:14:21.727120 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 12:14:21.727120 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 12:14:21.727120 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 12:14:21.727120 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 12:14:21.727120 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 12:14:21.727120 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 12:14:21.727120 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 12:14:21.727120 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 12:14:21.727120 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 12:14:21.727120 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 12:14:21.727120 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 12:14:21.727120 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 12:14:21.727120 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 12:14:21.727120 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 12:14:21.727120 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 12:14:21.727120 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 12:14:21.728015 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 12:14:21.728015 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 12:14:21.728015 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jun 16 12:14:21.728015 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 12:14:21.728015 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jun 16 12:14:21.728015 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 12:14:21.728015 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 12:14:21.728015 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 12:14:21.728015 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jun 16 12:14:21.728015 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 12:14:21.728015 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jun 16 12:14:21.728015 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 12:14:21.728015 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 12:14:21.728015 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 16 12:14:21.728015 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jun 16 12:14:21.728893 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f150e7f-73bf-4eee-8565-c34f40ca4e4a None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:14:21.735881 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 448/881] 10.222.0.44 () {56 vars in 1132 bytes} [Thu Jun 16 12:14:21 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 12:14:21.735881 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fde3a7-39b7-4420-bdaa-6a3db42260d5 None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:21.735881 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fde3a7-39b7-4420-bdaa-6a3db42260d5 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:21.735881 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fde3a7-39b7-4420-bdaa-6a3db42260d5 None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:21.735881 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 449/882] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 12:14:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 12:14:21.737621 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fde3a7-39b7-4420-bdaa-6a3db42260d5 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:14:21.766526 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2165d94f-4ee6-4860-8e8a-cfd2a0c8f5d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:14:21.767339 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2165d94f-4ee6-4860-8e8a-cfd2a0c8f5d4 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:21.767624 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2165d94f-4ee6-4860-8e8a-cfd2a0c8f5d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:21.767904 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2165d94f-4ee6-4860-8e8a-cfd2a0c8f5d4 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:21.778729 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2165d94f-4ee6-4860-8e8a-cfd2a0c8f5d4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 12:14:21.783892 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:14:21.787208 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application [None req-2165d94f-4ee6-4860-8e8a-cfd2a0c8f5d4 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 16 12:14:21.787208 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 12:14:21.787208 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 12:14:21.787208 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 12:14:21.787208 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 12:14:21.787208 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 12:14:21.787208 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 12:14:21.787208 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 12:14:21.787208 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 12:14:21.787208 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 12:14:21.787208 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 12:14:21.787208 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 12:14:21.787208 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 12:14:21.787208 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 12:14:21.787208 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 12:14:21.787208 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 12:14:21.788171 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 12:14:21.788171 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 12:14:21.788171 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 12:14:21.788171 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 12:14:21.788171 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 12:14:21.788171 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 12:14:21.788171 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 12:14:21.788171 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 12:14:21.788171 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 12:14:21.788171 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 12:14:21.788171 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 12:14:21.788171 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application with Lock( Jun 16 12:14:21.788171 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 12:14:21.788171 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._enter() Jun 16 12:14:21.788171 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 12:14:21.788171 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 12:14:21.789041 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 12:14:21.789041 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.creator() Jun 16 12:14:21.789041 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 12:14:21.789041 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application created_value = creator( Jun 16 12:14:21.789041 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 12:14:21.789041 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 12:14:21.789041 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 12:14:21.789041 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 12:14:21.789041 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 12:14:21.789041 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 12:14:21.789041 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 16 12:14:21.789041 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application Jun 16 12:14:21.789041 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 434/883] 10.222.0.44 () {56 vars in 1120 bytes} [Thu Jun 16 12:14:21 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 12:14:21.789948 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8102f09d-cebf-4c12-8f56-8d746e1a7f96 None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:21.789948 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8102f09d-cebf-4c12-8f56-8d746e1a7f96 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:21.790114 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8102f09d-cebf-4c12-8f56-8d746e1a7f96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:21.806484 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-8102f09d-cebf-4c12-8f56-8d746e1a7f96 None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:14:21.807678 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-8102f09d-cebf-4c12-8f56-8d746e1a7f96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:14:21.845076 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fde3a7-39b7-4420-bdaa-6a3db42260d5 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:14:21.875323 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 435/884] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 12:14:21 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 12:14:21.876620 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d04162f-123f-4efa-ac2a-841d33ed30f1 None None] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:21.877018 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d04162f-123f-4efa-ac2a-841d33ed30f1 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:21.877243 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d04162f-123f-4efa-ac2a-841d33ed30f1 None None] PATH_INFO: `/` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:21.878147 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca7b65f-46ba-4265-a606-e10a64008c38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:14:21.880801 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 436/885] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 12:14:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 12:14:21.880940 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca7b65f-46ba-4265-a606-e10a64008c38 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:21.880940 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca7b65f-46ba-4265-a606-e10a64008c38 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:21.880940 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca7b65f-46ba-4265-a606-e10a64008c38 None admin] PATH_INFO: `/v3/services` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:21.881187 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d04162f-123f-4efa-ac2a-841d33ed30f1 None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:14:21.881265 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca7b65f-46ba-4265-a606-e10a64008c38 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:14:21.881265 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca7b65f-46ba-4265-a606-e10a64008c38 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:14:21.882367 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca7b65f-46ba-4265-a606-e10a64008c38 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:14:21.888917 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 450/886] 10.222.0.44 () {56 vars in 1126 bytes} [Thu Jun 16 12:14:21 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:14:21.890683 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff286b12-6351-406b-8f61-6e2c26f8f704 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:21.890683 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff286b12-6351-406b-8f61-6e2c26f8f704 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:21.890683 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff286b12-6351-406b-8f61-6e2c26f8f704 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:21.908194 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-ff286b12-6351-406b-8f61-6e2c26f8f704 None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:14:21.909328 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-ff286b12-6351-406b-8f61-6e2c26f8f704 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:14:21.940011 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:14:21.979614 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 451/887] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 12:14:21 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 12:14:21.979614 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff286b12-6351-406b-8f61-6e2c26f8f704 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:14:22.001309 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d04162f-123f-4efa-ac2a-841d33ed30f1 None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:14:22.009656 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:14:22.035396 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183b898a-770a-47af-99c8-d359630bb7b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:14:22.036049 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183b898a-770a-47af-99c8-d359630bb7b4 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:22.036327 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183b898a-770a-47af-99c8-d359630bb7b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:22.036603 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183b898a-770a-47af-99c8-d359630bb7b4 None admin] PATH_INFO: `/v3/roles` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:22.037392 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183b898a-770a-47af-99c8-d359630bb7b4 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:14:22.037693 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183b898a-770a-47af-99c8-d359630bb7b4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:14:22.039036 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183b898a-770a-47af-99c8-d359630bb7b4 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:14:22.047045 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 437/888] 10.222.0.44 () {56 vars in 1115 bytes} [Thu Jun 16 12:14:21 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:14:22.047998 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183b898a-770a-47af-99c8-d359630bb7b4 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:14:22.076058 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff286b12-6351-406b-8f61-6e2c26f8f704 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:14:22.108214 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ca1467-b03b-49fa-8eda-d00f665fbc42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:14:22.108910 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ca1467-b03b-49fa-8eda-d00f665fbc42 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:22.109185 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ca1467-b03b-49fa-8eda-d00f665fbc42 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:22.109458 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ca1467-b03b-49fa-8eda-d00f665fbc42 None admin] PATH_INFO: `/v3/services` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:22.110155 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ca1467-b03b-49fa-8eda-d00f665fbc42 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:14:22.110457 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ca1467-b03b-49fa-8eda-d00f665fbc42 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:14:22.111819 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ca1467-b03b-49fa-8eda-d00f665fbc42 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:14:22.117482 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 452/889] 10.222.0.44 () {56 vars in 1126 bytes} [Thu Jun 16 12:14:21 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:14:22.118248 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ca1467-b03b-49fa-8eda-d00f665fbc42 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:14:22.148130 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183b898a-770a-47af-99c8-d359630bb7b4 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:14:22.156981 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:14:22.183561 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f83d77e-c53b-4a63-8124-daa699f10cae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:14:22.184287 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f83d77e-c53b-4a63-8124-daa699f10cae None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:22.184566 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f83d77e-c53b-4a63-8124-daa699f10cae None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:22.184872 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f83d77e-c53b-4a63-8124-daa699f10cae None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:22.185521 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f83d77e-c53b-4a63-8124-daa699f10cae None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:14:22.186875 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f83d77e-c53b-4a63-8124-daa699f10cae None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:14:22.199186 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application [None req-1f83d77e-c53b-4a63-8124-daa699f10cae None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 16 12:14:22.199186 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 12:14:22.199186 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 12:14:22.199186 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 12:14:22.199186 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 12:14:22.199186 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 12:14:22.199186 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 12:14:22.199186 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 12:14:22.199186 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 16 12:14:22.199186 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application Jun 16 12:14:22.199186 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 12:14:22.199186 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application Jun 16 12:14:22.199186 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 12:14:22.199186 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 12:14:22.199186 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 12:14:22.199186 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 12:14:22.199186 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 12:14:22.200397 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 12:14:22.200397 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 12:14:22.200397 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 12:14:22.200397 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 12:14:22.200397 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 12:14:22.200397 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 12:14:22.200397 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 12:14:22.200397 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 12:14:22.200397 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 12:14:22.200397 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 12:14:22.200397 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 12:14:22.200397 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 12:14:22.200397 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 12:14:22.200397 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 12:14:22.200397 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 12:14:22.200397 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 12:14:22.201352 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 12:14:22.201352 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application with Lock( Jun 16 12:14:22.201352 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 12:14:22.201352 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._enter() Jun 16 12:14:22.201352 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 12:14:22.201352 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 12:14:22.201352 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 12:14:22.201352 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.creator() Jun 16 12:14:22.201352 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 12:14:22.201352 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application created_value = creator( Jun 16 12:14:22.201352 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 12:14:22.201352 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 12:14:22.201352 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 16 12:14:22.201352 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application Jun 16 12:14:22.201352 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 438/890] 10.222.0.44 () {56 vars in 1114 bytes} [Thu Jun 16 12:14:22 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 12:14:22.202131 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f83d77e-c53b-4a63-8124-daa699f10cae None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:14:22.212670 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:14:22.216008 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ca1467-b03b-49fa-8eda-d00f665fbc42 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:14:22.250712 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958c390d-d6f7-4d68-81ee-645dd2e54cc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:14:22.251505 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958c390d-d6f7-4d68-81ee-645dd2e54cc8 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:22.251784 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958c390d-d6f7-4d68-81ee-645dd2e54cc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:22.252053 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958c390d-d6f7-4d68-81ee-645dd2e54cc8 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:22.252687 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958c390d-d6f7-4d68-81ee-645dd2e54cc8 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:14:22.254109 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958c390d-d6f7-4d68-81ee-645dd2e54cc8 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:14:22.265900 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-958c390d-d6f7-4d68-81ee-645dd2e54cc8 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 16 12:14:22.265900 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 12:14:22.265900 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 12:14:22.265900 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 12:14:22.265900 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 12:14:22.265900 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 12:14:22.265900 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 12:14:22.265900 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 12:14:22.265900 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 16 12:14:22.265900 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jun 16 12:14:22.265900 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 12:14:22.265900 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jun 16 12:14:22.265900 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 12:14:22.265900 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 12:14:22.265900 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 12:14:22.265900 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 12:14:22.265900 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 12:14:22.266879 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 12:14:22.266879 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 12:14:22.266879 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 12:14:22.266879 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 12:14:22.266879 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 12:14:22.266879 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 12:14:22.266879 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 12:14:22.266879 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 12:14:22.266879 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 12:14:22.266879 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 12:14:22.266879 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 12:14:22.266879 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 12:14:22.266879 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 12:14:22.266879 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 12:14:22.266879 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 12:14:22.266879 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 12:14:22.267730 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 12:14:22.267730 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jun 16 12:14:22.267730 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 12:14:22.267730 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jun 16 12:14:22.267730 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 12:14:22.267730 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 12:14:22.267730 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 12:14:22.267730 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jun 16 12:14:22.267730 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 12:14:22.267730 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jun 16 12:14:22.267730 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 12:14:22.267730 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 12:14:22.267730 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 16 12:14:22.267730 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jun 16 12:14:22.267730 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 453/891] 10.222.0.44 () {56 vars in 1126 bytes} [Thu Jun 16 12:14:22 2022] GET /identity/v3/services/object-store => generated 93 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 12:14:22.268515 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958c390d-d6f7-4d68-81ee-645dd2e54cc8 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:14:22.304265 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f83d77e-c53b-4a63-8124-daa699f10cae None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:14:22.338424 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fd5cd4-6ad6-4936-911f-a8955606056d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:14:22.339207 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fd5cd4-6ad6-4936-911f-a8955606056d None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:22.339486 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fd5cd4-6ad6-4936-911f-a8955606056d None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:22.339755 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fd5cd4-6ad6-4936-911f-a8955606056d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:22.350862 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fd5cd4-6ad6-4936-911f-a8955606056d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:14:22.352282 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fd5cd4-6ad6-4936-911f-a8955606056d None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:14:22.365534 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958c390d-d6f7-4d68-81ee-645dd2e54cc8 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:14:22.369312 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application [None req-b5fd5cd4-6ad6-4936-911f-a8955606056d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 12:14:22.369312 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 12:14:22.369312 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 12:14:22.369312 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 12:14:22.369312 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 12:14:22.369312 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 12:14:22.369312 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 12:14:22.369312 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 12:14:22.369312 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 12:14:22.369312 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 12:14:22.369312 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 12:14:22.369312 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 12:14:22.369312 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 12:14:22.369312 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 12:14:22.369312 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 12:14:22.370179 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 12:14:22.370179 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 12:14:22.370179 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 12:14:22.370179 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 12:14:22.370179 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 12:14:22.370179 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 12:14:22.370179 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 12:14:22.370179 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 12:14:22.370179 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application with Lock( Jun 16 12:14:22.370179 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 12:14:22.370179 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._enter() Jun 16 12:14:22.370179 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 12:14:22.370179 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 12:14:22.370179 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 12:14:22.370179 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.creator() Jun 16 12:14:22.370179 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 12:14:22.370179 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application created_value = creator( Jun 16 12:14:22.371067 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 12:14:22.371067 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 12:14:22.371067 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 12:14:22.371067 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application Jun 16 12:14:22.371067 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 439/892] 10.222.0.44 () {56 vars in 1108 bytes} [Thu Jun 16 12:14:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 12:14:22.371352 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fd5cd4-6ad6-4936-911f-a8955606056d None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:14:22.395226 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:14:22.402695 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2599a58e-131c-4624-b955-f1f7b48d5a85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:14:22.403340 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2599a58e-131c-4624-b955-f1f7b48d5a85 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:22.403614 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2599a58e-131c-4624-b955-f1f7b48d5a85 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:22.403883 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2599a58e-131c-4624-b955-f1f7b48d5a85 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:22.404656 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2599a58e-131c-4624-b955-f1f7b48d5a85 None admin] RBAC: Adding query filter params (interface=public, service_id=6174ccfe496e47599ab29880315b0839, region_id=RegionOne) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:14:22.404992 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2599a58e-131c-4624-b955-f1f7b48d5a85 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:14:22.406340 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2599a58e-131c-4624-b955-f1f7b48d5a85 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:14:22.411757 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 454/893] 10.222.0.44 () {56 vars in 1251 bytes} [Thu Jun 16 12:14:22 2022] GET /identity/v3/endpoints?service_id=6174ccfe496e47599ab29880315b0839&interface=public®ion_id=RegionOne => generated 194 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:14:22.412502 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2599a58e-131c-4624-b955-f1f7b48d5a85 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:14:22.440330 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:14:22.472650 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fd5cd4-6ad6-4936-911f-a8955606056d None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:14:22.506147 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f568984-f74c-4f79-b04f-ffdfc74344f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:14:22.506799 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f568984-f74c-4f79-b04f-ffdfc74344f6 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:22.507080 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f568984-f74c-4f79-b04f-ffdfc74344f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:22.507351 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f568984-f74c-4f79-b04f-ffdfc74344f6 None admin] PATH_INFO: `/v3/services` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:22.508049 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f568984-f74c-4f79-b04f-ffdfc74344f6 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:14:22.508353 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f568984-f74c-4f79-b04f-ffdfc74344f6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:14:22.509736 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f568984-f74c-4f79-b04f-ffdfc74344f6 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:14:22.513482 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2599a58e-131c-4624-b955-f1f7b48d5a85 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:14:22.514409 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 440/894] 10.222.0.44 () {56 vars in 1114 bytes} [Thu Jun 16 12:14:22 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:14:22.515189 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f568984-f74c-4f79-b04f-ffdfc74344f6 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:14:22.552384 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261b4a95-e8e3-47bf-8921-73367d562719 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:14:22.553079 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261b4a95-e8e3-47bf-8921-73367d562719 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:22.553361 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261b4a95-e8e3-47bf-8921-73367d562719 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:22.553634 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261b4a95-e8e3-47bf-8921-73367d562719 None admin] PATH_INFO: `/v3/services` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:22.554735 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261b4a95-e8e3-47bf-8921-73367d562719 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:14:22.555038 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261b4a95-e8e3-47bf-8921-73367d562719 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:14:22.556770 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261b4a95-e8e3-47bf-8921-73367d562719 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:14:22.561942 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 455/895] 10.222.0.44 () {56 vars in 1122 bytes} [Thu Jun 16 12:14:22 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:14:22.562701 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261b4a95-e8e3-47bf-8921-73367d562719 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:14:22.605341 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:14:22.618551 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f568984-f74c-4f79-b04f-ffdfc74344f6 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:14:22.651688 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543444aa-dd07-498b-9a6c-076a72828878 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:14:22.652344 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543444aa-dd07-498b-9a6c-076a72828878 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:22.652624 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543444aa-dd07-498b-9a6c-076a72828878 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:22.652927 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543444aa-dd07-498b-9a6c-076a72828878 None admin] PATH_INFO: `/v3/domains` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:22.653642 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543444aa-dd07-498b-9a6c-076a72828878 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:14:22.653945 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543444aa-dd07-498b-9a6c-076a72828878 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:14:22.654340 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:14:22.655338 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543444aa-dd07-498b-9a6c-076a72828878 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:14:22.663445 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261b4a95-e8e3-47bf-8921-73367d562719 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:14:22.667704 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 441/896] 10.222.0.44 () {56 vars in 1109 bytes} [Thu Jun 16 12:14:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:14:22.668670 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543444aa-dd07-498b-9a6c-076a72828878 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:14:22.698944 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadf70d9-b82d-4e9c-b984-19e79a7986af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:14:22.699535 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadf70d9-b82d-4e9c-b984-19e79a7986af None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:22.699814 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadf70d9-b82d-4e9c-b984-19e79a7986af None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:22.700088 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadf70d9-b82d-4e9c-b984-19e79a7986af None admin] PATH_INFO: `/v3/services` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:22.700768 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadf70d9-b82d-4e9c-b984-19e79a7986af None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:14:22.702188 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadf70d9-b82d-4e9c-b984-19e79a7986af None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:14:22.708268 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 456/897] 10.222.0.44 () {56 vars in 1087 bytes} [Thu Jun 16 12:14:22 2022] GET /identity/v3/services => generated 1268 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 12:14:22.709063 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadf70d9-b82d-4e9c-b984-19e79a7986af None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:14:22.778513 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543444aa-dd07-498b-9a6c-076a72828878 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:14:22.815802 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309a87a3-ed2a-4268-995e-af6eb7891909 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:14:22.816594 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309a87a3-ed2a-4268-995e-af6eb7891909 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:22.816905 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309a87a3-ed2a-4268-995e-af6eb7891909 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:22.817282 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309a87a3-ed2a-4268-995e-af6eb7891909 None admin] PATH_INFO: `/v3/services` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:22.818097 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309a87a3-ed2a-4268-995e-af6eb7891909 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:14:22.818412 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309a87a3-ed2a-4268-995e-af6eb7891909 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:14:22.820349 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309a87a3-ed2a-4268-995e-af6eb7891909 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:14:22.823451 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadf70d9-b82d-4e9c-b984-19e79a7986af None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:14:22.826545 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 442/898] 10.222.0.44 () {56 vars in 1114 bytes} [Thu Jun 16 12:14:22 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:14:22.827165 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309a87a3-ed2a-4268-995e-af6eb7891909 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:14:22.843967 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:14:22.865268 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcf3a9e-2718-46ea-aa6e-6c4d2bb5bd47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:14:22.866425 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcf3a9e-2718-46ea-aa6e-6c4d2bb5bd47 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:22.866425 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcf3a9e-2718-46ea-aa6e-6c4d2bb5bd47 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:22.866655 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcf3a9e-2718-46ea-aa6e-6c4d2bb5bd47 None admin] PATH_INFO: `/v3/services` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:22.867169 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcf3a9e-2718-46ea-aa6e-6c4d2bb5bd47 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:14:22.867471 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcf3a9e-2718-46ea-aa6e-6c4d2bb5bd47 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:14:22.868862 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcf3a9e-2718-46ea-aa6e-6c4d2bb5bd47 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:14:22.875657 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 457/899] 10.222.0.44 () {56 vars in 1122 bytes} [Thu Jun 16 12:14:22 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:14:22.876152 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcf3a9e-2718-46ea-aa6e-6c4d2bb5bd47 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:14:22.904290 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:14:22.955776 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309a87a3-ed2a-4268-995e-af6eb7891909 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:14:23.001009 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64061b7e-9312-4968-8e88-60b3e4f6830b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:14:23.001839 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64061b7e-9312-4968-8e88-60b3e4f6830b None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:23.002287 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64061b7e-9312-4968-8e88-60b3e4f6830b None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:23.002561 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64061b7e-9312-4968-8e88-60b3e4f6830b None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:23.013685 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64061b7e-9312-4968-8e88-60b3e4f6830b None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:14:23.013886 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcf3a9e-2718-46ea-aa6e-6c4d2bb5bd47 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:14:23.015271 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64061b7e-9312-4968-8e88-60b3e4f6830b None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:14:23.035770 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application [None req-64061b7e-9312-4968-8e88-60b3e4f6830b None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 16 12:14:23.035770 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 12:14:23.035770 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 12:14:23.035770 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 12:14:23.035770 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 12:14:23.035770 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 12:14:23.035770 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 12:14:23.035770 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 12:14:23.035770 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 12:14:23.035770 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 12:14:23.035770 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 12:14:23.035770 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 12:14:23.035770 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 12:14:23.035770 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 12:14:23.035770 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 12:14:23.035770 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 12:14:23.036870 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 12:14:23.036870 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 12:14:23.036870 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 12:14:23.036870 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 12:14:23.036870 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 12:14:23.036870 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 12:14:23.036870 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 12:14:23.036870 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 12:14:23.036870 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 12:14:23.036870 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 12:14:23.036870 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 12:14:23.036870 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application with Lock( Jun 16 12:14:23.036870 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 12:14:23.036870 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._enter() Jun 16 12:14:23.036870 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 12:14:23.036870 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 12:14:23.036870 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 12:14:23.036870 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.creator() Jun 16 12:14:23.037798 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 12:14:23.037798 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application created_value = creator( Jun 16 12:14:23.037798 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 12:14:23.037798 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 12:14:23.037798 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 12:14:23.037798 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 12:14:23.037798 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 12:14:23.037798 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 12:14:23.037798 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 16 12:14:23.037798 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application Jun 16 12:14:23.037798 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 443/900] 10.222.0.44 () {56 vars in 1117 bytes} [Thu Jun 16 12:14:22 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 12:14:23.044186 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64061b7e-9312-4968-8e88-60b3e4f6830b None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:14:23.053809 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879c4205-9ad2-4f70-bc6c-608ecafc859b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:14:23.054472 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879c4205-9ad2-4f70-bc6c-608ecafc859b None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:23.054748 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879c4205-9ad2-4f70-bc6c-608ecafc859b None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:23.055020 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879c4205-9ad2-4f70-bc6c-608ecafc859b None admin] PATH_INFO: `/v3/endpoints` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:23.055803 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879c4205-9ad2-4f70-bc6c-608ecafc859b None admin] RBAC: Adding query filter params (interface=public, service_id=8c4002a185ed48169b54e1210d314e30, region_id=RegionOne) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:14:23.056108 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879c4205-9ad2-4f70-bc6c-608ecafc859b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:14:23.057503 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879c4205-9ad2-4f70-bc6c-608ecafc859b None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:14:23.063803 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 458/901] 10.222.0.44 () {56 vars in 1251 bytes} [Thu Jun 16 12:14:22 2022] GET /identity/v3/endpoints?service_id=8c4002a185ed48169b54e1210d314e30&interface=public®ion_id=RegionOne => generated 194 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:14:23.069717 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879c4205-9ad2-4f70-bc6c-608ecafc859b None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:14:23.130486 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:14:23.162882 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64061b7e-9312-4968-8e88-60b3e4f6830b None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:14:23.176174 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:14:23.197815 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879c4205-9ad2-4f70-bc6c-608ecafc859b None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:14:23.200800 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0433d58f-7467-4363-b717-84cb2d2a13f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:14:23.201579 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0433d58f-7467-4363-b717-84cb2d2a13f5 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:23.201953 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0433d58f-7467-4363-b717-84cb2d2a13f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:23.202320 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0433d58f-7467-4363-b717-84cb2d2a13f5 None admin] PATH_INFO: `/v3/users` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:23.203264 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0433d58f-7467-4363-b717-84cb2d2a13f5 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:14:23.203688 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0433d58f-7467-4363-b717-84cb2d2a13f5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:14:23.205417 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0433d58f-7467-4363-b717-84cb2d2a13f5 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:14:23.230662 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 444/902] 10.222.0.44 () {56 vars in 1149 bytes} [Thu Jun 16 12:14:23 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:14:23.231796 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0433d58f-7467-4363-b717-84cb2d2a13f5 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:14:23.238409 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19aa6feb-2591-4cd6-8b8c-a7bf71aeff65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:14:23.239084 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19aa6feb-2591-4cd6-8b8c-a7bf71aeff65 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:23.239368 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19aa6feb-2591-4cd6-8b8c-a7bf71aeff65 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:23.239642 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19aa6feb-2591-4cd6-8b8c-a7bf71aeff65 None admin] PATH_INFO: `/v3/services` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:23.240329 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19aa6feb-2591-4cd6-8b8c-a7bf71aeff65 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:14:23.242253 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19aa6feb-2591-4cd6-8b8c-a7bf71aeff65 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:14:23.252844 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 459/903] 10.222.0.44 () {56 vars in 1087 bytes} [Thu Jun 16 12:14:23 2022] GET /identity/v3/services => generated 1268 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 12:14:23.354389 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0433d58f-7467-4363-b717-84cb2d2a13f5 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:14:23.386113 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:14:23.392804 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe73121-b091-4487-b205-c21427aa13cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:14:23.393474 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe73121-b091-4487-b205-c21427aa13cc None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:23.394315 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe73121-b091-4487-b205-c21427aa13cc None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:23.394590 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe73121-b091-4487-b205-c21427aa13cc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:23.475110 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe73121-b091-4487-b205-c21427aa13cc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:14:23.476618 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe73121-b091-4487-b205-c21427aa13cc None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:14:23.581684 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 445/904] 10.222.0.44 () {58 vars in 1282 bytes} [Thu Jun 16 12:14:23 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 16 12:14:23.586837 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19aa6feb-2591-4cd6-8b8c-a7bf71aeff65 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:14:23.689655 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19aa6feb-2591-4cd6-8b8c-a7bf71aeff65 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:14:23.725075 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc72b89-e95a-4c0e-b93f-8b8e33af51cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:14:23.725913 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc72b89-e95a-4c0e-b93f-8b8e33af51cb None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:23.726186 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc72b89-e95a-4c0e-b93f-8b8e33af51cb None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:23.726498 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc72b89-e95a-4c0e-b93f-8b8e33af51cb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:23.737100 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc72b89-e95a-4c0e-b93f-8b8e33af51cb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:14:23.738568 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc72b89-e95a-4c0e-b93f-8b8e33af51cb None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:14:23.758676 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-1dc72b89-e95a-4c0e-b93f-8b8e33af51cb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 12:14:23.758676 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 12:14:23.758676 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 12:14:23.758676 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 12:14:23.758676 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 12:14:23.758676 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 12:14:23.758676 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 12:14:23.758676 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 12:14:23.758676 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 12:14:23.758676 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 12:14:23.758676 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 12:14:23.758676 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 12:14:23.758676 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 12:14:23.758676 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 12:14:23.758676 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 12:14:23.760669 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 12:14:23.760669 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 12:14:23.760669 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 12:14:23.760669 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 12:14:23.760669 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 12:14:23.760669 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 12:14:23.760669 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 12:14:23.760669 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 12:14:23.760669 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jun 16 12:14:23.760669 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 12:14:23.760669 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jun 16 12:14:23.760669 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 12:14:23.760669 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 12:14:23.760669 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 12:14:23.760669 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jun 16 12:14:23.760669 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 12:14:23.760669 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jun 16 12:14:23.763627 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 12:14:23.763627 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 12:14:23.763627 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 12:14:23.763627 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jun 16 12:14:23.763627 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:14:23.763627 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 460/905] 10.222.0.44 () {56 vars in 1108 bytes} [Thu Jun 16 12:14:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 12:14:23.766514 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe73121-b091-4487-b205-c21427aa13cc None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:14:23.797855 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:14:23.871475 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe73121-b091-4487-b205-c21427aa13cc None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:14:23.908244 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7513cde-6f26-432d-8f14-2a0e94f453b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:14:23.909355 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7513cde-6f26-432d-8f14-2a0e94f453b9 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:23.909826 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7513cde-6f26-432d-8f14-2a0e94f453b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:23.910296 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7513cde-6f26-432d-8f14-2a0e94f453b9 None admin] PATH_INFO: `/v3/domains` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:23.911208 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7513cde-6f26-432d-8f14-2a0e94f453b9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:14:23.911690 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7513cde-6f26-432d-8f14-2a0e94f453b9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:14:23.913364 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7513cde-6f26-432d-8f14-2a0e94f453b9 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:14:23.927311 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 446/906] 10.222.0.44 () {56 vars in 1109 bytes} [Thu Jun 16 12:14:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:14:23.938126 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc72b89-e95a-4c0e-b93f-8b8e33af51cb None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:14:24.047808 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc72b89-e95a-4c0e-b93f-8b8e33af51cb None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:14:24.084228 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38f21ca-c2d1-4aee-b3e5-5c3860375099 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:14:24.085063 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38f21ca-c2d1-4aee-b3e5-5c3860375099 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:24.085350 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38f21ca-c2d1-4aee-b3e5-5c3860375099 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:24.085623 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38f21ca-c2d1-4aee-b3e5-5c3860375099 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:24.092728 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38f21ca-c2d1-4aee-b3e5-5c3860375099 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:14:24.094207 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38f21ca-c2d1-4aee-b3e5-5c3860375099 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:14:24.108682 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-b38f21ca-c2d1-4aee-b3e5-5c3860375099 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 12:14:24.108682 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 12:14:24.108682 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 12:14:24.108682 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 12:14:24.108682 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 12:14:24.108682 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 12:14:24.108682 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 12:14:24.108682 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 12:14:24.108682 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 12:14:24.108682 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 12:14:24.108682 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 12:14:24.108682 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 12:14:24.108682 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 12:14:24.108682 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 12:14:24.108682 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 12:14:24.109609 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 12:14:24.109609 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 12:14:24.109609 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 12:14:24.109609 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 12:14:24.109609 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 12:14:24.109609 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 12:14:24.109609 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 12:14:24.109609 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 12:14:24.109609 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jun 16 12:14:24.109609 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 12:14:24.109609 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jun 16 12:14:24.109609 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 12:14:24.109609 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 12:14:24.109609 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 12:14:24.109609 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jun 16 12:14:24.109609 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 12:14:24.109609 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jun 16 12:14:24.110480 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 12:14:24.110480 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 12:14:24.110480 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 12:14:24.110480 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 12:14:24.110480 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 12:14:24.110480 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 12:14:24.110480 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 12:14:24.110480 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jun 16 12:14:24.115170 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 461/907] 10.222.0.44 () {56 vars in 1111 bytes} [Thu Jun 16 12:14:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 12:14:24.116530 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7513cde-6f26-432d-8f14-2a0e94f453b9 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:14:24.213012 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:14:24.223300 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7513cde-6f26-432d-8f14-2a0e94f453b9 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:14:24.257866 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2df4490-38d0-4410-9eb3-45c5b2a80d02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:14:24.258774 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2df4490-38d0-4410-9eb3-45c5b2a80d02 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:24.259281 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2df4490-38d0-4410-9eb3-45c5b2a80d02 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:24.259761 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2df4490-38d0-4410-9eb3-45c5b2a80d02 None admin] PATH_INFO: `/v3/projects` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:24.260775 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2df4490-38d0-4410-9eb3-45c5b2a80d02 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:14:24.261291 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2df4490-38d0-4410-9eb3-45c5b2a80d02 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:14:24.262891 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2df4490-38d0-4410-9eb3-45c5b2a80d02 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:14:24.275362 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 447/908] 10.222.0.44 () {56 vars in 1148 bytes} [Thu Jun 16 12:14:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:14:24.284776 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38f21ca-c2d1-4aee-b3e5-5c3860375099 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:14:24.342935 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:14:24.386056 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38f21ca-c2d1-4aee-b3e5-5c3860375099 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:14:24.421361 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78656923-1f29-490e-82ae-72f1a7b50053 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:14:24.422152 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78656923-1f29-490e-82ae-72f1a7b50053 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:24.422435 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78656923-1f29-490e-82ae-72f1a7b50053 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:24.422712 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78656923-1f29-490e-82ae-72f1a7b50053 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:24.423578 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78656923-1f29-490e-82ae-72f1a7b50053 None admin] RBAC: Adding query filter params (role.id=6b361854fbed4b698a92f8199670a956, scope.project.id=601361df39e34fcca71175aa94e425c4, user.id=222b53cae3d64412b9b0a89d162311f4) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:14:24.423891 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78656923-1f29-490e-82ae-72f1a7b50053 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:14:24.425981 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78656923-1f29-490e-82ae-72f1a7b50053 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:14:24.436877 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 462/909] 10.222.0.44 () {56 vars in 1374 bytes} [Thu Jun 16 12:14:24 2022] GET /identity/v3/role_assignments?user.id=222b53cae3d64412b9b0a89d162311f4&scope.project.id=601361df39e34fcca71175aa94e425c4&role.id=6b361854fbed4b698a92f8199670a956 => generated 259 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:14:25.026022 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b714a3ea-acbb-4fa1-bd13-dedfd3a5ff3e None None] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:25.027049 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b714a3ea-acbb-4fa1-bd13-dedfd3a5ff3e None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:25.027528 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b714a3ea-acbb-4fa1-bd13-dedfd3a5ff3e None None] PATH_INFO: `/` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:25.029392 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 448/910] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 12:14:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 12:14:25.035537 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bdf25e-0ac4-4f05-8f79-cef6d111c7bb None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:25.035948 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bdf25e-0ac4-4f05-8f79-cef6d111c7bb None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:25.036121 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bdf25e-0ac4-4f05-8f79-cef6d111c7bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:25.053885 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-a8bdf25e-0ac4-4f05-8f79-cef6d111c7bb None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:14:25.055084 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-a8bdf25e-0ac4-4f05-8f79-cef6d111c7bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:14:25.061394 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a4b816-5b98-4ce1-97a3-099d510e64fd None None] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:25.061673 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a4b816-5b98-4ce1-97a3-099d510e64fd None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:25.061944 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a4b816-5b98-4ce1-97a3-099d510e64fd None None] PATH_INFO: `/` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:25.063545 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 449/911] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 12:14:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 12:14:25.068483 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9ee9bd-15e0-4b1a-bee4-8ff436a64456 None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:25.068785 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9ee9bd-15e0-4b1a-bee4-8ff436a64456 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:25.069063 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9ee9bd-15e0-4b1a-bee4-8ff436a64456 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:25.087159 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-bf9ee9bd-15e0-4b1a-bee4-8ff436a64456 None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:14:25.088931 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-bf9ee9bd-15e0-4b1a-bee4-8ff436a64456 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:14:25.127218 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 463/912] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 12:14:25 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 12:14:25.156200 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bdf25e-0ac4-4f05-8f79-cef6d111c7bb None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:14:25.165221 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 450/913] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 12:14:25 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 16 12:14:25.194352 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9ee9bd-15e0-4b1a-bee4-8ff436a64456 None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:14:25.224046 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:14:25.271953 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bdf25e-0ac4-4f05-8f79-cef6d111c7bb None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:14:25.284179 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:14:25.305610 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9ee9bd-15e0-4b1a-bee4-8ff436a64456 None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:14:25.310103 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649915c3-92fd-4332-8e32-ab9dc2ca989a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:14:25.311142 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649915c3-92fd-4332-8e32-ab9dc2ca989a None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:25.311618 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649915c3-92fd-4332-8e32-ab9dc2ca989a None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:25.312109 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649915c3-92fd-4332-8e32-ab9dc2ca989a None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:25.313072 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649915c3-92fd-4332-8e32-ab9dc2ca989a None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:14:25.314632 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649915c3-92fd-4332-8e32-ab9dc2ca989a None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:14:25.328224 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-649915c3-92fd-4332-8e32-ab9dc2ca989a None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 16 12:14:25.328224 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 12:14:25.328224 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 12:14:25.328224 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 12:14:25.328224 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 12:14:25.328224 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 12:14:25.328224 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 12:14:25.328224 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 12:14:25.328224 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 16 12:14:25.328224 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jun 16 12:14:25.328224 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 12:14:25.328224 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jun 16 12:14:25.328224 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 12:14:25.328224 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 12:14:25.328224 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 12:14:25.328224 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 12:14:25.329178 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 12:14:25.329178 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 12:14:25.329178 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 12:14:25.329178 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 12:14:25.329178 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 12:14:25.329178 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 12:14:25.329178 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 12:14:25.329178 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 12:14:25.329178 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 12:14:25.329178 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 12:14:25.329178 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 12:14:25.329178 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 12:14:25.329178 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 12:14:25.329178 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 12:14:25.329178 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 12:14:25.329178 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 12:14:25.329983 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 12:14:25.329983 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 12:14:25.329983 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jun 16 12:14:25.329983 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 12:14:25.329983 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jun 16 12:14:25.329983 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 12:14:25.329983 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 12:14:25.329983 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 12:14:25.329983 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jun 16 12:14:25.329983 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 12:14:25.329983 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jun 16 12:14:25.329983 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 12:14:25.329983 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 12:14:25.329983 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 16 12:14:25.329983 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jun 16 12:14:25.333538 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 464/914] 10.222.0.44 () {56 vars in 1132 bytes} [Thu Jun 16 12:14:25 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 12:14:25.340160 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649915c3-92fd-4332-8e32-ab9dc2ca989a None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:14:25.350282 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09567787-96e5-4b71-8aac-af7b36834908 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:14:25.350943 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09567787-96e5-4b71-8aac-af7b36834908 None admin] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:25.351219 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09567787-96e5-4b71-8aac-af7b36834908 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:25.351489 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09567787-96e5-4b71-8aac-af7b36834908 None admin] PATH_INFO: `/v3/services` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:25.352222 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09567787-96e5-4b71-8aac-af7b36834908 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:14:25.353838 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09567787-96e5-4b71-8aac-af7b36834908 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:14:25.377012 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 451/915] 10.222.0.44 () {60 vars in 1141 bytes} [Thu Jun 16 12:14:25 2022] POST /identity/v3/services => generated 241 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 12:14:25.466927 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649915c3-92fd-4332-8e32-ab9dc2ca989a None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:14:25.477783 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5eaac2-5ba0-4aa5-a43b-cbc001d84cf6 None None] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:25.478091 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5eaac2-5ba0-4aa5-a43b-cbc001d84cf6 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:25.478346 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5eaac2-5ba0-4aa5-a43b-cbc001d84cf6 None None] PATH_INFO: `/` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:25.479861 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 452/916] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 12:14:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 12:14:25.485201 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de0f800-1984-4466-aec3-b494c76890da None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:25.485487 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de0f800-1984-4466-aec3-b494c76890da None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:25.485766 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de0f800-1984-4466-aec3-b494c76890da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:25.486736 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:14:25.504056 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-3de0f800-1984-4466-aec3-b494c76890da None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:14:25.505350 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-3de0f800-1984-4466-aec3-b494c76890da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:14:25.520160 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f51cad-72ee-414e-b6f4-bc9ec5b33893 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:14:25.521510 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f51cad-72ee-414e-b6f4-bc9ec5b33893 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:25.522010 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f51cad-72ee-414e-b6f4-bc9ec5b33893 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:25.522922 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f51cad-72ee-414e-b6f4-bc9ec5b33893 None admin] PATH_INFO: `/v3/services` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:25.524125 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f51cad-72ee-414e-b6f4-bc9ec5b33893 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:14:25.524611 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f51cad-72ee-414e-b6f4-bc9ec5b33893 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:14:25.526898 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f51cad-72ee-414e-b6f4-bc9ec5b33893 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:14:25.535534 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 465/917] 10.222.0.44 () {56 vars in 1126 bytes} [Thu Jun 16 12:14:25 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:14:25.542115 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f51cad-72ee-414e-b6f4-bc9ec5b33893 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:14:25.602376 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 453/918] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 12:14:25 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (3 switches on core 0) Jun 16 12:14:25.628463 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de0f800-1984-4466-aec3-b494c76890da None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:14:25.654086 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f51cad-72ee-414e-b6f4-bc9ec5b33893 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:14:25.693550 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf95e78-52b6-4241-aad3-027b0029003e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:14:25.694219 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf95e78-52b6-4241-aad3-027b0029003e None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:25.694500 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf95e78-52b6-4241-aad3-027b0029003e None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:25.694900 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf95e78-52b6-4241-aad3-027b0029003e None admin] PATH_INFO: `/v3/services` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:25.695654 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf95e78-52b6-4241-aad3-027b0029003e None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:14:25.695962 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf95e78-52b6-4241-aad3-027b0029003e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:14:25.697603 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf95e78-52b6-4241-aad3-027b0029003e None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:14:25.708719 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 466/919] 10.222.0.44 () {56 vars in 1126 bytes} [Thu Jun 16 12:14:25 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 12:14:25.708904 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:14:25.710933 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf95e78-52b6-4241-aad3-027b0029003e None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:14:25.754365 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de0f800-1984-4466-aec3-b494c76890da None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:14:25.762605 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:14:25.799876 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741f5c27-17a6-40c4-9750-59b50b1faa77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:14:25.801588 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741f5c27-17a6-40c4-9750-59b50b1faa77 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:25.802071 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741f5c27-17a6-40c4-9750-59b50b1faa77 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:25.802986 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741f5c27-17a6-40c4-9750-59b50b1faa77 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:25.803842 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741f5c27-17a6-40c4-9750-59b50b1faa77 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:14:25.806090 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741f5c27-17a6-40c4-9750-59b50b1faa77 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:14:25.823045 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application [None req-741f5c27-17a6-40c4-9750-59b50b1faa77 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 16 12:14:25.823045 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 12:14:25.823045 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 12:14:25.823045 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 12:14:25.823045 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 12:14:25.823045 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 12:14:25.823045 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 12:14:25.823045 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 12:14:25.823045 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 16 12:14:25.823045 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application Jun 16 12:14:25.823045 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 12:14:25.823045 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application Jun 16 12:14:25.823045 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 12:14:25.823045 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 12:14:25.823045 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 12:14:25.823045 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 12:14:25.823045 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 12:14:25.824005 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 12:14:25.824005 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 12:14:25.824005 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 12:14:25.824005 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 12:14:25.824005 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 12:14:25.824005 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 12:14:25.824005 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 12:14:25.824005 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 12:14:25.824005 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 12:14:25.824005 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 12:14:25.824005 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 12:14:25.824005 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 12:14:25.824005 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 12:14:25.824005 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 12:14:25.824005 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 12:14:25.824005 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 12:14:25.824849 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 12:14:25.824849 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application with Lock( Jun 16 12:14:25.824849 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 12:14:25.824849 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._enter() Jun 16 12:14:25.824849 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 12:14:25.824849 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 12:14:25.824849 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 12:14:25.824849 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.creator() Jun 16 12:14:25.824849 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 12:14:25.824849 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application created_value = creator( Jun 16 12:14:25.824849 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 12:14:25.824849 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 12:14:25.824849 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 16 12:14:25.824849 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application Jun 16 12:14:25.828828 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 454/920] 10.222.0.44 () {56 vars in 1114 bytes} [Thu Jun 16 12:14:25 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 12:14:25.833326 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741f5c27-17a6-40c4-9750-59b50b1faa77 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:14:25.834330 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf95e78-52b6-4241-aad3-027b0029003e None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:14:25.870491 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3db0a6-3712-4edb-b462-3b24c1aec9a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:14:25.871195 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3db0a6-3712-4edb-b462-3b24c1aec9a6 None admin] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:25.871483 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3db0a6-3712-4edb-b462-3b24c1aec9a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:25.871770 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3db0a6-3712-4edb-b462-3b24c1aec9a6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:25.872485 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3db0a6-3712-4edb-b462-3b24c1aec9a6 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:14:25.873902 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3db0a6-3712-4edb-b462-3b24c1aec9a6 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:14:25.900779 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 467/921] 10.222.0.44 () {60 vars in 1144 bytes} [Thu Jun 16 12:14:25 2022] POST /identity/v3/endpoints => generated 347 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 12:14:25.977223 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741f5c27-17a6-40c4-9750-59b50b1faa77 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:14:26.016872 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:14:26.025100 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8291fb6c-ad2c-442f-af39-b775b293b21e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:14:26.025987 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8291fb6c-ad2c-442f-af39-b775b293b21e None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:26.026272 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8291fb6c-ad2c-442f-af39-b775b293b21e None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:26.026801 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8291fb6c-ad2c-442f-af39-b775b293b21e None admin] PATH_INFO: `/v3/services` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:26.027251 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8291fb6c-ad2c-442f-af39-b775b293b21e None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:14:26.027558 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8291fb6c-ad2c-442f-af39-b775b293b21e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:14:26.028984 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8291fb6c-ad2c-442f-af39-b775b293b21e None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:14:26.039527 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 455/922] 10.222.0.44 () {56 vars in 1114 bytes} [Thu Jun 16 12:14:25 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:14:26.041112 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3db0a6-3712-4edb-b462-3b24c1aec9a6 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:14:26.146905 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:14:26.152154 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3db0a6-3712-4edb-b462-3b24c1aec9a6 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:14:26.189230 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3f558b-11e4-4ae4-a0cc-39fa8c73a4cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:14:26.189900 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3f558b-11e4-4ae4-a0cc-39fa8c73a4cb None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:26.190181 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3f558b-11e4-4ae4-a0cc-39fa8c73a4cb None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:26.190991 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3f558b-11e4-4ae4-a0cc-39fa8c73a4cb None admin] PATH_INFO: `/v3/services` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:26.191698 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3f558b-11e4-4ae4-a0cc-39fa8c73a4cb None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:14:26.192003 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3f558b-11e4-4ae4-a0cc-39fa8c73a4cb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:14:26.193466 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3f558b-11e4-4ae4-a0cc-39fa8c73a4cb None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:14:26.203327 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 468/923] 10.222.0.44 () {56 vars in 1114 bytes} [Thu Jun 16 12:14:26 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:14:26.204650 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8291fb6c-ad2c-442f-af39-b775b293b21e None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:14:26.309220 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8291fb6c-ad2c-442f-af39-b775b293b21e None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:14:26.344430 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e363ca-0f11-4c1a-8ff6-10b064fb0598 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:14:26.345117 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e363ca-0f11-4c1a-8ff6-10b064fb0598 None admin] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:26.345397 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e363ca-0f11-4c1a-8ff6-10b064fb0598 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:26.345670 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e363ca-0f11-4c1a-8ff6-10b064fb0598 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:26.346428 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e363ca-0f11-4c1a-8ff6-10b064fb0598 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:14:26.347901 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e363ca-0f11-4c1a-8ff6-10b064fb0598 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:14:26.372920 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 456/924] 10.222.0.44 () {60 vars in 1144 bytes} [Thu Jun 16 12:14:26 2022] POST /identity/v3/endpoints => generated 346 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 12:14:26.609503 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f6bee8-c128-4538-9a84-cfff7478d458 None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:26.609805 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f6bee8-c128-4538-9a84-cfff7478d458 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:26.609983 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f6bee8-c128-4538-9a84-cfff7478d458 None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:26.611487 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 469/925] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 12:14:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 12:14:26.617135 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31d2165-4bb5-4f97-8136-a044a92e3633 None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:26.617424 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31d2165-4bb5-4f97-8136-a044a92e3633 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:26.617699 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31d2165-4bb5-4f97-8136-a044a92e3633 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:26.634846 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-c31d2165-4bb5-4f97-8136-a044a92e3633 None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:14:26.636027 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-c31d2165-4bb5-4f97-8136-a044a92e3633 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:14:26.686325 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:14:26.716547 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 457/926] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 12:14:26 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 12:14:26.739727 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f6bee8-c128-4538-9a84-cfff7478d458 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:14:26.843553 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f6bee8-c128-4538-9a84-cfff7478d458 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:14:26.878079 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262d5a76-8c78-448f-aefe-7538971abbe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:14:26.879089 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262d5a76-8c78-448f-aefe-7538971abbe0 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:26.879523 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262d5a76-8c78-448f-aefe-7538971abbe0 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:26.879931 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262d5a76-8c78-448f-aefe-7538971abbe0 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:26.890729 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262d5a76-8c78-448f-aefe-7538971abbe0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 12:14:26.899009 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-262d5a76-8c78-448f-aefe-7538971abbe0 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 16 12:14:26.899009 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 12:14:26.899009 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 12:14:26.899009 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 12:14:26.899009 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 12:14:26.899009 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 12:14:26.899009 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 12:14:26.899009 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 12:14:26.899009 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 12:14:26.899009 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 12:14:26.899009 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 12:14:26.899009 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 12:14:26.899009 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 12:14:26.899009 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 12:14:26.899009 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 12:14:26.899009 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 12:14:26.900139 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 12:14:26.900139 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 12:14:26.900139 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 12:14:26.900139 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 12:14:26.900139 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 12:14:26.900139 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 12:14:26.900139 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 12:14:26.900139 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 12:14:26.900139 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 12:14:26.900139 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 12:14:26.900139 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 12:14:26.900139 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jun 16 12:14:26.900139 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 12:14:26.900139 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jun 16 12:14:26.900139 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 12:14:26.900139 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 12:14:26.901219 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 12:14:26.901219 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jun 16 12:14:26.901219 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 12:14:26.901219 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jun 16 12:14:26.901219 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 12:14:26.901219 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 12:14:26.901219 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 12:14:26.901219 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 12:14:26.901219 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 12:14:26.901219 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 12:14:26.901219 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 16 12:14:26.901219 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jun 16 12:14:26.903482 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 470/927] 10.222.0.44 () {56 vars in 1120 bytes} [Thu Jun 16 12:14:26 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 12:14:26.910073 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31d2165-4bb5-4f97-8136-a044a92e3633 None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:14:27.017832 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31d2165-4bb5-4f97-8136-a044a92e3633 None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:14:27.056713 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2066a144-0a34-4ff5-824f-45a3c88771b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:14:27.057496 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2066a144-0a34-4ff5-824f-45a3c88771b5 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:27.057664 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2066a144-0a34-4ff5-824f-45a3c88771b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:27.057929 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2066a144-0a34-4ff5-824f-45a3c88771b5 None admin] PATH_INFO: `/v3/roles` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:27.058673 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2066a144-0a34-4ff5-824f-45a3c88771b5 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:14:27.058974 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2066a144-0a34-4ff5-824f-45a3c88771b5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:14:27.060328 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2066a144-0a34-4ff5-824f-45a3c88771b5 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:14:27.069045 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 458/928] 10.222.0.44 () {56 vars in 1115 bytes} [Thu Jun 16 12:14:26 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:14:27.074409 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262d5a76-8c78-448f-aefe-7538971abbe0 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:14:27.117554 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:14:27.180121 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262d5a76-8c78-448f-aefe-7538971abbe0 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:14:27.216554 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf44681-b4ff-47a8-9ce2-04afb3c2760a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:14:27.217809 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf44681-b4ff-47a8-9ce2-04afb3c2760a None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:27.218378 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf44681-b4ff-47a8-9ce2-04afb3c2760a None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:27.218871 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf44681-b4ff-47a8-9ce2-04afb3c2760a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:27.230821 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf44681-b4ff-47a8-9ce2-04afb3c2760a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:14:27.232602 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf44681-b4ff-47a8-9ce2-04afb3c2760a None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:14:27.250998 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-2cf44681-b4ff-47a8-9ce2-04afb3c2760a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 12:14:27.250998 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 12:14:27.250998 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 12:14:27.250998 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 12:14:27.250998 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 12:14:27.250998 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 12:14:27.250998 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 12:14:27.250998 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 12:14:27.250998 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 12:14:27.250998 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 12:14:27.250998 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 12:14:27.250998 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 12:14:27.250998 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 12:14:27.250998 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 12:14:27.250998 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 12:14:27.251940 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 12:14:27.251940 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 12:14:27.251940 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 12:14:27.251940 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 12:14:27.251940 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 12:14:27.251940 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 12:14:27.251940 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 12:14:27.251940 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 12:14:27.251940 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jun 16 12:14:27.251940 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 12:14:27.251940 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jun 16 12:14:27.251940 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 12:14:27.251940 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 12:14:27.251940 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 12:14:27.251940 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jun 16 12:14:27.251940 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 12:14:27.251940 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jun 16 12:14:27.252857 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 12:14:27.252857 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 12:14:27.252857 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 12:14:27.252857 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jun 16 12:14:27.255107 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 471/929] 10.222.0.44 () {56 vars in 1108 bytes} [Thu Jun 16 12:14:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 12:14:27.260861 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2066a144-0a34-4ff5-824f-45a3c88771b5 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:14:27.305166 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:14:27.368093 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2066a144-0a34-4ff5-824f-45a3c88771b5 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:14:27.403622 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7896cbc-864a-4473-b907-bb6fbc4b2b57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:14:27.404283 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7896cbc-864a-4473-b907-bb6fbc4b2b57 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:27.404565 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7896cbc-864a-4473-b907-bb6fbc4b2b57 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:27.404871 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7896cbc-864a-4473-b907-bb6fbc4b2b57 None admin] PATH_INFO: `/v3/domains` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:27.405592 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7896cbc-864a-4473-b907-bb6fbc4b2b57 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:14:27.405900 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7896cbc-864a-4473-b907-bb6fbc4b2b57 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:14:27.407268 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7896cbc-864a-4473-b907-bb6fbc4b2b57 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:14:27.420169 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 459/930] 10.222.0.44 () {56 vars in 1109 bytes} [Thu Jun 16 12:14:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:14:27.425646 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf44681-b4ff-47a8-9ce2-04afb3c2760a None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:14:27.500974 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:14:27.530288 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf44681-b4ff-47a8-9ce2-04afb3c2760a None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:14:27.566713 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c84cbc-459e-41cc-95d7-743377fe3449 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:14:27.567523 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c84cbc-459e-41cc-95d7-743377fe3449 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:27.567801 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c84cbc-459e-41cc-95d7-743377fe3449 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:27.568071 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c84cbc-459e-41cc-95d7-743377fe3449 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:27.575905 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c84cbc-459e-41cc-95d7-743377fe3449 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:14:27.577357 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c84cbc-459e-41cc-95d7-743377fe3449 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:14:27.592523 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-61c84cbc-459e-41cc-95d7-743377fe3449 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 16 12:14:27.592523 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 12:14:27.592523 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 12:14:27.592523 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 12:14:27.592523 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 12:14:27.592523 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 12:14:27.592523 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 12:14:27.592523 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 12:14:27.592523 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 12:14:27.592523 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 12:14:27.592523 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 12:14:27.592523 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 12:14:27.592523 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 12:14:27.592523 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 12:14:27.592523 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 12:14:27.592523 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 12:14:27.593562 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 12:14:27.593562 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 12:14:27.593562 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 12:14:27.593562 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 12:14:27.593562 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 12:14:27.593562 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 12:14:27.593562 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 12:14:27.593562 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 12:14:27.593562 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 12:14:27.593562 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 12:14:27.593562 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 12:14:27.593562 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jun 16 12:14:27.593562 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 12:14:27.593562 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jun 16 12:14:27.593562 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 12:14:27.593562 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 12:14:27.593562 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 12:14:27.593562 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jun 16 12:14:27.595121 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 12:14:27.595121 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jun 16 12:14:27.595121 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 12:14:27.595121 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 12:14:27.595121 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 12:14:27.595121 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 12:14:27.595121 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 12:14:27.595121 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 12:14:27.595121 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 16 12:14:27.595121 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jun 16 12:14:27.595121 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 472/931] 10.222.0.44 () {56 vars in 1117 bytes} [Thu Jun 16 12:14:27 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 12:14:27.599378 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7896cbc-864a-4473-b907-bb6fbc4b2b57 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:14:27.716405 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:14:27.720315 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7896cbc-864a-4473-b907-bb6fbc4b2b57 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:14:27.735451 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca7d7f8-7ea9-4a80-8ee7-3d47c02ae9d3 None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:27.736069 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca7d7f8-7ea9-4a80-8ee7-3d47c02ae9d3 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:27.736549 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca7d7f8-7ea9-4a80-8ee7-3d47c02ae9d3 None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:27.738434 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 473/932] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 12:14:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 12:14:27.743732 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734a88ba-652a-4cf7-9b6b-72c5c0fd321a None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:27.744253 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734a88ba-652a-4cf7-9b6b-72c5c0fd321a None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:27.744735 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734a88ba-652a-4cf7-9b6b-72c5c0fd321a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:27.756453 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9a49c7-2aba-4316-adc2-acd7c5930b54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:14:27.757089 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9a49c7-2aba-4316-adc2-acd7c5930b54 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:27.757372 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9a49c7-2aba-4316-adc2-acd7c5930b54 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:27.757649 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9a49c7-2aba-4316-adc2-acd7c5930b54 None admin] PATH_INFO: `/v3/users` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:27.758494 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9a49c7-2aba-4316-adc2-acd7c5930b54 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:14:27.758803 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9a49c7-2aba-4316-adc2-acd7c5930b54 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:14:27.760231 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9a49c7-2aba-4316-adc2-acd7c5930b54 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:14:27.765354 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-734a88ba-652a-4cf7-9b6b-72c5c0fd321a None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:14:27.766772 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-734a88ba-652a-4cf7-9b6b-72c5c0fd321a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:14:27.780800 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 460/933] 10.222.0.44 () {56 vars in 1149 bytes} [Thu Jun 16 12:14:27 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:14:27.784937 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9a49c7-2aba-4316-adc2-acd7c5930b54 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:14:27.867354 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 474/934] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 12:14:27 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 16 12:14:27.891377 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734a88ba-652a-4cf7-9b6b-72c5c0fd321a None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:14:27.896887 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9a49c7-2aba-4316-adc2-acd7c5930b54 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:14:27.953294 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af90082-9616-4984-8f08-44eab4b07786 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:14:27.954371 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af90082-9616-4984-8f08-44eab4b07786 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:27.955015 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af90082-9616-4984-8f08-44eab4b07786 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:27.955464 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af90082-9616-4984-8f08-44eab4b07786 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:27.968526 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:14:27.972037 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af90082-9616-4984-8f08-44eab4b07786 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:14:27.973554 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af90082-9616-4984-8f08-44eab4b07786 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:14:27.992350 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application [None req-3af90082-9616-4984-8f08-44eab4b07786 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 12:14:27.992350 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 12:14:27.992350 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 12:14:27.992350 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 12:14:27.992350 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 12:14:27.992350 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 12:14:27.992350 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 12:14:27.992350 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 12:14:27.992350 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 12:14:27.992350 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 12:14:27.992350 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 12:14:27.992350 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 12:14:27.992350 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 12:14:27.992350 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 12:14:27.992350 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 12:14:27.993290 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 12:14:27.993290 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 12:14:27.993290 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 12:14:27.993290 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 12:14:27.993290 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 12:14:27.993290 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 12:14:27.993290 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 12:14:27.993290 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 12:14:27.993290 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application with Lock( Jun 16 12:14:27.993290 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 12:14:27.993290 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._enter() Jun 16 12:14:27.993290 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 12:14:27.993290 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 12:14:27.993290 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 12:14:27.993290 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.creator() Jun 16 12:14:27.993290 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 12:14:27.993290 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application created_value = creator( Jun 16 12:14:27.994186 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 12:14:27.994186 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 12:14:27.994186 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 12:14:27.994186 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application Jun 16 12:14:27.998310 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 461/935] 10.222.0.44 () {56 vars in 1108 bytes} [Thu Jun 16 12:14:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 12:14:27.999604 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af90082-9616-4984-8f08-44eab4b07786 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:14:28.011372 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:14:28.023253 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734a88ba-652a-4cf7-9b6b-72c5c0fd321a None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:14:28.078876 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25086fde-8104-4d87-8697-70ec34359c66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:14:28.081662 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25086fde-8104-4d87-8697-70ec34359c66 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:28.082164 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25086fde-8104-4d87-8697-70ec34359c66 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:28.082649 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25086fde-8104-4d87-8697-70ec34359c66 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:28.083482 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25086fde-8104-4d87-8697-70ec34359c66 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:14:28.085057 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25086fde-8104-4d87-8697-70ec34359c66 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:14:28.102463 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-25086fde-8104-4d87-8697-70ec34359c66 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 16 12:14:28.102463 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 12:14:28.102463 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 12:14:28.102463 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 12:14:28.102463 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 12:14:28.102463 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 12:14:28.102463 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 12:14:28.102463 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 12:14:28.102463 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 16 12:14:28.102463 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jun 16 12:14:28.102463 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 12:14:28.102463 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jun 16 12:14:28.102463 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 12:14:28.102463 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 12:14:28.102463 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 12:14:28.102463 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 12:14:28.102463 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 12:14:28.103462 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 12:14:28.103462 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 12:14:28.103462 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 12:14:28.103462 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 12:14:28.103462 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 12:14:28.103462 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 12:14:28.103462 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 12:14:28.103462 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 12:14:28.103462 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 12:14:28.103462 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 12:14:28.103462 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 12:14:28.103462 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 12:14:28.103462 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 12:14:28.103462 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 12:14:28.103462 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 12:14:28.103462 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 12:14:28.104326 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 12:14:28.104326 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jun 16 12:14:28.104326 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 12:14:28.104326 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jun 16 12:14:28.104326 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 12:14:28.104326 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 12:14:28.104326 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 12:14:28.104326 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jun 16 12:14:28.104326 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 12:14:28.104326 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jun 16 12:14:28.104326 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 12:14:28.104326 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 12:14:28.104326 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 16 12:14:28.104326 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jun 16 12:14:28.111066 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 475/936] 10.222.0.44 () {56 vars in 1126 bytes} [Thu Jun 16 12:14:27 2022] GET /identity/v3/services/object-store => generated 93 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 12:14:28.112683 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25086fde-8104-4d87-8697-70ec34359c66 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:14:28.124456 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af90082-9616-4984-8f08-44eab4b07786 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:14:28.177441 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee3e49e-1326-41e1-a4c9-f881b6772ee1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:14:28.178772 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee3e49e-1326-41e1-a4c9-f881b6772ee1 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:28.179696 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee3e49e-1326-41e1-a4c9-f881b6772ee1 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:28.180468 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee3e49e-1326-41e1-a4c9-f881b6772ee1 None admin] PATH_INFO: `/v3/domains` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:28.181690 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee3e49e-1326-41e1-a4c9-f881b6772ee1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:14:28.182623 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee3e49e-1326-41e1-a4c9-f881b6772ee1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:14:28.184768 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee3e49e-1326-41e1-a4c9-f881b6772ee1 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:14:28.201898 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 462/937] 10.222.0.44 () {56 vars in 1109 bytes} [Thu Jun 16 12:14:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 12:14:28.206993 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee3e49e-1326-41e1-a4c9-f881b6772ee1 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:14:28.230598 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25086fde-8104-4d87-8697-70ec34359c66 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:14:28.259380 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:14:28.268180 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90720cc2-64f9-402f-9d68-f3e47223071b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:14:28.268949 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90720cc2-64f9-402f-9d68-f3e47223071b None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:28.269225 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90720cc2-64f9-402f-9d68-f3e47223071b None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:28.269498 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90720cc2-64f9-402f-9d68-f3e47223071b None admin] PATH_INFO: `/v3/services` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:28.270193 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90720cc2-64f9-402f-9d68-f3e47223071b None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:14:28.270492 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90720cc2-64f9-402f-9d68-f3e47223071b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:14:28.272104 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90720cc2-64f9-402f-9d68-f3e47223071b None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:14:28.281943 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 476/938] 10.222.0.44 () {56 vars in 1122 bytes} [Thu Jun 16 12:14:28 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:14:28.282116 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:14:28.282202 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086c614a-9c2d-48b2-95fe-1acbd0f64d81 None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:28.282202 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086c614a-9c2d-48b2-95fe-1acbd0f64d81 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:28.282202 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086c614a-9c2d-48b2-95fe-1acbd0f64d81 None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:28.285421 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 477/939] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 12:14:28 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 12:14:28.285638 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086c614a-9c2d-48b2-95fe-1acbd0f64d81 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:14:28.320150 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee3e49e-1326-41e1-a4c9-f881b6772ee1 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:14:28.355956 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0754ca88-ad71-4343-9412-b11dfc73f48c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:14:28.356742 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0754ca88-ad71-4343-9412-b11dfc73f48c None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:28.357051 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0754ca88-ad71-4343-9412-b11dfc73f48c None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:28.357325 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0754ca88-ad71-4343-9412-b11dfc73f48c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:28.365550 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0754ca88-ad71-4343-9412-b11dfc73f48c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:14:28.366991 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0754ca88-ad71-4343-9412-b11dfc73f48c None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:14:28.381399 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application [None req-0754ca88-ad71-4343-9412-b11dfc73f48c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 12:14:28.381399 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 12:14:28.381399 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 12:14:28.381399 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 12:14:28.381399 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 12:14:28.381399 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 12:14:28.381399 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 12:14:28.381399 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 12:14:28.381399 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 12:14:28.381399 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 12:14:28.381399 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 12:14:28.381399 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 12:14:28.381399 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 12:14:28.381399 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 12:14:28.381399 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 12:14:28.382354 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 12:14:28.382354 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 12:14:28.382354 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 12:14:28.382354 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 12:14:28.382354 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 12:14:28.382354 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 12:14:28.382354 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 12:14:28.382354 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 12:14:28.382354 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application with Lock( Jun 16 12:14:28.382354 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 12:14:28.382354 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._enter() Jun 16 12:14:28.382354 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 12:14:28.382354 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 12:14:28.382354 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 12:14:28.382354 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.creator() Jun 16 12:14:28.382354 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 12:14:28.382354 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application created_value = creator( Jun 16 12:14:28.383220 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 12:14:28.383220 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 12:14:28.383220 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 12:14:28.383220 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 12:14:28.383220 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 12:14:28.383220 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 12:14:28.383220 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 12:14:28.383220 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application Jun 16 12:14:28.383220 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 463/940] 10.222.0.44 () {56 vars in 1111 bytes} [Thu Jun 16 12:14:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 12:14:28.384206 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4111855f-d231-4be4-8b9e-3168f65e1ebf None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:28.384206 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4111855f-d231-4be4-8b9e-3168f65e1ebf None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:28.384336 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4111855f-d231-4be4-8b9e-3168f65e1ebf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:28.396878 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086c614a-9c2d-48b2-95fe-1acbd0f64d81 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:14:28.401025 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-4111855f-d231-4be4-8b9e-3168f65e1ebf None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:14:28.402219 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-4111855f-d231-4be4-8b9e-3168f65e1ebf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:14:28.432343 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb5984a-a5a8-49d5-901a-729ebe2293b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:14:28.433139 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb5984a-a5a8-49d5-901a-729ebe2293b0 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:28.433423 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb5984a-a5a8-49d5-901a-729ebe2293b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:28.433698 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb5984a-a5a8-49d5-901a-729ebe2293b0 None admin] PATH_INFO: `/v3/services` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:28.434436 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb5984a-a5a8-49d5-901a-729ebe2293b0 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:14:28.434734 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb5984a-a5a8-49d5-901a-729ebe2293b0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:14:28.436113 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb5984a-a5a8-49d5-901a-729ebe2293b0 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:14:28.445828 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 478/941] 10.222.0.44 () {56 vars in 1122 bytes} [Thu Jun 16 12:14:28 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:14:28.445828 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb5984a-a5a8-49d5-901a-729ebe2293b0 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:14:28.484103 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 464/942] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 12:14:28 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 12:14:28.489187 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4111855f-d231-4be4-8b9e-3168f65e1ebf None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:14:28.507505 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:14:28.549330 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:14:28.558043 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb5984a-a5a8-49d5-901a-729ebe2293b0 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:14:28.593636 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f716e133-b649-48e3-ab34-39da48ce14da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:14:28.594295 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f716e133-b649-48e3-ab34-39da48ce14da None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:28.594571 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f716e133-b649-48e3-ab34-39da48ce14da None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:28.594844 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f716e133-b649-48e3-ab34-39da48ce14da None admin] PATH_INFO: `/v3/projects` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:28.595219 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4111855f-d231-4be4-8b9e-3168f65e1ebf None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:14:28.595622 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f716e133-b649-48e3-ab34-39da48ce14da None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:14:28.595923 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f716e133-b649-48e3-ab34-39da48ce14da None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:14:28.598116 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f716e133-b649-48e3-ab34-39da48ce14da None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:14:28.610304 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 479/943] 10.222.0.44 () {56 vars in 1148 bytes} [Thu Jun 16 12:14:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:14:28.611398 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f716e133-b649-48e3-ab34-39da48ce14da None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:14:28.631149 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113960f4-913f-4ecd-bb50-b1c0bc844722 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:14:28.631799 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113960f4-913f-4ecd-bb50-b1c0bc844722 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:28.632075 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113960f4-913f-4ecd-bb50-b1c0bc844722 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:28.632341 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113960f4-913f-4ecd-bb50-b1c0bc844722 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:28.633160 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113960f4-913f-4ecd-bb50-b1c0bc844722 None admin] RBAC: Adding query filter params (interface=public, service_id=36c273efb41749e791cd2302614eaa35, region_id=RegionOne) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:14:28.633467 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113960f4-913f-4ecd-bb50-b1c0bc844722 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:14:28.634810 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113960f4-913f-4ecd-bb50-b1c0bc844722 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:14:28.639683 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 465/944] 10.222.0.44 () {56 vars in 1251 bytes} [Thu Jun 16 12:14:28 2022] GET /identity/v3/endpoints?service_id=36c273efb41749e791cd2302614eaa35&interface=public®ion_id=RegionOne => generated 194 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:14:28.640906 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba5f0a0-ff04-49f4-9a93-9c58002fa19c None None] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:28.641187 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba5f0a0-ff04-49f4-9a93-9c58002fa19c None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:28.641457 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba5f0a0-ff04-49f4-9a93-9c58002fa19c None None] PATH_INFO: `/` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:28.642667 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 466/945] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 12:14:28 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 12:14:28.643859 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba5f0a0-ff04-49f4-9a93-9c58002fa19c None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:14:28.715857 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f716e133-b649-48e3-ab34-39da48ce14da None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:14:28.732142 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:14:28.745188 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba5f0a0-ff04-49f4-9a93-9c58002fa19c None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:14:28.750001 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5174023a-4a5a-49e0-9bb0-831eb5af39bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:14:28.750789 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5174023a-4a5a-49e0-9bb0-831eb5af39bb None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:28.751071 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5174023a-4a5a-49e0-9bb0-831eb5af39bb None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:28.751345 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5174023a-4a5a-49e0-9bb0-831eb5af39bb None admin] PATH_INFO: `/v3/services/compute` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:28.752001 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5174023a-4a5a-49e0-9bb0-831eb5af39bb None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:14:28.753424 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5174023a-4a5a-49e0-9bb0-831eb5af39bb None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:14:28.765032 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-5174023a-4a5a-49e0-9bb0-831eb5af39bb None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 16 12:14:28.765032 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 12:14:28.765032 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 12:14:28.765032 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 12:14:28.765032 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 12:14:28.765032 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 12:14:28.765032 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 12:14:28.765032 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 12:14:28.765032 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 16 12:14:28.765032 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jun 16 12:14:28.765032 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 12:14:28.765032 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jun 16 12:14:28.765032 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 12:14:28.765032 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 12:14:28.765032 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 12:14:28.765032 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 12:14:28.765032 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 12:14:28.766167 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 12:14:28.766167 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 12:14:28.766167 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 12:14:28.766167 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 12:14:28.766167 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 12:14:28.766167 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 12:14:28.766167 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 12:14:28.766167 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 12:14:28.766167 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 12:14:28.766167 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 12:14:28.766167 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 12:14:28.766167 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 12:14:28.766167 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 12:14:28.766167 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 12:14:28.766167 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 12:14:28.766167 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 12:14:28.767143 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 12:14:28.767143 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jun 16 12:14:28.767143 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 12:14:28.767143 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jun 16 12:14:28.767143 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 12:14:28.767143 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 12:14:28.767143 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 12:14:28.767143 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jun 16 12:14:28.767143 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 12:14:28.767143 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jun 16 12:14:28.767143 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 12:14:28.767143 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 12:14:28.767143 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 16 12:14:28.767143 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jun 16 12:14:28.767143 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 480/946] 10.222.0.44 () {56 vars in 1111 bytes} [Thu Jun 16 12:14:28 2022] GET /identity/v3/services/compute => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 12:14:28.768072 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5174023a-4a5a-49e0-9bb0-831eb5af39bb None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:14:28.770281 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:14:28.782079 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5cd71f-6444-4dd0-b901-ff3f5c5df355 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:14:28.782963 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5cd71f-6444-4dd0-b901-ff3f5c5df355 None admin] REQUEST_METHOD: `PUT` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:28.783238 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5cd71f-6444-4dd0-b901-ff3f5c5df355 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:28.783511 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5cd71f-6444-4dd0-b901-ff3f5c5df355 None admin] PATH_INFO: `/v3/projects/601361df39e34fcca71175aa94e425c4/users/222b53cae3d64412b9b0a89d162311f4/roles/6b361854fbed4b698a92f8199670a956` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:28.786275 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5cd71f-6444-4dd0-b901-ff3f5c5df355 None admin] RBAC: Authorizing `identity:create_grant(project_id=601361df39e34fcca71175aa94e425c4, user_id=222b53cae3d64412b9b0a89d162311f4, role_id=6b361854fbed4b698a92f8199670a956)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:14:28.787684 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5cd71f-6444-4dd0-b901-ff3f5c5df355 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:14:28.800668 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 467/947] 10.222.0.44 () {58 vars in 1439 bytes} [Thu Jun 16 12:14:28 2022] PUT /identity/v3/projects/601361df39e34fcca71175aa94e425c4/users/222b53cae3d64412b9b0a89d162311f4/roles/6b361854fbed4b698a92f8199670a956 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:14:28.806281 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffae33d-d973-4cfa-acd0-d1addd2f1487 None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:28.806605 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffae33d-d973-4cfa-acd0-d1addd2f1487 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:28.806836 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffae33d-d973-4cfa-acd0-d1addd2f1487 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:28.825563 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-7ffae33d-d973-4cfa-acd0-d1addd2f1487 None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:14:28.826909 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-7ffae33d-d973-4cfa-acd0-d1addd2f1487 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:14:28.874084 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5174023a-4a5a-49e0-9bb0-831eb5af39bb None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:14:28.905606 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 468/948] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 12:14:28 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 12:14:28.906473 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffae33d-d973-4cfa-acd0-d1addd2f1487 None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:14:28.913990 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70516a56-91b8-43ae-a3e0-75c297953f18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:14:28.914731 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70516a56-91b8-43ae-a3e0-75c297953f18 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:28.915019 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70516a56-91b8-43ae-a3e0-75c297953f18 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:28.915296 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70516a56-91b8-43ae-a3e0-75c297953f18 None admin] PATH_INFO: `/v3/services` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:28.915993 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70516a56-91b8-43ae-a3e0-75c297953f18 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:14:28.921212 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70516a56-91b8-43ae-a3e0-75c297953f18 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:14:28.929108 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 481/949] 10.222.0.44 () {56 vars in 1087 bytes} [Thu Jun 16 12:14:28 2022] GET /identity/v3/services => generated 1497 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 12:14:28.944941 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70516a56-91b8-43ae-a3e0-75c297953f18 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:14:29.005112 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:14:29.048303 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffae33d-d973-4cfa-acd0-d1addd2f1487 None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:14:29.067574 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:14:29.086748 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70516a56-91b8-43ae-a3e0-75c297953f18 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:14:29.095237 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3e1ae6-35a9-4f15-ade9-bc2c48730925 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:14:29.096172 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3e1ae6-35a9-4f15-ade9-bc2c48730925 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:29.102029 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3e1ae6-35a9-4f15-ade9-bc2c48730925 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:29.102029 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3e1ae6-35a9-4f15-ade9-bc2c48730925 None admin] PATH_INFO: `/v3/services` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:29.102749 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3e1ae6-35a9-4f15-ade9-bc2c48730925 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:14:29.103068 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3e1ae6-35a9-4f15-ade9-bc2c48730925 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:14:29.104945 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3e1ae6-35a9-4f15-ade9-bc2c48730925 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:14:29.111715 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 469/950] 10.222.0.44 () {56 vars in 1112 bytes} [Thu Jun 16 12:14:28 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:14:29.118381 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3e1ae6-35a9-4f15-ade9-bc2c48730925 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:14:29.132923 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f73d4dc-6fda-44e4-9ecf-aeeb326653ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:14:29.133720 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f73d4dc-6fda-44e4-9ecf-aeeb326653ee None admin] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:29.134112 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f73d4dc-6fda-44e4-9ecf-aeeb326653ee None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:29.134476 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f73d4dc-6fda-44e4-9ecf-aeeb326653ee None admin] PATH_INFO: `/v3/projects` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:29.135257 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f73d4dc-6fda-44e4-9ecf-aeeb326653ee None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:14:29.136866 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f73d4dc-6fda-44e4-9ecf-aeeb326653ee None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:14:29.138208 dv-cinder-846149-2-smb devstack@keystone.service[80076]: WARNING keystone.server.flask.common [None req-7f73d4dc-6fda-44e4-9ecf-aeeb326653ee None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jun 16 12:14:29.160165 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.sql.core [None req-7f73d4dc-6fda-44e4-9ecf-aeeb326653ee None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 16 12:14:29.160165 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jun 16 12:14:29.160165 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [parameters: {'id': '4d5f882248044574b7c1e0049dd65388', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jun 16 12:14:29.160165 dv-cinder-846149-2-smb devstack@keystone.service[80076]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80076) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 16 12:14:29.182616 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-7f73d4dc-6fda-44e4-9ecf-aeeb326653ee None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 4d5f882248044574b7c1e0049dd65388.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 4d5f882248044574b7c1e0049dd65388. Jun 16 12:14:29.182616 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 12:14:29.182616 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 16 12:14:29.182616 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 16 12:14:29.182616 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 16 12:14:29.182616 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 16 12:14:29.182616 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 16 12:14:29.182616 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application result = self._query(query) Jun 16 12:14:29.182616 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 16 12:14:29.182616 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application conn.query(q) Jun 16 12:14:29.182616 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 16 12:14:29.182616 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 16 12:14:29.182616 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 16 12:14:29.183692 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application result.read() Jun 16 12:14:29.183692 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 16 12:14:29.183692 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 16 12:14:29.183692 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 16 12:14:29.183692 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 16 12:14:29.183692 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 16 12:14:29.183692 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 16 12:14:29.183692 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 16 12:14:29.183692 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 16 12:14:29.183692 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 16 12:14:29.183692 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jun 16 12:14:29.183692 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 16 12:14:29.183692 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jun 16 12:14:29.183692 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 12:14:29.183692 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 16 12:14:29.183692 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 16 12:14:29.183692 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jun 16 12:14:29.183692 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return project_ref.to_dict() Jun 16 12:14:29.184940 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 16 12:14:29.184940 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application next(self.gen) Jun 16 12:14:29.184940 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 16 12:14:29.184940 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application yield resource Jun 16 12:14:29.184940 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 16 12:14:29.184940 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application next(self.gen) Jun 16 12:14:29.184940 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 16 12:14:29.184940 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application self.session.rollback() Jun 16 12:14:29.184940 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 16 12:14:29.184940 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application self.force_reraise() Jun 16 12:14:29.184940 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 16 12:14:29.184940 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise self.value Jun 16 12:14:29.184940 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 16 12:14:29.184940 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 16 12:14:29.184940 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 16 12:14:29.184940 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application session.commit() Jun 16 12:14:29.184940 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 16 12:14:29.186678 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 16 12:14:29.186678 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 16 12:14:29.186678 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application self._prepare_impl() Jun 16 12:14:29.186678 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 16 12:14:29.186678 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application self.session.flush() Jun 16 12:14:29.186678 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 16 12:14:29.186678 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application self._flush(objects) Jun 16 12:14:29.186678 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 16 12:14:29.186678 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 16 12:14:29.186678 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 16 12:14:29.186678 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application compat.raise_( Jun 16 12:14:29.186678 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 16 12:14:29.186678 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception Jun 16 12:14:29.186678 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 16 12:14:29.186678 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application flush_context.execute() Jun 16 12:14:29.186678 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 16 12:14:29.186678 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application rec.execute(self) Jun 16 12:14:29.188065 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 16 12:14:29.188065 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 16 12:14:29.188065 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 16 12:14:29.188065 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 16 12:14:29.188065 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jun 16 12:14:29.188065 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application c = connection._execute_20( Jun 16 12:14:29.188065 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 16 12:14:29.188065 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 16 12:14:29.188065 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 16 12:14:29.188065 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 16 12:14:29.188065 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 16 12:14:29.188065 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 16 12:14:29.188065 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 16 12:14:29.188065 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 16 12:14:29.188065 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 16 12:14:29.189098 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 16 12:14:29.189098 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 16 12:14:29.189098 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception Jun 16 12:14:29.189098 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 16 12:14:29.189098 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 16 12:14:29.189098 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 16 12:14:29.189098 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 16 12:14:29.189098 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 16 12:14:29.189098 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application result = self._query(query) Jun 16 12:14:29.189098 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 16 12:14:29.189098 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application conn.query(q) Jun 16 12:14:29.189098 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 16 12:14:29.189098 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 16 12:14:29.189098 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 16 12:14:29.189098 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application result.read() Jun 16 12:14:29.189098 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 16 12:14:29.189098 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 16 12:14:29.190351 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 16 12:14:29.190351 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 16 12:14:29.190351 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 16 12:14:29.190351 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 16 12:14:29.190351 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 16 12:14:29.190351 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 16 12:14:29.190351 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 16 12:14:29.190351 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jun 16 12:14:29.190351 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application [parameters: {'id': '4d5f882248044574b7c1e0049dd65388', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jun 16 12:14:29.190351 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 16 12:14:29.190351 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jun 16 12:14:29.190351 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 12:14:29.190351 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jun 16 12:14:29.190351 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 12:14:29.190351 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jun 16 12:14:29.197660 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jun 16 12:14:29.197660 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 16 12:14:29.197660 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 16 12:14:29.197660 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jun 16 12:14:29.197660 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jun 16 12:14:29.197660 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 12:14:29.197660 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jun 16 12:14:29.197660 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 12:14:29.197660 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 12:14:29.197660 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 12:14:29.197660 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 12:14:29.197660 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 12:14:29.197660 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 12:14:29.197660 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 12:14:29.197660 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 12:14:29.197660 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 12:14:29.197660 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 12:14:29.198577 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 12:14:29.198577 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jun 16 12:14:29.198577 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jun 16 12:14:29.198577 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 12:14:29.198577 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 12:14:29.198577 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jun 16 12:14:29.198577 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.Conflict( Jun 16 12:14:29.198577 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 4d5f882248044574b7c1e0049dd65388. Jun 16 12:14:29.198577 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jun 16 12:14:29.198577 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 482/951] 10.222.0.44 () {60 vars in 1140 bytes} [Thu Jun 16 12:14:28 2022] POST /identity/v3/projects => generated 262 bytes in 242 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jun 16 12:14:29.198577 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f73d4dc-6fda-44e4-9ecf-aeeb326653ee None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:14:29.250113 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3e1ae6-35a9-4f15-ade9-bc2c48730925 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:14:29.297715 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64dcf9ce-c882-499a-b2a6-2516427ff231 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:14:29.298627 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dcf9ce-c882-499a-b2a6-2516427ff231 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:29.299082 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dcf9ce-c882-499a-b2a6-2516427ff231 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:29.300128 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dcf9ce-c882-499a-b2a6-2516427ff231 None admin] PATH_INFO: `/v3/services` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:29.301049 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64dcf9ce-c882-499a-b2a6-2516427ff231 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:14:29.301545 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64dcf9ce-c882-499a-b2a6-2516427ff231 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:14:29.303108 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64dcf9ce-c882-499a-b2a6-2516427ff231 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:14:29.308409 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 470/952] 10.222.0.44 () {56 vars in 1112 bytes} [Thu Jun 16 12:14:29 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 12:14:29.321118 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:14:29.324851 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f73d4dc-6fda-44e4-9ecf-aeeb326653ee None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:14:29.365267 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4886bb05-0183-4f46-b3a5-c0f87ebd7d4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:14:29.366192 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4886bb05-0183-4f46-b3a5-c0f87ebd7d4d None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:29.366480 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4886bb05-0183-4f46-b3a5-c0f87ebd7d4d None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:29.366753 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4886bb05-0183-4f46-b3a5-c0f87ebd7d4d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:29.375072 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4886bb05-0183-4f46-b3a5-c0f87ebd7d4d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:14:29.376928 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4886bb05-0183-4f46-b3a5-c0f87ebd7d4d None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:14:29.392521 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-4886bb05-0183-4f46-b3a5-c0f87ebd7d4d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 12:14:29.392521 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 12:14:29.392521 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 12:14:29.392521 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 12:14:29.392521 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 12:14:29.392521 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 12:14:29.392521 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 12:14:29.392521 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 12:14:29.392521 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 12:14:29.392521 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 12:14:29.392521 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 12:14:29.392521 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 12:14:29.392521 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 12:14:29.392521 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 12:14:29.392521 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 12:14:29.394254 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 12:14:29.394254 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 12:14:29.394254 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 12:14:29.394254 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 12:14:29.394254 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 12:14:29.394254 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 12:14:29.394254 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 12:14:29.394254 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 12:14:29.394254 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jun 16 12:14:29.394254 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 12:14:29.394254 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jun 16 12:14:29.394254 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 12:14:29.394254 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 12:14:29.394254 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 12:14:29.394254 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jun 16 12:14:29.394254 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 12:14:29.394254 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jun 16 12:14:29.395200 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 12:14:29.395200 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 12:14:29.395200 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 12:14:29.395200 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 12:14:29.395200 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 12:14:29.395200 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 12:14:29.395200 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 12:14:29.395200 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jun 16 12:14:29.395200 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 483/953] 10.222.0.44 () {56 vars in 1111 bytes} [Thu Jun 16 12:14:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 12:14:29.400569 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64dcf9ce-c882-499a-b2a6-2516427ff231 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:14:29.454717 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:14:29.519354 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64dcf9ce-c882-499a-b2a6-2516427ff231 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:14:29.554983 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016b4c61-aa35-4fd2-a48d-7134bd10a663 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:14:29.556010 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016b4c61-aa35-4fd2-a48d-7134bd10a663 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:29.556485 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016b4c61-aa35-4fd2-a48d-7134bd10a663 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:29.557020 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016b4c61-aa35-4fd2-a48d-7134bd10a663 None admin] PATH_INFO: `/v3/projects` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:29.558006 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016b4c61-aa35-4fd2-a48d-7134bd10a663 None admin] RBAC: Adding query filter params (name=service) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:14:29.558559 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016b4c61-aa35-4fd2-a48d-7134bd10a663 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:14:29.560209 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016b4c61-aa35-4fd2-a48d-7134bd10a663 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:14:29.578339 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 471/954] 10.222.0.44 () {56 vars in 1112 bytes} [Thu Jun 16 12:14:29 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:14:31.007648 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b80c88-0951-43fe-bf4f-9b1c5108dab0 None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:31.008163 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b80c88-0951-43fe-bf4f-9b1c5108dab0 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:31.008242 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b80c88-0951-43fe-bf4f-9b1c5108dab0 None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:31.012533 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 484/955] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 12:14:31 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 12:14:31.017917 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60b1ef3-c651-4cdb-8dda-583c607bc3e3 None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:31.018384 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60b1ef3-c651-4cdb-8dda-583c607bc3e3 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:31.018592 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60b1ef3-c651-4cdb-8dda-583c607bc3e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:31.035541 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-b60b1ef3-c651-4cdb-8dda-583c607bc3e3 None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:14:31.036734 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-b60b1ef3-c651-4cdb-8dda-583c607bc3e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:14:31.107061 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 472/956] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 12:14:31 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 12:14:31.131601 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b80c88-0951-43fe-bf4f-9b1c5108dab0 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:14:31.161932 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad6ca0c-9034-4a0a-9da3-d1b0e8fd9037 None None] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:31.162552 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad6ca0c-9034-4a0a-9da3-d1b0e8fd9037 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:31.163034 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad6ca0c-9034-4a0a-9da3-d1b0e8fd9037 None None] PATH_INFO: `/` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:31.164896 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 473/957] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 12:14:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 12:14:31.170264 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2e40a8-6d5a-4f87-84b6-eb9f2cabe6fd None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:31.170777 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2e40a8-6d5a-4f87-84b6-eb9f2cabe6fd None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:31.171260 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2e40a8-6d5a-4f87-84b6-eb9f2cabe6fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:31.188261 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-fa2e40a8-6d5a-4f87-84b6-eb9f2cabe6fd None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:14:31.189793 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-fa2e40a8-6d5a-4f87-84b6-eb9f2cabe6fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:14:31.218664 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:14:31.238575 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b80c88-0951-43fe-bf4f-9b1c5108dab0 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:14:31.269111 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 474/958] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 12:14:31 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 16 12:14:31.273682 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464d9c12-cc95-4d3b-b90f-028a80e6b93e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:14:31.274505 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464d9c12-cc95-4d3b-b90f-028a80e6b93e None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:31.274785 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464d9c12-cc95-4d3b-b90f-028a80e6b93e None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:31.275057 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464d9c12-cc95-4d3b-b90f-028a80e6b93e None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:31.286108 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464d9c12-cc95-4d3b-b90f-028a80e6b93e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 12:14:31.289976 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2e40a8-6d5a-4f87-84b6-eb9f2cabe6fd None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:14:31.294729 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-464d9c12-cc95-4d3b-b90f-028a80e6b93e None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 16 12:14:31.294729 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 12:14:31.294729 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 12:14:31.294729 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 12:14:31.294729 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 12:14:31.294729 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 12:14:31.294729 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 12:14:31.294729 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 12:14:31.294729 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 12:14:31.294729 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 12:14:31.294729 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 12:14:31.294729 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 12:14:31.294729 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 12:14:31.294729 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 12:14:31.294729 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 12:14:31.294729 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 12:14:31.295699 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 12:14:31.295699 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 12:14:31.295699 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 12:14:31.295699 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 12:14:31.295699 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 12:14:31.295699 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 12:14:31.295699 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 12:14:31.295699 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 12:14:31.295699 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 12:14:31.295699 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 12:14:31.295699 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 12:14:31.295699 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jun 16 12:14:31.295699 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 12:14:31.295699 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jun 16 12:14:31.295699 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 12:14:31.295699 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 12:14:31.296524 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 12:14:31.296524 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jun 16 12:14:31.296524 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 12:14:31.296524 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jun 16 12:14:31.296524 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 12:14:31.296524 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 12:14:31.296524 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 12:14:31.296524 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 12:14:31.296524 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 12:14:31.296524 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 12:14:31.296524 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 16 12:14:31.296524 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jun 16 12:14:31.296524 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 485/959] 10.222.0.44 () {56 vars in 1120 bytes} [Thu Jun 16 12:14:31 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 12:14:31.302303 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464d9c12-cc95-4d3b-b90f-028a80e6b93e None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:14:31.324629 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:14:31.403823 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2e40a8-6d5a-4f87-84b6-eb9f2cabe6fd None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:14:31.404595 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464d9c12-cc95-4d3b-b90f-028a80e6b93e None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:14:31.441481 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd2c2cd-ab2a-4789-bc1a-70f3cf96f788 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:14:31.442084 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd2c2cd-ab2a-4789-bc1a-70f3cf96f788 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:31.442391 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd2c2cd-ab2a-4789-bc1a-70f3cf96f788 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:31.442636 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd2c2cd-ab2a-4789-bc1a-70f3cf96f788 None admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:31.443404 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd2c2cd-ab2a-4789-bc1a-70f3cf96f788 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:14:31.443680 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02d89ad-74fb-4dcf-b6c4-0bb408948a0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:14:31.443799 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd2c2cd-ab2a-4789-bc1a-70f3cf96f788 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:14:31.444891 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02d89ad-74fb-4dcf-b6c4-0bb408948a0a None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:31.445157 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd2c2cd-ab2a-4789-bc1a-70f3cf96f788 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:14:31.445611 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02d89ad-74fb-4dcf-b6c4-0bb408948a0a None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:31.446101 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02d89ad-74fb-4dcf-b6c4-0bb408948a0a None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:31.447112 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02d89ad-74fb-4dcf-b6c4-0bb408948a0a None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:14:31.448915 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02d89ad-74fb-4dcf-b6c4-0bb408948a0a None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:14:31.461258 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 486/960] 10.222.0.44 () {56 vars in 1115 bytes} [Thu Jun 16 12:14:31 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:14:31.462276 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd2c2cd-ab2a-4789-bc1a-70f3cf96f788 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:14:31.464058 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application [None req-a02d89ad-74fb-4dcf-b6c4-0bb408948a0a None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 16 12:14:31.464058 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 12:14:31.464058 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 12:14:31.464058 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 12:14:31.464058 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 12:14:31.464058 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 12:14:31.464058 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 12:14:31.464058 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 12:14:31.464058 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 16 12:14:31.464058 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application Jun 16 12:14:31.464058 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 12:14:31.464058 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application Jun 16 12:14:31.464058 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 12:14:31.464058 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 12:14:31.464058 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 12:14:31.464058 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 12:14:31.464058 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 12:14:31.465233 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 12:14:31.465233 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 12:14:31.465233 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 12:14:31.465233 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 12:14:31.465233 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 12:14:31.465233 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 12:14:31.465233 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 12:14:31.465233 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 12:14:31.465233 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 12:14:31.465233 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 12:14:31.465233 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 12:14:31.465233 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 12:14:31.465233 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 12:14:31.465233 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 12:14:31.465233 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 12:14:31.465233 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 12:14:31.466075 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 12:14:31.466075 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application with Lock( Jun 16 12:14:31.466075 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 12:14:31.466075 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._enter() Jun 16 12:14:31.466075 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 12:14:31.466075 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 12:14:31.466075 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 12:14:31.466075 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.creator() Jun 16 12:14:31.466075 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 12:14:31.466075 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application created_value = creator( Jun 16 12:14:31.466075 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 12:14:31.466075 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 12:14:31.466075 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 16 12:14:31.466075 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application Jun 16 12:14:31.474251 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 475/961] 10.222.0.44 () {56 vars in 1126 bytes} [Thu Jun 16 12:14:31 2022] GET /identity/v3/services/object-store => generated 93 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 12:14:31.475670 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02d89ad-74fb-4dcf-b6c4-0bb408948a0a None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:14:31.513093 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:14:31.564499 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:14:31.585873 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd2c2cd-ab2a-4789-bc1a-70f3cf96f788 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:14:31.588788 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02d89ad-74fb-4dcf-b6c4-0bb408948a0a None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:14:31.620804 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7461e89d-81f2-42da-9fec-31a097d33c0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:14:31.621576 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7461e89d-81f2-42da-9fec-31a097d33c0c None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:31.621857 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7461e89d-81f2-42da-9fec-31a097d33c0c None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:31.622134 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7461e89d-81f2-42da-9fec-31a097d33c0c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:31.624288 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc80a309-ecf0-43b9-81e2-577e48ac8401 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:14:31.624959 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc80a309-ecf0-43b9-81e2-577e48ac8401 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:31.625240 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc80a309-ecf0-43b9-81e2-577e48ac8401 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:31.625516 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc80a309-ecf0-43b9-81e2-577e48ac8401 None admin] PATH_INFO: `/v3/services` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:31.626230 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc80a309-ecf0-43b9-81e2-577e48ac8401 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:14:31.626540 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc80a309-ecf0-43b9-81e2-577e48ac8401 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:14:31.628461 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc80a309-ecf0-43b9-81e2-577e48ac8401 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:14:31.634138 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7461e89d-81f2-42da-9fec-31a097d33c0c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:14:31.635582 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7461e89d-81f2-42da-9fec-31a097d33c0c None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:14:31.638177 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 476/962] 10.222.0.44 () {56 vars in 1122 bytes} [Thu Jun 16 12:14:31 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:14:31.639528 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d94f0f-70f0-4622-a23e-fca764a59062 None None] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:31.639822 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d94f0f-70f0-4622-a23e-fca764a59062 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:31.640104 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d94f0f-70f0-4622-a23e-fca764a59062 None None] PATH_INFO: `/` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:31.645210 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 477/963] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 12:14:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 12:14:31.645210 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d94f0f-70f0-4622-a23e-fca764a59062 None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:14:31.655796 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-7461e89d-81f2-42da-9fec-31a097d33c0c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 12:14:31.655796 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 12:14:31.655796 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 12:14:31.655796 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 12:14:31.655796 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 12:14:31.655796 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 12:14:31.655796 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 12:14:31.655796 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 12:14:31.655796 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 12:14:31.655796 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 12:14:31.655796 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 12:14:31.655796 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 12:14:31.655796 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 12:14:31.655796 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 12:14:31.655796 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 12:14:31.656742 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 12:14:31.656742 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 12:14:31.656742 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 12:14:31.656742 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 12:14:31.656742 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 12:14:31.656742 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 12:14:31.656742 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 12:14:31.656742 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 12:14:31.656742 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jun 16 12:14:31.656742 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 12:14:31.656742 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jun 16 12:14:31.656742 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 12:14:31.656742 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 12:14:31.656742 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 12:14:31.656742 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jun 16 12:14:31.656742 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 12:14:31.656742 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jun 16 12:14:31.657660 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 12:14:31.657660 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 12:14:31.657660 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 12:14:31.657660 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jun 16 12:14:31.661016 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 487/964] 10.222.0.44 () {56 vars in 1108 bytes} [Thu Jun 16 12:14:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 12:14:31.662589 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3d9323-f8b4-4256-a21f-872210beebae None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:31.663132 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3d9323-f8b4-4256-a21f-872210beebae None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:31.663411 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3d9323-f8b4-4256-a21f-872210beebae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:31.681185 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-0a3d9323-f8b4-4256-a21f-872210beebae None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:14:31.682755 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-0a3d9323-f8b4-4256-a21f-872210beebae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:14:31.745405 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:14:31.760684 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d94f0f-70f0-4622-a23e-fca764a59062 None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:14:31.762528 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 488/965] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 12:14:31 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 12:14:31.763374 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3d9323-f8b4-4256-a21f-872210beebae None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:14:31.794925 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c689d018-2ae2-4add-9f96-c1ff595a2e45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:14:31.795699 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c689d018-2ae2-4add-9f96-c1ff595a2e45 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:31.796045 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c689d018-2ae2-4add-9f96-c1ff595a2e45 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:31.796389 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c689d018-2ae2-4add-9f96-c1ff595a2e45 None admin] PATH_INFO: `/v3/services` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:31.797190 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c689d018-2ae2-4add-9f96-c1ff595a2e45 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:14:31.797497 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c689d018-2ae2-4add-9f96-c1ff595a2e45 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:14:31.798850 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c689d018-2ae2-4add-9f96-c1ff595a2e45 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:14:31.804307 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 478/966] 10.222.0.44 () {56 vars in 1122 bytes} [Thu Jun 16 12:14:31 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:14:31.805381 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93c8fad-fbfc-42b1-848a-e2d7f6000817 None None] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:31.805665 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93c8fad-fbfc-42b1-848a-e2d7f6000817 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:31.805938 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93c8fad-fbfc-42b1-848a-e2d7f6000817 None None] PATH_INFO: `/` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:31.807154 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 479/967] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 12:14:31 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 12:14:31.807850 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93c8fad-fbfc-42b1-848a-e2d7f6000817 None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:14:31.829216 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:14:31.866399 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3d9323-f8b4-4256-a21f-872210beebae None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:14:31.900212 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d44eee7-78b5-45dc-99c1-16608ed9aa08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:14:31.900898 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d44eee7-78b5-45dc-99c1-16608ed9aa08 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:31.901178 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d44eee7-78b5-45dc-99c1-16608ed9aa08 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:31.901458 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d44eee7-78b5-45dc-99c1-16608ed9aa08 None admin] PATH_INFO: `/v3/domains` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:31.902178 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d44eee7-78b5-45dc-99c1-16608ed9aa08 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:14:31.902480 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d44eee7-78b5-45dc-99c1-16608ed9aa08 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:14:31.903845 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d44eee7-78b5-45dc-99c1-16608ed9aa08 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:14:31.909423 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93c8fad-fbfc-42b1-848a-e2d7f6000817 None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:14:31.915295 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 489/968] 10.222.0.44 () {56 vars in 1109 bytes} [Thu Jun 16 12:14:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:14:31.916054 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d44eee7-78b5-45dc-99c1-16608ed9aa08 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:14:31.948349 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee75c3a-3544-41eb-9d37-ff29703d6bcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:14:31.949044 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee75c3a-3544-41eb-9d37-ff29703d6bcd None admin] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:31.949322 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee75c3a-3544-41eb-9d37-ff29703d6bcd None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:31.949602 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee75c3a-3544-41eb-9d37-ff29703d6bcd None admin] PATH_INFO: `/v3/services` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:31.950313 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee75c3a-3544-41eb-9d37-ff29703d6bcd None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:14:31.951668 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee75c3a-3544-41eb-9d37-ff29703d6bcd None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:14:31.964862 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 480/969] 10.222.0.44 () {60 vars in 1141 bytes} [Thu Jun 16 12:14:31 2022] POST /identity/v3/services => generated 242 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 12:14:31.966229 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8591d7a2-9bb4-4c51-8313-67f66f7bb75e None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:31.966518 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8591d7a2-9bb4-4c51-8313-67f66f7bb75e None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:31.966789 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8591d7a2-9bb4-4c51-8313-67f66f7bb75e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:31.984365 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-8591d7a2-9bb4-4c51-8313-67f66f7bb75e None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:14:31.985606 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-8591d7a2-9bb4-4c51-8313-67f66f7bb75e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:14:31.995376 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:14:32.042161 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d44eee7-78b5-45dc-99c1-16608ed9aa08 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:14:32.068687 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:14:32.078205 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 481/970] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 12:14:31 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 12:14:32.081718 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8591d7a2-9bb4-4c51-8313-67f66f7bb75e None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:14:32.090665 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b598e38-dc37-4603-90ae-5123f9a50dd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:14:32.091840 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b598e38-dc37-4603-90ae-5123f9a50dd0 None admin] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:32.092330 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b598e38-dc37-4603-90ae-5123f9a50dd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:32.092830 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b598e38-dc37-4603-90ae-5123f9a50dd0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:32.093799 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b598e38-dc37-4603-90ae-5123f9a50dd0 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:14:32.095498 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b598e38-dc37-4603-90ae-5123f9a50dd0 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:14:32.118831 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 490/971] 10.222.0.44 () {60 vars in 1144 bytes} [Thu Jun 16 12:14:31 2022] POST /identity/v3/endpoints => generated 349 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 12:14:32.119862 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b598e38-dc37-4603-90ae-5123f9a50dd0 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:14:32.224524 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8591d7a2-9bb4-4c51-8313-67f66f7bb75e None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:14:32.269003 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b598e38-dc37-4603-90ae-5123f9a50dd0 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:14:32.272473 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097ccfe8-1925-46fd-947b-1e7a594dfe12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:14:32.273620 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097ccfe8-1925-46fd-947b-1e7a594dfe12 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:32.274106 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097ccfe8-1925-46fd-947b-1e7a594dfe12 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:32.274575 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097ccfe8-1925-46fd-947b-1e7a594dfe12 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:32.285840 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097ccfe8-1925-46fd-947b-1e7a594dfe12 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:14:32.287952 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097ccfe8-1925-46fd-947b-1e7a594dfe12 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:14:32.290405 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:14:32.308433 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f942127-01e4-4a5d-8c06-1df38e0ef7aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:14:32.309074 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f942127-01e4-4a5d-8c06-1df38e0ef7aa None admin] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:32.309351 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f942127-01e4-4a5d-8c06-1df38e0ef7aa None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:32.309623 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f942127-01e4-4a5d-8c06-1df38e0ef7aa None admin] PATH_INFO: `/v3/users` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:32.309805 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application [None req-097ccfe8-1925-46fd-947b-1e7a594dfe12 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 16 12:14:32.309805 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 12:14:32.309805 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 12:14:32.309805 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 12:14:32.309805 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 12:14:32.309805 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 12:14:32.309805 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 12:14:32.309805 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 12:14:32.309805 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 12:14:32.309805 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 12:14:32.309805 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 12:14:32.309805 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 12:14:32.309805 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 12:14:32.309805 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 12:14:32.309805 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 12:14:32.309805 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 12:14:32.310694 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 12:14:32.310694 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 12:14:32.310694 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 12:14:32.310694 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 12:14:32.310694 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 12:14:32.310694 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 12:14:32.310694 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 12:14:32.310694 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 12:14:32.310694 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 12:14:32.310694 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 12:14:32.310694 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 12:14:32.310694 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application with Lock( Jun 16 12:14:32.310694 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 12:14:32.310694 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._enter() Jun 16 12:14:32.310694 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 12:14:32.310694 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 12:14:32.310694 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 12:14:32.310694 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.creator() Jun 16 12:14:32.311674 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 12:14:32.311674 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application created_value = creator( Jun 16 12:14:32.311674 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 12:14:32.311674 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 12:14:32.311674 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 12:14:32.311674 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 12:14:32.311674 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 12:14:32.311674 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 12:14:32.311674 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 16 12:14:32.311674 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application Jun 16 12:14:32.312232 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f942127-01e4-4a5d-8c06-1df38e0ef7aa None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:14:32.312316 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 482/972] 10.222.0.44 () {56 vars in 1117 bytes} [Thu Jun 16 12:14:32 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 12:14:32.313597 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f942127-01e4-4a5d-8c06-1df38e0ef7aa None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:14:32.316962 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097ccfe8-1925-46fd-947b-1e7a594dfe12 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:14:32.330755 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.sql.core [None req-0f942127-01e4-4a5d-8c06-1df38e0ef7aa None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 16 12:14:32.330755 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jun 16 12:14:32.330755 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [parameters: {'user_id': 'f3577d043bac48dabc07ff326f472edf', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jun 16 12:14:32.330755 dv-cinder-846149-2-smb devstack@keystone.service[80076]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80076) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 16 12:14:32.338296 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-0f942127-01e4-4a5d-8c06-1df38e0ef7aa None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jun 16 12:14:32.338296 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 12:14:32.338296 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 16 12:14:32.338296 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 16 12:14:32.338296 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 16 12:14:32.338296 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 16 12:14:32.338296 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 16 12:14:32.338296 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application result = self._query(query) Jun 16 12:14:32.338296 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 16 12:14:32.338296 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application conn.query(q) Jun 16 12:14:32.338296 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 16 12:14:32.338296 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 16 12:14:32.338296 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 16 12:14:32.338296 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application result.read() Jun 16 12:14:32.338296 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 16 12:14:32.339229 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 16 12:14:32.339229 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 16 12:14:32.339229 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 16 12:14:32.339229 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 16 12:14:32.339229 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 16 12:14:32.339229 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 16 12:14:32.339229 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 16 12:14:32.339229 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 16 12:14:32.339229 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jun 16 12:14:32.339229 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 16 12:14:32.339229 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jun 16 12:14:32.339229 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 12:14:32.339229 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 16 12:14:32.339229 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 16 12:14:32.339229 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jun 16 12:14:32.339229 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jun 16 12:14:32.339229 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 16 12:14:32.339229 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application next(self.gen) Jun 16 12:14:32.340233 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 16 12:14:32.340233 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application yield resource Jun 16 12:14:32.340233 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 16 12:14:32.340233 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application next(self.gen) Jun 16 12:14:32.340233 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 16 12:14:32.340233 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application self.session.rollback() Jun 16 12:14:32.340233 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 16 12:14:32.340233 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application self.force_reraise() Jun 16 12:14:32.340233 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 16 12:14:32.340233 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise self.value Jun 16 12:14:32.340233 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 16 12:14:32.340233 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 16 12:14:32.340233 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 16 12:14:32.340233 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application session.commit() Jun 16 12:14:32.340233 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 16 12:14:32.340233 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 16 12:14:32.340233 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 16 12:14:32.341976 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application self._prepare_impl() Jun 16 12:14:32.341976 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 16 12:14:32.341976 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application self.session.flush() Jun 16 12:14:32.341976 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 16 12:14:32.341976 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application self._flush(objects) Jun 16 12:14:32.341976 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 16 12:14:32.341976 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 16 12:14:32.341976 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 16 12:14:32.341976 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application compat.raise_( Jun 16 12:14:32.341976 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 16 12:14:32.341976 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception Jun 16 12:14:32.341976 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 16 12:14:32.341976 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application flush_context.execute() Jun 16 12:14:32.341976 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 16 12:14:32.341976 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application rec.execute(self) Jun 16 12:14:32.341976 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 16 12:14:32.341976 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 16 12:14:32.343160 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 16 12:14:32.343160 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 16 12:14:32.343160 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jun 16 12:14:32.343160 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application result = connection._execute_20( Jun 16 12:14:32.343160 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 16 12:14:32.343160 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 16 12:14:32.343160 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 16 12:14:32.343160 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 16 12:14:32.343160 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 16 12:14:32.343160 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 16 12:14:32.343160 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 16 12:14:32.343160 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 16 12:14:32.343160 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 16 12:14:32.343160 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 16 12:14:32.343160 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 16 12:14:32.343160 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception Jun 16 12:14:32.344741 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 16 12:14:32.344741 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 16 12:14:32.344741 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 16 12:14:32.344741 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 16 12:14:32.344741 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 16 12:14:32.344741 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application result = self._query(query) Jun 16 12:14:32.344741 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 16 12:14:32.344741 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application conn.query(q) Jun 16 12:14:32.344741 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 16 12:14:32.344741 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 16 12:14:32.344741 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 16 12:14:32.344741 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application result.read() Jun 16 12:14:32.344741 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 16 12:14:32.344741 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 16 12:14:32.344741 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 16 12:14:32.344741 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 16 12:14:32.346053 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 16 12:14:32.346053 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 16 12:14:32.346053 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 16 12:14:32.346053 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 16 12:14:32.346053 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 16 12:14:32.346053 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jun 16 12:14:32.346053 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application [parameters: {'user_id': 'f3577d043bac48dabc07ff326f472edf', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jun 16 12:14:32.346053 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 16 12:14:32.346053 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jun 16 12:14:32.346053 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 12:14:32.346053 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jun 16 12:14:32.346053 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 12:14:32.346053 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 12:14:32.346053 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 12:14:32.346053 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 12:14:32.348219 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 12:14:32.348219 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 12:14:32.348219 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 12:14:32.348219 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 12:14:32.348219 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 12:14:32.348219 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 12:14:32.348219 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 12:14:32.348219 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jun 16 12:14:32.348219 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jun 16 12:14:32.348219 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 12:14:32.348219 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 12:14:32.348219 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 12:14:32.348219 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 12:14:32.348219 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 12:14:32.348219 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 12:14:32.348219 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jun 16 12:14:32.348219 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jun 16 12:14:32.351464 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jun 16 12:14:32.351464 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jun 16 12:14:32.351464 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 16 12:14:32.351464 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 16 12:14:32.351464 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jun 16 12:14:32.351464 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jun 16 12:14:32.351464 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 491/973] 10.222.0.44 () {60 vars in 1131 bytes} [Thu Jun 16 12:14:32 2022] POST /identity/v3/users => generated 160 bytes in 220 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jun 16 12:14:32.351464 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f942127-01e4-4a5d-8c06-1df38e0ef7aa None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:14:32.412538 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:14:32.468561 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097ccfe8-1925-46fd-947b-1e7a594dfe12 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:14:32.483653 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f942127-01e4-4a5d-8c06-1df38e0ef7aa None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:14:32.516223 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d7f9cb-77ac-4e9e-a62c-c0eb5103f0f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:14:32.516935 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d7f9cb-77ac-4e9e-a62c-c0eb5103f0f2 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:32.517212 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d7f9cb-77ac-4e9e-a62c-c0eb5103f0f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:32.517550 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d7f9cb-77ac-4e9e-a62c-c0eb5103f0f2 None admin] PATH_INFO: `/v3/users` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:32.518847 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d7f9cb-77ac-4e9e-a62c-c0eb5103f0f2 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:14:32.519147 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d7f9cb-77ac-4e9e-a62c-c0eb5103f0f2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:14:32.522130 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d7f9cb-77ac-4e9e-a62c-c0eb5103f0f2 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:14:32.535371 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17a908f-acec-44c9-ac4b-96ed65fb699d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:14:32.536433 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17a908f-acec-44c9-ac4b-96ed65fb699d None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:32.536926 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17a908f-acec-44c9-ac4b-96ed65fb699d None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:32.537397 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17a908f-acec-44c9-ac4b-96ed65fb699d None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:32.541646 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 483/974] 10.222.0.44 () {56 vars in 1149 bytes} [Thu Jun 16 12:14:32 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 12:14:32.547152 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d7f9cb-77ac-4e9e-a62c-c0eb5103f0f2 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:14:32.548105 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17a908f-acec-44c9-ac4b-96ed65fb699d None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:14:32.550257 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17a908f-acec-44c9-ac4b-96ed65fb699d None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:14:32.570003 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-f17a908f-acec-44c9-ac4b-96ed65fb699d None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 16 12:14:32.570003 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 12:14:32.570003 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 12:14:32.570003 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 12:14:32.570003 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 12:14:32.570003 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 12:14:32.570003 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 12:14:32.570003 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 12:14:32.570003 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 12:14:32.570003 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 12:14:32.570003 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 12:14:32.570003 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 12:14:32.570003 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 12:14:32.570003 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 12:14:32.570003 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 12:14:32.570003 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 12:14:32.570953 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 12:14:32.570953 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 12:14:32.570953 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 12:14:32.570953 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 12:14:32.570953 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 12:14:32.570953 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 12:14:32.570953 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 12:14:32.570953 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 12:14:32.570953 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 12:14:32.570953 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 12:14:32.570953 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 12:14:32.570953 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jun 16 12:14:32.570953 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 12:14:32.570953 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jun 16 12:14:32.570953 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 12:14:32.570953 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 12:14:32.570953 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 12:14:32.570953 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jun 16 12:14:32.571877 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 12:14:32.571877 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jun 16 12:14:32.571877 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 12:14:32.571877 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 12:14:32.571877 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 12:14:32.571877 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 12:14:32.571877 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 12:14:32.571877 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 12:14:32.571877 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 16 12:14:32.571877 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jun 16 12:14:32.574413 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 492/975] 10.222.0.44 () {56 vars in 1099 bytes} [Thu Jun 16 12:14:32 2022] GET /identity/v3/users/cinder => generated 84 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 12:14:32.580393 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17a908f-acec-44c9-ac4b-96ed65fb699d None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:14:32.619264 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:14:32.677435 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d7f9cb-77ac-4e9e-a62c-c0eb5103f0f2 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:14:32.689008 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:14:32.695030 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17a908f-acec-44c9-ac4b-96ed65fb699d None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:14:32.724356 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ec190e-17c5-4ff1-9c62-f02f690a040a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:14:32.727154 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ec190e-17c5-4ff1-9c62-f02f690a040a None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:32.727434 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ec190e-17c5-4ff1-9c62-f02f690a040a None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:32.727711 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ec190e-17c5-4ff1-9c62-f02f690a040a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:32.741066 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ece5a8-b486-4d8e-af5b-8195bee4a535 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:14:32.741749 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ece5a8-b486-4d8e-af5b-8195bee4a535 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:32.742024 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ece5a8-b486-4d8e-af5b-8195bee4a535 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:32.742291 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ece5a8-b486-4d8e-af5b-8195bee4a535 None admin] PATH_INFO: `/v3/users` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:32.743442 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ece5a8-b486-4d8e-af5b-8195bee4a535 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:14:32.743993 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ece5a8-b486-4d8e-af5b-8195bee4a535 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:14:32.745490 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ece5a8-b486-4d8e-af5b-8195bee4a535 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:14:32.800551 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 493/976] 10.222.0.44 () {56 vars in 1101 bytes} [Thu Jun 16 12:14:32 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:14:32.804787 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ec190e-17c5-4ff1-9c62-f02f690a040a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:14:32.804787 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ec190e-17c5-4ff1-9c62-f02f690a040a None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:14:32.869260 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:14:32.914640 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 484/977] 10.222.0.44 () {58 vars in 1282 bytes} [Thu Jun 16 12:14:32 2022] GET /identity/v3/auth/tokens => generated 1560 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 16 12:14:32.921007 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ece5a8-b486-4d8e-af5b-8195bee4a535 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:14:33.032610 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ece5a8-b486-4d8e-af5b-8195bee4a535 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:14:33.067863 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db61ecd-5bb0-4836-8daf-83ff15f93c0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:14:33.068658 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db61ecd-5bb0-4836-8daf-83ff15f93c0a None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:33.068956 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db61ecd-5bb0-4836-8daf-83ff15f93c0a None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:33.069228 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db61ecd-5bb0-4836-8daf-83ff15f93c0a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:33.079497 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db61ecd-5bb0-4836-8daf-83ff15f93c0a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:14:33.081141 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db61ecd-5bb0-4836-8daf-83ff15f93c0a None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:14:33.099530 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-4db61ecd-5bb0-4836-8daf-83ff15f93c0a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 12:14:33.099530 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 12:14:33.099530 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 12:14:33.099530 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 12:14:33.099530 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 12:14:33.099530 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 12:14:33.099530 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 12:14:33.099530 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 12:14:33.099530 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 12:14:33.099530 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 12:14:33.099530 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 12:14:33.099530 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 12:14:33.099530 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 12:14:33.099530 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 12:14:33.099530 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 12:14:33.100458 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 12:14:33.100458 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 12:14:33.100458 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 12:14:33.100458 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 12:14:33.100458 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 12:14:33.100458 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 12:14:33.100458 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 12:14:33.100458 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 12:14:33.100458 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jun 16 12:14:33.100458 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 12:14:33.100458 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jun 16 12:14:33.100458 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 12:14:33.100458 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 12:14:33.100458 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 12:14:33.100458 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jun 16 12:14:33.100458 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 12:14:33.100458 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jun 16 12:14:33.101941 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 12:14:33.101941 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 12:14:33.101941 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 12:14:33.101941 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jun 16 12:14:33.101941 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 494/978] 10.222.0.44 () {56 vars in 1108 bytes} [Thu Jun 16 12:14:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 12:14:33.107986 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ec190e-17c5-4ff1-9c62-f02f690a040a None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:14:33.208900 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ec190e-17c5-4ff1-9c62-f02f690a040a None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:14:33.243712 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b94aac-2adc-46bc-89fc-e01d545893c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:14:33.244376 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b94aac-2adc-46bc-89fc-e01d545893c1 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:33.244654 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b94aac-2adc-46bc-89fc-e01d545893c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:33.244948 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b94aac-2adc-46bc-89fc-e01d545893c1 None admin] PATH_INFO: `/v3/domains` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:33.245718 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b94aac-2adc-46bc-89fc-e01d545893c1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:14:33.246023 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b94aac-2adc-46bc-89fc-e01d545893c1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:14:33.247422 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b94aac-2adc-46bc-89fc-e01d545893c1 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:14:33.258975 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 485/979] 10.222.0.44 () {56 vars in 1109 bytes} [Thu Jun 16 12:14:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 12:14:33.264249 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db61ecd-5bb0-4836-8daf-83ff15f93c0a None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:14:33.276008 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:14:33.367775 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db61ecd-5bb0-4836-8daf-83ff15f93c0a None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:14:33.402238 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b4122b-04c3-4a47-b872-e5de76a9a2bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:14:33.403049 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b4122b-04c3-4a47-b872-e5de76a9a2bd None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:33.403330 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b4122b-04c3-4a47-b872-e5de76a9a2bd None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:33.403598 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b4122b-04c3-4a47-b872-e5de76a9a2bd None admin] PATH_INFO: `/v3/projects/service` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:33.410880 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b4122b-04c3-4a47-b872-e5de76a9a2bd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:14:33.412430 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b4122b-04c3-4a47-b872-e5de76a9a2bd None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:14:33.426410 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-59b4122b-04c3-4a47-b872-e5de76a9a2bd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 12:14:33.426410 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 12:14:33.426410 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 12:14:33.426410 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 12:14:33.426410 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 12:14:33.426410 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 12:14:33.426410 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 12:14:33.426410 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 12:14:33.426410 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 12:14:33.426410 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 12:14:33.426410 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 12:14:33.426410 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 12:14:33.426410 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 12:14:33.426410 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 12:14:33.426410 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 12:14:33.427276 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 12:14:33.427276 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 12:14:33.427276 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 12:14:33.427276 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 12:14:33.427276 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 12:14:33.427276 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 12:14:33.427276 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 12:14:33.427276 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 12:14:33.427276 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jun 16 12:14:33.427276 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 12:14:33.427276 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jun 16 12:14:33.427276 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 12:14:33.427276 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 12:14:33.427276 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 12:14:33.427276 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jun 16 12:14:33.427276 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 12:14:33.427276 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jun 16 12:14:33.428163 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 12:14:33.428163 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 12:14:33.428163 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 12:14:33.428163 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 12:14:33.428163 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 12:14:33.428163 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 12:14:33.428163 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 12:14:33.428163 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jun 16 12:14:33.428163 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 495/980] 10.222.0.44 () {56 vars in 1111 bytes} [Thu Jun 16 12:14:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 12:14:33.436863 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b94aac-2adc-46bc-89fc-e01d545893c1 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:14:33.455044 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:14:33.537686 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b94aac-2adc-46bc-89fc-e01d545893c1 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:14:33.570771 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e16ed86-ac2c-4f2a-ac0f-e9e291ab6f16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:14:33.571427 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e16ed86-ac2c-4f2a-ac0f-e9e291ab6f16 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:33.571707 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e16ed86-ac2c-4f2a-ac0f-e9e291ab6f16 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:33.571981 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e16ed86-ac2c-4f2a-ac0f-e9e291ab6f16 None admin] PATH_INFO: `/v3/projects` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:33.572778 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e16ed86-ac2c-4f2a-ac0f-e9e291ab6f16 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:14:33.573106 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e16ed86-ac2c-4f2a-ac0f-e9e291ab6f16 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:14:33.574523 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e16ed86-ac2c-4f2a-ac0f-e9e291ab6f16 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:14:33.587223 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 486/981] 10.222.0.44 () {56 vars in 1148 bytes} [Thu Jun 16 12:14:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:14:33.592885 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b4122b-04c3-4a47-b872-e5de76a9a2bd None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:14:33.659589 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:14:33.693648 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b4122b-04c3-4a47-b872-e5de76a9a2bd None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:14:33.727184 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6c3f7f-0da9-41f3-b5e0-399dc41992f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:14:33.727830 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6c3f7f-0da9-41f3-b5e0-399dc41992f0 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:33.728105 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6c3f7f-0da9-41f3-b5e0-399dc41992f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:33.728375 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6c3f7f-0da9-41f3-b5e0-399dc41992f0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:33.729222 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6c3f7f-0da9-41f3-b5e0-399dc41992f0 None admin] RBAC: Adding query filter params (role.id=6b361854fbed4b698a92f8199670a956, scope.project.id=601361df39e34fcca71175aa94e425c4, user.id=222b53cae3d64412b9b0a89d162311f4) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:14:33.729530 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6c3f7f-0da9-41f3-b5e0-399dc41992f0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:14:33.730952 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6c3f7f-0da9-41f3-b5e0-399dc41992f0 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:14:33.744838 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 496/982] 10.222.0.44 () {56 vars in 1374 bytes} [Thu Jun 16 12:14:33 2022] GET /identity/v3/role_assignments?user.id=222b53cae3d64412b9b0a89d162311f4&scope.project.id=601361df39e34fcca71175aa94e425c4&role.id=6b361854fbed4b698a92f8199670a956 => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:14:34.192962 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7301f920-8c1e-48ad-ba4e-92cca608eff2 None None] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:34.193469 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7301f920-8c1e-48ad-ba4e-92cca608eff2 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:34.193469 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7301f920-8c1e-48ad-ba4e-92cca608eff2 None None] PATH_INFO: `/` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:34.194927 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 487/983] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 12:14:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 12:14:34.200033 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e094d17-1be2-4f98-9956-fd38bbd22222 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:34.200454 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e094d17-1be2-4f98-9956-fd38bbd22222 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:34.200598 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e094d17-1be2-4f98-9956-fd38bbd22222 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:34.218905 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-8e094d17-1be2-4f98-9956-fd38bbd22222 None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:14:34.220622 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-8e094d17-1be2-4f98-9956-fd38bbd22222 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:14:34.292834 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 497/984] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 12:14:34 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 12:14:34.316033 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7301f920-8c1e-48ad-ba4e-92cca608eff2 None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:14:34.340423 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60f7c8f-489f-4c7e-a282-8351d5b109f5 None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:34.340711 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60f7c8f-489f-4c7e-a282-8351d5b109f5 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:34.341015 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60f7c8f-489f-4c7e-a282-8351d5b109f5 None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:34.342529 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 498/985] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 12:14:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 12:14:34.347664 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b2f67e-06cf-46c9-b468-381dab152eda None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:34.347957 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b2f67e-06cf-46c9-b468-381dab152eda None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:34.348228 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b2f67e-06cf-46c9-b468-381dab152eda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:34.365132 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-20b2f67e-06cf-46c9-b468-381dab152eda None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:14:34.366337 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-20b2f67e-06cf-46c9-b468-381dab152eda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:14:34.403000 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:14:34.427531 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:14:34.434902 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7301f920-8c1e-48ad-ba4e-92cca608eff2 None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:14:34.440028 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 499/986] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 12:14:34 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 16 12:14:34.462572 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b2f67e-06cf-46c9-b468-381dab152eda None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:14:34.476112 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196c05e8-e5fd-4180-92a6-df005b7889a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:14:34.476978 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196c05e8-e5fd-4180-92a6-df005b7889a9 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:34.477486 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196c05e8-e5fd-4180-92a6-df005b7889a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:34.477764 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196c05e8-e5fd-4180-92a6-df005b7889a9 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:34.478553 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196c05e8-e5fd-4180-92a6-df005b7889a9 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:14:34.479923 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196c05e8-e5fd-4180-92a6-df005b7889a9 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:14:34.493911 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application [None req-196c05e8-e5fd-4180-92a6-df005b7889a9 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 16 12:14:34.493911 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 12:14:34.493911 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 12:14:34.493911 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 12:14:34.493911 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 12:14:34.493911 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 12:14:34.493911 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 12:14:34.493911 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 12:14:34.493911 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 16 12:14:34.493911 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application Jun 16 12:14:34.493911 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 12:14:34.493911 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application Jun 16 12:14:34.493911 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 12:14:34.493911 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 12:14:34.493911 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 12:14:34.493911 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 12:14:34.493911 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 12:14:34.500054 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 12:14:34.500054 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 12:14:34.500054 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 12:14:34.500054 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 12:14:34.500054 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 12:14:34.500054 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 12:14:34.500054 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 12:14:34.500054 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 12:14:34.500054 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 12:14:34.500054 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 12:14:34.500054 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 12:14:34.500054 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 12:14:34.500054 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 12:14:34.500054 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 12:14:34.500054 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 12:14:34.500054 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 12:14:34.501238 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 12:14:34.501238 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application with Lock( Jun 16 12:14:34.501238 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 12:14:34.501238 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._enter() Jun 16 12:14:34.501238 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 12:14:34.501238 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 12:14:34.501238 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 12:14:34.501238 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.creator() Jun 16 12:14:34.501238 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 12:14:34.501238 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application created_value = creator( Jun 16 12:14:34.501238 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 12:14:34.501238 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 12:14:34.501238 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 16 12:14:34.501238 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application Jun 16 12:14:34.501238 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 488/987] 10.222.0.44 () {56 vars in 1111 bytes} [Thu Jun 16 12:14:34 2022] GET /identity/v3/services/compute => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 12:14:34.503279 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196c05e8-e5fd-4180-92a6-df005b7889a9 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:14:34.575533 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b2f67e-06cf-46c9-b468-381dab152eda None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:14:34.606535 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196c05e8-e5fd-4180-92a6-df005b7889a9 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:14:34.609472 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef86efcb-70c8-4d93-bda8-f4a91cfc8d8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:14:34.610271 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef86efcb-70c8-4d93-bda8-f4a91cfc8d8c None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:34.610556 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef86efcb-70c8-4d93-bda8-f4a91cfc8d8c None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:34.610858 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef86efcb-70c8-4d93-bda8-f4a91cfc8d8c None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:34.611509 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef86efcb-70c8-4d93-bda8-f4a91cfc8d8c None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:14:34.613468 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef86efcb-70c8-4d93-bda8-f4a91cfc8d8c None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:14:34.625360 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-ef86efcb-70c8-4d93-bda8-f4a91cfc8d8c None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 16 12:14:34.625360 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 12:14:34.625360 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 12:14:34.625360 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 12:14:34.625360 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 12:14:34.625360 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 12:14:34.625360 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 12:14:34.625360 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 12:14:34.625360 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 16 12:14:34.625360 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jun 16 12:14:34.625360 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 12:14:34.625360 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jun 16 12:14:34.625360 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 12:14:34.625360 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 12:14:34.625360 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 12:14:34.625360 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 12:14:34.625360 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 12:14:34.626331 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 12:14:34.626331 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 12:14:34.626331 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 12:14:34.626331 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 12:14:34.626331 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 12:14:34.626331 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 12:14:34.626331 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 12:14:34.626331 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 12:14:34.626331 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 12:14:34.626331 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 12:14:34.626331 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 12:14:34.626331 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 12:14:34.626331 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 12:14:34.626331 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 12:14:34.626331 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 12:14:34.626331 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 12:14:34.627210 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 12:14:34.627210 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jun 16 12:14:34.627210 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 12:14:34.627210 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jun 16 12:14:34.627210 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 12:14:34.627210 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 12:14:34.627210 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 12:14:34.627210 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jun 16 12:14:34.627210 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 12:14:34.627210 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jun 16 12:14:34.627210 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 12:14:34.627210 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 12:14:34.627210 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 16 12:14:34.627210 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jun 16 12:14:34.627210 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 500/988] 10.222.0.44 () {56 vars in 1126 bytes} [Thu Jun 16 12:14:34 2022] GET /identity/v3/services/object-store => generated 93 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 12:14:34.632371 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef86efcb-70c8-4d93-bda8-f4a91cfc8d8c None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:14:34.646921 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dc7415-8cd1-47bb-bec6-c1242ea48fb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:14:34.647940 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dc7415-8cd1-47bb-bec6-c1242ea48fb5 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:34.648369 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dc7415-8cd1-47bb-bec6-c1242ea48fb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:34.648864 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dc7415-8cd1-47bb-bec6-c1242ea48fb5 None admin] PATH_INFO: `/v3/services` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:34.649710 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01dc7415-8cd1-47bb-bec6-c1242ea48fb5 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:14:34.650185 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01dc7415-8cd1-47bb-bec6-c1242ea48fb5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:14:34.651873 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01dc7415-8cd1-47bb-bec6-c1242ea48fb5 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:14:34.657207 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 489/989] 10.222.0.44 () {56 vars in 1112 bytes} [Thu Jun 16 12:14:34 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 12:14:34.662641 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dc7415-8cd1-47bb-bec6-c1242ea48fb5 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:14:34.666450 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:14:34.699612 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:14:34.746444 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef86efcb-70c8-4d93-bda8-f4a91cfc8d8c None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:14:34.777666 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dc7415-8cd1-47bb-bec6-c1242ea48fb5 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:14:34.782433 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bd47c3-95f4-464d-8de1-7c2f63eaf1c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:14:34.783098 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bd47c3-95f4-464d-8de1-7c2f63eaf1c6 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:34.783382 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bd47c3-95f4-464d-8de1-7c2f63eaf1c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:34.783695 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bd47c3-95f4-464d-8de1-7c2f63eaf1c6 None admin] PATH_INFO: `/v3/services` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:34.784423 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bd47c3-95f4-464d-8de1-7c2f63eaf1c6 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:14:34.784732 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bd47c3-95f4-464d-8de1-7c2f63eaf1c6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:14:34.786126 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bd47c3-95f4-464d-8de1-7c2f63eaf1c6 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:14:34.791537 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 501/990] 10.222.0.44 () {56 vars in 1122 bytes} [Thu Jun 16 12:14:34 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 12:14:34.797137 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bd47c3-95f4-464d-8de1-7c2f63eaf1c6 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:14:34.813110 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25773ae1-ed09-41a1-99e4-507e42c9a643 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:14:34.813768 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25773ae1-ed09-41a1-99e4-507e42c9a643 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:34.814051 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25773ae1-ed09-41a1-99e4-507e42c9a643 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:34.814328 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25773ae1-ed09-41a1-99e4-507e42c9a643 None admin] PATH_INFO: `/v3/services` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:34.815086 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25773ae1-ed09-41a1-99e4-507e42c9a643 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:14:34.815392 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25773ae1-ed09-41a1-99e4-507e42c9a643 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:14:34.816770 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25773ae1-ed09-41a1-99e4-507e42c9a643 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:14:34.821604 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 490/991] 10.222.0.44 () {56 vars in 1112 bytes} [Thu Jun 16 12:14:34 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:14:34.827176 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25773ae1-ed09-41a1-99e4-507e42c9a643 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:14:34.898761 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:14:34.913741 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bd47c3-95f4-464d-8de1-7c2f63eaf1c6 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:14:34.938478 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:14:34.939581 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25773ae1-ed09-41a1-99e4-507e42c9a643 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:14:34.953924 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e742175f-4680-4fd3-9fdd-cec44ccac31a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:14:34.954706 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e742175f-4680-4fd3-9fdd-cec44ccac31a None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:34.954987 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e742175f-4680-4fd3-9fdd-cec44ccac31a None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:34.955260 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e742175f-4680-4fd3-9fdd-cec44ccac31a None admin] PATH_INFO: `/v3/services` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:34.956497 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e742175f-4680-4fd3-9fdd-cec44ccac31a None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:14:34.956821 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e742175f-4680-4fd3-9fdd-cec44ccac31a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:14:34.958413 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e742175f-4680-4fd3-9fdd-cec44ccac31a None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:14:34.963382 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 502/992] 10.222.0.44 () {56 vars in 1122 bytes} [Thu Jun 16 12:14:34 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 12:14:34.969034 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e742175f-4680-4fd3-9fdd-cec44ccac31a None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:14:34.983090 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2b0c44-4b7f-4010-adda-fae6e005cfe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:14:34.983753 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2b0c44-4b7f-4010-adda-fae6e005cfe1 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:34.984046 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2b0c44-4b7f-4010-adda-fae6e005cfe1 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:34.984306 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2b0c44-4b7f-4010-adda-fae6e005cfe1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:34.985147 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2b0c44-4b7f-4010-adda-fae6e005cfe1 None admin] RBAC: Adding query filter params (interface=public, service_id=11b60ffbbbec43799df9978172f2e4b0, region_id=RegionOne) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:14:34.985467 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2b0c44-4b7f-4010-adda-fae6e005cfe1 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:14:34.986847 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2b0c44-4b7f-4010-adda-fae6e005cfe1 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:14:34.992074 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 491/993] 10.222.0.44 () {56 vars in 1251 bytes} [Thu Jun 16 12:14:34 2022] GET /identity/v3/endpoints?service_id=11b60ffbbbec43799df9978172f2e4b0&interface=public®ion_id=RegionOne => generated 194 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 12:14:34.997701 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2b0c44-4b7f-4010-adda-fae6e005cfe1 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:14:35.077177 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e742175f-4680-4fd3-9fdd-cec44ccac31a None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:14:35.100606 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2b0c44-4b7f-4010-adda-fae6e005cfe1 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:14:35.113627 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6093224-709e-4261-bd1f-d14cadd7c316 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:14:35.114310 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6093224-709e-4261-bd1f-d14cadd7c316 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:35.114566 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6093224-709e-4261-bd1f-d14cadd7c316 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:35.114837 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6093224-709e-4261-bd1f-d14cadd7c316 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:35.115632 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6093224-709e-4261-bd1f-d14cadd7c316 None admin] RBAC: Adding query filter params (interface=admin, service_id=36c273efb41749e791cd2302614eaa35, region_id=RegionOne) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:14:35.115941 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6093224-709e-4261-bd1f-d14cadd7c316 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:14:35.117449 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6093224-709e-4261-bd1f-d14cadd7c316 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:14:35.122619 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 503/994] 10.222.0.44 () {56 vars in 1249 bytes} [Thu Jun 16 12:14:34 2022] GET /identity/v3/endpoints?service_id=36c273efb41749e791cd2302614eaa35&interface=admin®ion_id=RegionOne => generated 193 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 12:14:35.128321 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6093224-709e-4261-bd1f-d14cadd7c316 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:14:35.131015 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:14:35.137064 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb8794f-845e-4c94-98d5-b812c3468481 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:14:35.137726 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb8794f-845e-4c94-98d5-b812c3468481 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:35.138001 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb8794f-845e-4c94-98d5-b812c3468481 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:35.138269 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb8794f-845e-4c94-98d5-b812c3468481 None admin] PATH_INFO: `/v3/services` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:35.138940 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb8794f-845e-4c94-98d5-b812c3468481 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:14:35.140277 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb8794f-845e-4c94-98d5-b812c3468481 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:14:35.147426 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 492/995] 10.222.0.44 () {56 vars in 1087 bytes} [Thu Jun 16 12:14:34 2022] GET /identity/v3/services => generated 1727 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 12:14:35.183153 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:14:35.240541 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6093224-709e-4261-bd1f-d14cadd7c316 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:14:35.277598 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896ea128-ebb3-45d1-a2bc-ade6b695e747 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:14:35.278190 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896ea128-ebb3-45d1-a2bc-ade6b695e747 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:35.278464 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896ea128-ebb3-45d1-a2bc-ade6b695e747 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:35.278732 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896ea128-ebb3-45d1-a2bc-ade6b695e747 None admin] PATH_INFO: `/v3/services` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:35.279414 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896ea128-ebb3-45d1-a2bc-ade6b695e747 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:14:35.280830 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896ea128-ebb3-45d1-a2bc-ade6b695e747 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:14:35.297035 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 504/996] 10.222.0.44 () {56 vars in 1087 bytes} [Thu Jun 16 12:14:35 2022] GET /identity/v3/services => generated 1727 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 12:14:35.893925 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210595d5-200b-480b-8a42-922de891c242 None None] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:35.894440 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210595d5-200b-480b-8a42-922de891c242 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:35.894516 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210595d5-200b-480b-8a42-922de891c242 None None] PATH_INFO: `/` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:35.895981 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 493/997] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 12:14:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 12:14:35.900962 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30984e21-5fc8-4f40-a8ba-e6118b530866 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:35.901252 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30984e21-5fc8-4f40-a8ba-e6118b530866 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:35.901529 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30984e21-5fc8-4f40-a8ba-e6118b530866 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:35.920440 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-30984e21-5fc8-4f40-a8ba-e6118b530866 None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:14:35.920440 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-30984e21-5fc8-4f40-a8ba-e6118b530866 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:14:35.988852 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 505/998] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 12:14:35 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 12:14:36.010535 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210595d5-200b-480b-8a42-922de891c242 None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:14:36.113342 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210595d5-200b-480b-8a42-922de891c242 None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:14:36.146633 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0003c947-6d7e-4502-9bb2-75cbe3bc3495 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:14:36.147341 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0003c947-6d7e-4502-9bb2-75cbe3bc3495 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:36.147620 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0003c947-6d7e-4502-9bb2-75cbe3bc3495 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:36.147889 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0003c947-6d7e-4502-9bb2-75cbe3bc3495 None admin] PATH_INFO: `/v3/services/image` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:36.148529 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0003c947-6d7e-4502-9bb2-75cbe3bc3495 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:14:36.149912 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0003c947-6d7e-4502-9bb2-75cbe3bc3495 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:14:36.161773 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application [None req-0003c947-6d7e-4502-9bb2-75cbe3bc3495 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 16 12:14:36.161773 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 12:14:36.161773 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 12:14:36.161773 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 12:14:36.161773 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 12:14:36.161773 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 12:14:36.161773 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 12:14:36.161773 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 12:14:36.161773 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 16 12:14:36.161773 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application Jun 16 12:14:36.161773 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 12:14:36.161773 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application Jun 16 12:14:36.161773 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 12:14:36.161773 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 12:14:36.161773 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 12:14:36.161773 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 12:14:36.161773 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 12:14:36.162721 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 12:14:36.162721 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 12:14:36.162721 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 12:14:36.162721 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 12:14:36.162721 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 12:14:36.162721 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 12:14:36.162721 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 12:14:36.162721 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 12:14:36.162721 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 12:14:36.162721 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 12:14:36.162721 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 12:14:36.162721 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 12:14:36.162721 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 12:14:36.162721 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 12:14:36.162721 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 12:14:36.162721 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 12:14:36.163562 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 12:14:36.163562 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application with Lock( Jun 16 12:14:36.163562 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 12:14:36.163562 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._enter() Jun 16 12:14:36.163562 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 12:14:36.163562 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 12:14:36.163562 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 12:14:36.163562 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.creator() Jun 16 12:14:36.163562 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 12:14:36.163562 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application created_value = creator( Jun 16 12:14:36.163562 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 12:14:36.163562 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 12:14:36.163562 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 16 12:14:36.163562 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application Jun 16 12:14:36.163562 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 494/999] 10.222.0.44 () {56 vars in 1105 bytes} [Thu Jun 16 12:14:36 2022] GET /identity/v3/services/image => generated 86 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 12:14:36.168965 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30984e21-5fc8-4f40-a8ba-e6118b530866 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:14:36.212093 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:14:36.270502 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30984e21-5fc8-4f40-a8ba-e6118b530866 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:14:36.307505 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80807c67-e7bd-4ffc-95c5-7833d36a7182 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:14:36.308170 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80807c67-e7bd-4ffc-95c5-7833d36a7182 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:36.308452 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80807c67-e7bd-4ffc-95c5-7833d36a7182 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:36.308729 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80807c67-e7bd-4ffc-95c5-7833d36a7182 None admin] PATH_INFO: `/v3/services` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:36.309467 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80807c67-e7bd-4ffc-95c5-7833d36a7182 None admin] RBAC: Adding query filter params (name=image) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:14:36.309776 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80807c67-e7bd-4ffc-95c5-7833d36a7182 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:14:36.311148 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80807c67-e7bd-4ffc-95c5-7833d36a7182 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:14:36.320799 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 506/1000] 10.222.0.44 () {56 vars in 1108 bytes} [Thu Jun 16 12:14:36 2022] GET /identity/v3/services?name=image => generated 122 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:14:36.321945 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0003c947-6d7e-4502-9bb2-75cbe3bc3495 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:14:36.382453 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:14:36.428132 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0003c947-6d7e-4502-9bb2-75cbe3bc3495 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:14:36.461781 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d543e4f-d9a2-4c73-9c81-ec9d0c30b33b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:14:36.462438 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d543e4f-d9a2-4c73-9c81-ec9d0c30b33b None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:36.462712 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d543e4f-d9a2-4c73-9c81-ec9d0c30b33b None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:36.462978 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d543e4f-d9a2-4c73-9c81-ec9d0c30b33b None admin] PATH_INFO: `/v3/services` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:36.463674 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d543e4f-d9a2-4c73-9c81-ec9d0c30b33b None admin] RBAC: Adding query filter params (type=image) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:14:36.463975 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d543e4f-d9a2-4c73-9c81-ec9d0c30b33b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:14:36.465381 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d543e4f-d9a2-4c73-9c81-ec9d0c30b33b None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:14:36.469959 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 495/1001] 10.222.0.44 () {56 vars in 1108 bytes} [Thu Jun 16 12:14:36 2022] GET /identity/v3/services?type=image => generated 122 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:14:37.271416 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612d22b1-fe6a-4d9b-b5fe-cff40b00967f None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:37.271963 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612d22b1-fe6a-4d9b-b5fe-cff40b00967f None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:37.271963 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612d22b1-fe6a-4d9b-b5fe-cff40b00967f None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:37.273400 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 507/1002] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 12:14:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 12:14:37.278361 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4440511f-f2d1-4ec3-a7ff-4dd8e50e653c None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:37.278753 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4440511f-f2d1-4ec3-a7ff-4dd8e50e653c None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:37.278912 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4440511f-f2d1-4ec3-a7ff-4dd8e50e653c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:37.296058 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-4440511f-f2d1-4ec3-a7ff-4dd8e50e653c None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:14:37.297265 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-4440511f-f2d1-4ec3-a7ff-4dd8e50e653c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:14:37.365345 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 496/1003] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 12:14:37 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 16 12:14:37.388081 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612d22b1-fe6a-4d9b-b5fe-cff40b00967f None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:14:37.448320 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5274fca7-7628-458d-91f4-b22882a9e350 None None] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:37.448606 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5274fca7-7628-458d-91f4-b22882a9e350 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:37.448910 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5274fca7-7628-458d-91f4-b22882a9e350 None None] PATH_INFO: `/` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:37.450262 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 497/1004] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 12:14:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 12:14:37.455307 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad3ed62-62f6-4b41-a828-53f4c5ee8a43 None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:37.455817 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad3ed62-62f6-4b41-a828-53f4c5ee8a43 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:37.456096 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad3ed62-62f6-4b41-a828-53f4c5ee8a43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:37.472930 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-9ad3ed62-62f6-4b41-a828-53f4c5ee8a43 None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:14:37.474105 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-9ad3ed62-62f6-4b41-a828-53f4c5ee8a43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:14:37.495386 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612d22b1-fe6a-4d9b-b5fe-cff40b00967f None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:14:37.502668 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:14:37.524475 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:14:37.531598 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0005297-1e91-4130-a19d-533c03bf1fe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:14:37.532423 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0005297-1e91-4130-a19d-533c03bf1fe6 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:37.532703 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0005297-1e91-4130-a19d-533c03bf1fe6 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:37.533000 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0005297-1e91-4130-a19d-533c03bf1fe6 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:37.534220 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0005297-1e91-4130-a19d-533c03bf1fe6 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:14:37.535649 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0005297-1e91-4130-a19d-533c03bf1fe6 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:14:37.546204 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 498/1005] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 12:14:37 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 16 12:14:37.548273 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-e0005297-1e91-4130-a19d-533c03bf1fe6 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 16 12:14:37.548273 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 12:14:37.548273 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 12:14:37.548273 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 12:14:37.548273 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 12:14:37.548273 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 12:14:37.548273 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 12:14:37.548273 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 12:14:37.548273 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 16 12:14:37.548273 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jun 16 12:14:37.548273 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 12:14:37.548273 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jun 16 12:14:37.548273 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 12:14:37.548273 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 12:14:37.548273 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 12:14:37.548273 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 12:14:37.548273 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 12:14:37.550017 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 12:14:37.550017 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 12:14:37.550017 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 12:14:37.550017 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 12:14:37.550017 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 12:14:37.550017 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 12:14:37.550017 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 12:14:37.550017 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 12:14:37.550017 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 12:14:37.550017 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 12:14:37.550017 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 12:14:37.550017 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 12:14:37.550017 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 12:14:37.550017 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 12:14:37.550017 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 12:14:37.550017 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 12:14:37.555735 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 12:14:37.555735 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jun 16 12:14:37.555735 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 12:14:37.555735 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jun 16 12:14:37.555735 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 12:14:37.555735 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 12:14:37.555735 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 12:14:37.555735 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jun 16 12:14:37.555735 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 12:14:37.555735 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jun 16 12:14:37.555735 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 12:14:37.555735 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 12:14:37.555735 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 16 12:14:37.555735 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jun 16 12:14:37.555735 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 508/1006] 10.222.0.44 () {56 vars in 1111 bytes} [Thu Jun 16 12:14:37 2022] GET /identity/v3/services/compute => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 12:14:37.556530 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad3ed62-62f6-4b41-a828-53f4c5ee8a43 None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:14:37.570033 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0005297-1e91-4130-a19d-533c03bf1fe6 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:14:37.657377 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad3ed62-62f6-4b41-a828-53f4c5ee8a43 None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:14:37.674620 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0005297-1e91-4130-a19d-533c03bf1fe6 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:14:37.692210 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a33084-3d8a-4210-85b8-5022573d9b27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:14:37.692901 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a33084-3d8a-4210-85b8-5022573d9b27 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:37.693239 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a33084-3d8a-4210-85b8-5022573d9b27 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:37.693514 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a33084-3d8a-4210-85b8-5022573d9b27 None admin] PATH_INFO: `/v3/services` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:37.694214 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a33084-3d8a-4210-85b8-5022573d9b27 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:14:37.694515 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a33084-3d8a-4210-85b8-5022573d9b27 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:14:37.695866 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a33084-3d8a-4210-85b8-5022573d9b27 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:14:37.701730 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 499/1007] 10.222.0.44 () {56 vars in 1112 bytes} [Thu Jun 16 12:14:37 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:14:37.707946 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a33084-3d8a-4210-85b8-5022573d9b27 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:14:37.709960 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc2f316-3762-4465-84f2-a0da74744ca9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:14:37.710769 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc2f316-3762-4465-84f2-a0da74744ca9 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:37.711046 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc2f316-3762-4465-84f2-a0da74744ca9 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:37.712054 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc2f316-3762-4465-84f2-a0da74744ca9 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:37.712054 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc2f316-3762-4465-84f2-a0da74744ca9 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:14:37.713363 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc2f316-3762-4465-84f2-a0da74744ca9 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:14:37.726220 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-9cc2f316-3762-4465-84f2-a0da74744ca9 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 16 12:14:37.726220 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 12:14:37.726220 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 12:14:37.726220 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 12:14:37.726220 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 12:14:37.726220 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 12:14:37.726220 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 12:14:37.726220 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 12:14:37.726220 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 16 12:14:37.726220 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jun 16 12:14:37.726220 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 12:14:37.726220 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jun 16 12:14:37.726220 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 12:14:37.726220 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 12:14:37.726220 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 12:14:37.726220 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 12:14:37.726220 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 12:14:37.727201 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 12:14:37.727201 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 12:14:37.727201 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 12:14:37.727201 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 12:14:37.727201 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 12:14:37.727201 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 12:14:37.727201 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 12:14:37.727201 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 12:14:37.727201 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 12:14:37.727201 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 12:14:37.727201 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 12:14:37.727201 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 12:14:37.727201 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 12:14:37.727201 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 12:14:37.727201 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 12:14:37.727201 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 12:14:37.728032 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 12:14:37.728032 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jun 16 12:14:37.728032 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 12:14:37.728032 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jun 16 12:14:37.728032 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 12:14:37.728032 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 12:14:37.728032 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 12:14:37.728032 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jun 16 12:14:37.728032 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 12:14:37.728032 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jun 16 12:14:37.728032 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 12:14:37.728032 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 12:14:37.728032 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 16 12:14:37.728032 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jun 16 12:14:37.728032 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 509/1008] 10.222.0.44 () {56 vars in 1126 bytes} [Thu Jun 16 12:14:37 2022] GET /identity/v3/services/object-store => generated 93 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 12:14:37.733131 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc2f316-3762-4465-84f2-a0da74744ca9 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:14:37.766785 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:14:37.768135 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:14:37.822424 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a33084-3d8a-4210-85b8-5022573d9b27 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:14:37.838389 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc2f316-3762-4465-84f2-a0da74744ca9 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:14:37.858881 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2831dd6-d901-4bfe-ade0-de136fd5ae31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:14:37.859539 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2831dd6-d901-4bfe-ade0-de136fd5ae31 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:37.859817 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2831dd6-d901-4bfe-ade0-de136fd5ae31 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:37.860111 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2831dd6-d901-4bfe-ade0-de136fd5ae31 None admin] PATH_INFO: `/v3/services` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:37.860872 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2831dd6-d901-4bfe-ade0-de136fd5ae31 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:14:37.861179 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2831dd6-d901-4bfe-ade0-de136fd5ae31 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:14:37.862830 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2831dd6-d901-4bfe-ade0-de136fd5ae31 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:14:37.868437 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 500/1009] 10.222.0.44 () {56 vars in 1112 bytes} [Thu Jun 16 12:14:37 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 12:14:37.873907 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2831dd6-d901-4bfe-ade0-de136fd5ae31 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:14:37.875838 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b5a773-4d5b-4e41-a307-98d69f34f510 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:14:37.876500 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b5a773-4d5b-4e41-a307-98d69f34f510 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:37.876804 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b5a773-4d5b-4e41-a307-98d69f34f510 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:37.877116 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b5a773-4d5b-4e41-a307-98d69f34f510 None admin] PATH_INFO: `/v3/services` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:37.877819 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b5a773-4d5b-4e41-a307-98d69f34f510 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:14:37.878171 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b5a773-4d5b-4e41-a307-98d69f34f510 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:14:37.879542 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b5a773-4d5b-4e41-a307-98d69f34f510 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:14:37.884410 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 510/1010] 10.222.0.44 () {56 vars in 1122 bytes} [Thu Jun 16 12:14:37 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 12:14:37.889784 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b5a773-4d5b-4e41-a307-98d69f34f510 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:14:37.990348 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2831dd6-d901-4bfe-ade0-de136fd5ae31 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:14:37.999834 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:14:38.004784 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:14:38.006443 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b5a773-4d5b-4e41-a307-98d69f34f510 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:14:38.028625 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08178960-b983-4acf-8701-c4a9969b4d34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:14:38.029726 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08178960-b983-4acf-8701-c4a9969b4d34 None admin] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:38.030006 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08178960-b983-4acf-8701-c4a9969b4d34 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:38.030280 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08178960-b983-4acf-8701-c4a9969b4d34 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:38.031009 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08178960-b983-4acf-8701-c4a9969b4d34 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:14:38.032361 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08178960-b983-4acf-8701-c4a9969b4d34 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:14:38.045124 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7af5d7-9f52-45ac-8d9d-c32765084a24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:14:38.045786 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7af5d7-9f52-45ac-8d9d-c32765084a24 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:38.046069 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7af5d7-9f52-45ac-8d9d-c32765084a24 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:38.046340 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7af5d7-9f52-45ac-8d9d-c32765084a24 None admin] PATH_INFO: `/v3/services` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:38.047045 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7af5d7-9f52-45ac-8d9d-c32765084a24 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:14:38.047349 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7af5d7-9f52-45ac-8d9d-c32765084a24 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:14:38.048717 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7af5d7-9f52-45ac-8d9d-c32765084a24 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:14:38.056795 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 501/1011] 10.222.0.44 () {60 vars in 1144 bytes} [Thu Jun 16 12:14:37 2022] POST /identity/v3/endpoints => generated 334 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 12:14:38.056972 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 511/1012] 10.222.0.44 () {56 vars in 1122 bytes} [Thu Jun 16 12:14:37 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 12:14:38.060811 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08178960-b983-4acf-8701-c4a9969b4d34 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:14:38.175696 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08178960-b983-4acf-8701-c4a9969b4d34 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:14:38.212316 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83735953-41cb-42de-8eed-cf171edea21c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:14:38.213048 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83735953-41cb-42de-8eed-cf171edea21c None admin] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:38.213335 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83735953-41cb-42de-8eed-cf171edea21c None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:38.213607 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83735953-41cb-42de-8eed-cf171edea21c None admin] PATH_INFO: `/v3/endpoints` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:38.214369 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83735953-41cb-42de-8eed-cf171edea21c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:14:38.215773 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83735953-41cb-42de-8eed-cf171edea21c None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:14:38.232354 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 502/1013] 10.222.0.44 () {60 vars in 1144 bytes} [Thu Jun 16 12:14:38 2022] POST /identity/v3/endpoints => generated 325 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 12:14:38.599551 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51c9872-84b5-4249-9619-af29a45f282c None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:38.600076 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51c9872-84b5-4249-9619-af29a45f282c None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:38.600156 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51c9872-84b5-4249-9619-af29a45f282c None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:38.601566 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 512/1014] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 12:14:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 12:14:38.606633 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856bdebc-bbdb-4bfc-8f68-39b2befb4603 None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:38.607016 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856bdebc-bbdb-4bfc-8f68-39b2befb4603 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:38.607202 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856bdebc-bbdb-4bfc-8f68-39b2befb4603 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:38.624530 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-856bdebc-bbdb-4bfc-8f68-39b2befb4603 None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:14:38.625771 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-856bdebc-bbdb-4bfc-8f68-39b2befb4603 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:14:38.643869 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:14:38.704128 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 503/1015] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 12:14:38 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 12:14:38.727473 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51c9872-84b5-4249-9619-af29a45f282c None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:14:38.834220 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51c9872-84b5-4249-9619-af29a45f282c None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:14:38.868053 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737de25b-7494-4a32-8da6-d370603b8332 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:14:38.868648 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737de25b-7494-4a32-8da6-d370603b8332 None admin] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:38.869027 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737de25b-7494-4a32-8da6-d370603b8332 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:38.869310 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737de25b-7494-4a32-8da6-d370603b8332 None admin] PATH_INFO: `/v3/services` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:38.870041 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737de25b-7494-4a32-8da6-d370603b8332 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:14:38.871466 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737de25b-7494-4a32-8da6-d370603b8332 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:14:38.894201 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 513/1016] 10.222.0.44 () {60 vars in 1141 bytes} [Thu Jun 16 12:14:38 2022] POST /identity/v3/services => generated 242 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 12:14:40.324735 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a75f44b-4864-4abb-9fd7-f8c199bebbc8 None None] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:40.325290 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a75f44b-4864-4abb-9fd7-f8c199bebbc8 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:40.325407 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a75f44b-4864-4abb-9fd7-f8c199bebbc8 None None] PATH_INFO: `/` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:40.326702 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 504/1017] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 12:14:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 12:14:40.332334 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03151c15-5cd8-4c6f-9591-82fc2322fcd6 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:40.332739 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03151c15-5cd8-4c6f-9591-82fc2322fcd6 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:40.332935 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03151c15-5cd8-4c6f-9591-82fc2322fcd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:40.350144 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-03151c15-5cd8-4c6f-9591-82fc2322fcd6 None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:14:40.351330 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-03151c15-5cd8-4c6f-9591-82fc2322fcd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:14:40.363990 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa46f50-ded9-4921-833c-f0d1dfeef53d None None] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:40.364276 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa46f50-ded9-4921-833c-f0d1dfeef53d None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:40.364555 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa46f50-ded9-4921-833c-f0d1dfeef53d None None] PATH_INFO: `/` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:40.365961 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 505/1018] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 12:14:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 12:14:40.368946 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:14:40.371644 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbb6b53-91aa-4cb7-88c2-2e0b4eafff41 None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:40.372160 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbb6b53-91aa-4cb7-88c2-2e0b4eafff41 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:40.372346 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbb6b53-91aa-4cb7-88c2-2e0b4eafff41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:40.388976 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-acbb6b53-91aa-4cb7-88c2-2e0b4eafff41 None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:14:40.390158 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-acbb6b53-91aa-4cb7-88c2-2e0b4eafff41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:14:40.428772 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 514/1019] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 12:14:40 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 12:14:40.451899 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03151c15-5cd8-4c6f-9591-82fc2322fcd6 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:14:40.459687 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 506/1020] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 12:14:40 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 16 12:14:40.483050 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbb6b53-91aa-4cb7-88c2-2e0b4eafff41 None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:14:40.557861 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03151c15-5cd8-4c6f-9591-82fc2322fcd6 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:14:40.569312 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:14:40.591449 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbb6b53-91aa-4cb7-88c2-2e0b4eafff41 None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:14:40.598796 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdb720a-5391-4b7b-8df6-fd0a956a0195 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:14:40.600022 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdb720a-5391-4b7b-8df6-fd0a956a0195 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:40.600307 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdb720a-5391-4b7b-8df6-fd0a956a0195 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:40.600578 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdb720a-5391-4b7b-8df6-fd0a956a0195 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:40.612040 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdb720a-5391-4b7b-8df6-fd0a956a0195 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 12:14:40.620243 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-7cdb720a-5391-4b7b-8df6-fd0a956a0195 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 16 12:14:40.620243 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 12:14:40.620243 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 12:14:40.620243 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 12:14:40.620243 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 12:14:40.620243 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 12:14:40.620243 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 12:14:40.620243 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 12:14:40.620243 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 12:14:40.620243 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 12:14:40.620243 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 12:14:40.620243 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 12:14:40.620243 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 12:14:40.620243 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 12:14:40.620243 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 12:14:40.620243 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 12:14:40.621422 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 12:14:40.621422 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 12:14:40.621422 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 12:14:40.621422 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 12:14:40.621422 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 12:14:40.621422 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 12:14:40.621422 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 12:14:40.621422 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 12:14:40.621422 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 12:14:40.621422 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 12:14:40.621422 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 12:14:40.621422 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jun 16 12:14:40.621422 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 12:14:40.621422 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jun 16 12:14:40.621422 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 12:14:40.621422 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 12:14:40.622266 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 12:14:40.622266 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jun 16 12:14:40.622266 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 12:14:40.622266 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jun 16 12:14:40.622266 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 12:14:40.622266 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 12:14:40.622266 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 12:14:40.622266 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 12:14:40.622266 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 12:14:40.622266 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 12:14:40.622266 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 16 12:14:40.622266 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jun 16 12:14:40.622266 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 515/1021] 10.222.0.44 () {56 vars in 1120 bytes} [Thu Jun 16 12:14:40 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 12:14:40.627300 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdb720a-5391-4b7b-8df6-fd0a956a0195 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:14:40.630457 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef94bbb-f4c5-4158-b8be-8df0d807dd36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:14:40.631257 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef94bbb-f4c5-4158-b8be-8df0d807dd36 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:40.631538 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef94bbb-f4c5-4158-b8be-8df0d807dd36 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:40.631814 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef94bbb-f4c5-4158-b8be-8df0d807dd36 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:40.633046 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef94bbb-f4c5-4158-b8be-8df0d807dd36 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:14:40.634481 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef94bbb-f4c5-4158-b8be-8df0d807dd36 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:14:40.636107 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 507/1022] 10.222.0.44 () {56 vars in 1108 bytes} [Thu Jun 16 12:14:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 12:14:40.639854 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:14:40.642186 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef94bbb-f4c5-4158-b8be-8df0d807dd36 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:14:40.737536 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdb720a-5391-4b7b-8df6-fd0a956a0195 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:14:40.746485 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef94bbb-f4c5-4158-b8be-8df0d807dd36 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:14:40.772430 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbeaa9c-1d79-4a29-9825-dbe609adb432 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:14:40.773142 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbeaa9c-1d79-4a29-9825-dbe609adb432 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:40.773422 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbeaa9c-1d79-4a29-9825-dbe609adb432 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:40.773698 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbeaa9c-1d79-4a29-9825-dbe609adb432 None admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:40.774435 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbeaa9c-1d79-4a29-9825-dbe609adb432 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:14:40.774739 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbeaa9c-1d79-4a29-9825-dbe609adb432 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:14:40.776103 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbeaa9c-1d79-4a29-9825-dbe609adb432 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:14:40.790543 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad04f4b0-1e96-46f4-981c-50464303ddcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:14:40.790733 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 516/1023] 10.222.0.44 () {56 vars in 1115 bytes} [Thu Jun 16 12:14:40 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:14:40.790818 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad04f4b0-1e96-46f4-981c-50464303ddcd None admin] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:40.790818 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad04f4b0-1e96-46f4-981c-50464303ddcd None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:40.790818 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad04f4b0-1e96-46f4-981c-50464303ddcd None admin] PATH_INFO: `/v3/projects` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:40.790818 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad04f4b0-1e96-46f4-981c-50464303ddcd None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:14:40.790818 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad04f4b0-1e96-46f4-981c-50464303ddcd None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:14:40.791649 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbeaa9c-1d79-4a29-9825-dbe609adb432 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:14:40.811056 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:14:40.829124 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 508/1024] 10.222.0.44 () {60 vars in 1141 bytes} [Thu Jun 16 12:14:40 2022] POST /identity/v3/projects => generated 311 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 12:14:40.868249 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:14:40.904428 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbeaa9c-1d79-4a29-9825-dbe609adb432 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:14:40.949564 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460f1a15-3c2b-4cd0-9333-8957517476d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:14:40.950371 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460f1a15-3c2b-4cd0-9333-8957517476d9 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:40.950649 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460f1a15-3c2b-4cd0-9333-8957517476d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:40.950922 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460f1a15-3c2b-4cd0-9333-8957517476d9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:40.964683 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460f1a15-3c2b-4cd0-9333-8957517476d9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:14:40.966232 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460f1a15-3c2b-4cd0-9333-8957517476d9 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:14:40.988272 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-460f1a15-3c2b-4cd0-9333-8957517476d9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 12:14:40.988272 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 12:14:40.988272 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 12:14:40.988272 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 12:14:40.988272 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 12:14:40.988272 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 12:14:40.988272 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 12:14:40.988272 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 12:14:40.988272 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 12:14:40.988272 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 12:14:40.988272 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 12:14:40.988272 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 12:14:40.988272 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 12:14:40.988272 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 12:14:40.988272 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 12:14:40.989454 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 12:14:40.989454 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 12:14:40.989454 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 12:14:40.989454 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 12:14:40.989454 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 12:14:40.989454 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 12:14:40.989454 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 12:14:40.989454 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 12:14:40.989454 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jun 16 12:14:40.989454 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 12:14:40.989454 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jun 16 12:14:40.989454 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 12:14:40.989454 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 12:14:40.989454 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 12:14:40.989454 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jun 16 12:14:40.989454 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 12:14:40.989454 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jun 16 12:14:40.990467 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 12:14:40.990467 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 12:14:40.990467 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 12:14:40.990467 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jun 16 12:14:40.990467 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 517/1025] 10.222.0.44 () {56 vars in 1108 bytes} [Thu Jun 16 12:14:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 12:14:40.995884 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad04f4b0-1e96-46f4-981c-50464303ddcd None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:14:41.039042 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ff3126-5801-42ad-86e2-2efffa73a202 None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:41.039327 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ff3126-5801-42ad-86e2-2efffa73a202 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:41.039610 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ff3126-5801-42ad-86e2-2efffa73a202 None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:41.044323 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 518/1026] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 12:14:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 12:14:41.049783 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495ceac5-5803-401f-bce0-d379858bfe92 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:41.050063 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495ceac5-5803-401f-bce0-d379858bfe92 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:41.050337 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495ceac5-5803-401f-bce0-d379858bfe92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:41.067864 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-495ceac5-5803-401f-bce0-d379858bfe92 None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:14:41.069163 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-495ceac5-5803-401f-bce0-d379858bfe92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:14:41.109686 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad04f4b0-1e96-46f4-981c-50464303ddcd None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:14:41.137691 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 519/1027] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 12:14:41 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 16 12:14:41.146765 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612cfa38-f5db-4070-b6ea-33bdd0369e81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:14:41.147641 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612cfa38-f5db-4070-b6ea-33bdd0369e81 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:41.148136 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612cfa38-f5db-4070-b6ea-33bdd0369e81 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:41.148605 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612cfa38-f5db-4070-b6ea-33bdd0369e81 None admin] PATH_INFO: `/v3/domains` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:41.149529 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612cfa38-f5db-4070-b6ea-33bdd0369e81 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:14:41.150019 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612cfa38-f5db-4070-b6ea-33bdd0369e81 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:14:41.151561 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612cfa38-f5db-4070-b6ea-33bdd0369e81 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:14:41.160376 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495ceac5-5803-401f-bce0-d379858bfe92 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:14:41.163899 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 509/1028] 10.222.0.44 () {56 vars in 1109 bytes} [Thu Jun 16 12:14:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:14:41.170833 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612cfa38-f5db-4070-b6ea-33bdd0369e81 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:14:41.217406 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:14:41.241847 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:14:41.273129 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495ceac5-5803-401f-bce0-d379858bfe92 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:14:41.285945 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612cfa38-f5db-4070-b6ea-33bdd0369e81 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:14:41.308075 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829b6754-735a-47fb-a8fa-365974438a67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:14:41.308885 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829b6754-735a-47fb-a8fa-365974438a67 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:41.309163 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829b6754-735a-47fb-a8fa-365974438a67 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:41.309432 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829b6754-735a-47fb-a8fa-365974438a67 None admin] PATH_INFO: `/v3/services/image` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:41.310072 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829b6754-735a-47fb-a8fa-365974438a67 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:14:41.311484 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829b6754-735a-47fb-a8fa-365974438a67 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:14:41.321914 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb0144b-231f-4e2b-95e2-90ac0cb9d078 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:14:41.322702 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb0144b-231f-4e2b-95e2-90ac0cb9d078 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:41.322984 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb0144b-231f-4e2b-95e2-90ac0cb9d078 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:41.323260 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb0144b-231f-4e2b-95e2-90ac0cb9d078 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:41.323559 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-829b6754-735a-47fb-a8fa-365974438a67 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 16 12:14:41.323559 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 12:14:41.323559 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 12:14:41.323559 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 12:14:41.323559 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 12:14:41.323559 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 12:14:41.323559 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 12:14:41.323559 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 12:14:41.323559 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 16 12:14:41.323559 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jun 16 12:14:41.323559 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 12:14:41.323559 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jun 16 12:14:41.323559 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 12:14:41.323559 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 12:14:41.323559 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 12:14:41.323559 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 12:14:41.323559 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 12:14:41.324499 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 12:14:41.324499 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 12:14:41.324499 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 12:14:41.324499 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 12:14:41.324499 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 12:14:41.324499 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 12:14:41.324499 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 12:14:41.324499 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 12:14:41.324499 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 12:14:41.324499 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 12:14:41.324499 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 12:14:41.324499 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 12:14:41.324499 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 12:14:41.324499 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 12:14:41.324499 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 12:14:41.324499 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 12:14:41.325373 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 12:14:41.325373 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jun 16 12:14:41.325373 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 12:14:41.325373 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jun 16 12:14:41.325373 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 12:14:41.325373 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 12:14:41.325373 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 12:14:41.325373 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jun 16 12:14:41.325373 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 12:14:41.325373 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jun 16 12:14:41.325373 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 12:14:41.325373 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 12:14:41.325373 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 16 12:14:41.325373 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jun 16 12:14:41.325373 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 520/1029] 10.222.0.44 () {56 vars in 1105 bytes} [Thu Jun 16 12:14:41 2022] GET /identity/v3/services/image => generated 86 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 12:14:41.330992 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829b6754-735a-47fb-a8fa-365974438a67 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:14:41.337611 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb0144b-231f-4e2b-95e2-90ac0cb9d078 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:14:41.338968 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb0144b-231f-4e2b-95e2-90ac0cb9d078 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:14:41.354784 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application [None req-abb0144b-231f-4e2b-95e2-90ac0cb9d078 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 16 12:14:41.354784 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 12:14:41.354784 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 12:14:41.354784 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 12:14:41.354784 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 12:14:41.354784 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 12:14:41.354784 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 12:14:41.354784 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 12:14:41.354784 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 12:14:41.354784 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 12:14:41.354784 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 12:14:41.354784 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 12:14:41.354784 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 12:14:41.354784 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 12:14:41.354784 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 12:14:41.354784 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 12:14:41.355738 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 12:14:41.355738 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 12:14:41.355738 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 12:14:41.355738 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 12:14:41.355738 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 12:14:41.355738 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 12:14:41.355738 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 12:14:41.355738 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 12:14:41.355738 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 12:14:41.355738 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 12:14:41.355738 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 12:14:41.355738 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application with Lock( Jun 16 12:14:41.355738 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 12:14:41.355738 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._enter() Jun 16 12:14:41.355738 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 12:14:41.355738 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 12:14:41.355738 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 12:14:41.355738 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.creator() Jun 16 12:14:41.357208 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 12:14:41.357208 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application created_value = creator( Jun 16 12:14:41.357208 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 12:14:41.357208 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 12:14:41.357208 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 12:14:41.357208 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 12:14:41.357208 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 12:14:41.357208 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 12:14:41.357208 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 16 12:14:41.357208 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application Jun 16 12:14:41.357208 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 510/1030] 10.222.0.44 () {56 vars in 1093 bytes} [Thu Jun 16 12:14:41 2022] GET /identity/v3/users/nova => generated 82 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 12:14:41.362360 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb0144b-231f-4e2b-95e2-90ac0cb9d078 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:14:41.438075 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829b6754-735a-47fb-a8fa-365974438a67 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:14:41.456438 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:14:41.465768 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb0144b-231f-4e2b-95e2-90ac0cb9d078 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:14:41.477328 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091887a0-1634-4996-b1b6-240574211e73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:14:41.477980 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091887a0-1634-4996-b1b6-240574211e73 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:41.478256 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091887a0-1634-4996-b1b6-240574211e73 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:41.478603 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091887a0-1634-4996-b1b6-240574211e73 None admin] PATH_INFO: `/v3/services` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:41.479211 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091887a0-1634-4996-b1b6-240574211e73 None admin] RBAC: Adding query filter params (name=image) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:14:41.479508 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091887a0-1634-4996-b1b6-240574211e73 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:14:41.480893 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091887a0-1634-4996-b1b6-240574211e73 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:14:41.486213 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 521/1031] 10.222.0.44 () {56 vars in 1108 bytes} [Thu Jun 16 12:14:41 2022] GET /identity/v3/services?name=image => generated 122 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:14:41.491050 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:14:41.491572 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091887a0-1634-4996-b1b6-240574211e73 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:14:41.507704 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249f98cf-a14f-4929-9cca-e644c580ae1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:14:41.508381 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249f98cf-a14f-4929-9cca-e644c580ae1c None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:41.508666 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249f98cf-a14f-4929-9cca-e644c580ae1c None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:41.508981 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249f98cf-a14f-4929-9cca-e644c580ae1c None admin] PATH_INFO: `/v3/users` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:41.509820 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249f98cf-a14f-4929-9cca-e644c580ae1c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:14:41.510133 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249f98cf-a14f-4929-9cca-e644c580ae1c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:14:41.511555 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249f98cf-a14f-4929-9cca-e644c580ae1c None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:14:41.530846 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 511/1032] 10.222.0.44 () {56 vars in 1133 bytes} [Thu Jun 16 12:14:41 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 12:14:41.536895 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249f98cf-a14f-4929-9cca-e644c580ae1c None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:14:41.599076 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091887a0-1634-4996-b1b6-240574211e73 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:14:41.634356 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0949ae92-df08-4433-9554-6a0c8ed5a8c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:14:41.635026 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0949ae92-df08-4433-9554-6a0c8ed5a8c9 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:41.635308 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0949ae92-df08-4433-9554-6a0c8ed5a8c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:41.635583 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0949ae92-df08-4433-9554-6a0c8ed5a8c9 None admin] PATH_INFO: `/v3/services` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:41.635867 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249f98cf-a14f-4929-9cca-e644c580ae1c None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:14:41.636288 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0949ae92-df08-4433-9554-6a0c8ed5a8c9 None admin] RBAC: Adding query filter params (type=image) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:14:41.636595 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0949ae92-df08-4433-9554-6a0c8ed5a8c9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:14:41.638233 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0949ae92-df08-4433-9554-6a0c8ed5a8c9 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:14:41.644915 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 522/1033] 10.222.0.44 () {56 vars in 1108 bytes} [Thu Jun 16 12:14:41 2022] GET /identity/v3/services?type=image => generated 350 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 12:14:41.649460 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0949ae92-df08-4433-9554-6a0c8ed5a8c9 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:14:41.673592 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe3325e-1445-454e-a661-aede97d80c7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:14:41.674602 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe3325e-1445-454e-a661-aede97d80c7c None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:41.675083 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe3325e-1445-454e-a661-aede97d80c7c None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:41.675616 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe3325e-1445-454e-a661-aede97d80c7c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:41.695257 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:14:41.727950 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:14:41.749669 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0949ae92-df08-4433-9554-6a0c8ed5a8c9 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:14:41.750718 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe3325e-1445-454e-a661-aede97d80c7c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:14:41.752701 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe3325e-1445-454e-a661-aede97d80c7c None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:14:41.784898 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772ffdb3-2fe2-4b58-9cb2-8ae3ad2cb43e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:14:41.786451 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772ffdb3-2fe2-4b58-9cb2-8ae3ad2cb43e None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:41.786912 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772ffdb3-2fe2-4b58-9cb2-8ae3ad2cb43e None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:41.787346 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772ffdb3-2fe2-4b58-9cb2-8ae3ad2cb43e None admin] PATH_INFO: `/v3/endpoints` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:41.788272 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772ffdb3-2fe2-4b58-9cb2-8ae3ad2cb43e None admin] RBAC: Adding query filter params (interface=public, service_id=d1ef4e89248f4139ac367e80a729ba38, region_id=RegionOne) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:14:41.788727 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772ffdb3-2fe2-4b58-9cb2-8ae3ad2cb43e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:14:41.790666 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772ffdb3-2fe2-4b58-9cb2-8ae3ad2cb43e None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:14:41.797588 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 523/1034] 10.222.0.44 () {56 vars in 1251 bytes} [Thu Jun 16 12:14:41 2022] GET /identity/v3/endpoints?service_id=d1ef4e89248f4139ac367e80a729ba38&interface=public®ion_id=RegionOne => generated 194 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 12:14:41.803279 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772ffdb3-2fe2-4b58-9cb2-8ae3ad2cb43e None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:14:41.857086 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 512/1035] 10.222.0.44 () {58 vars in 1282 bytes} [Thu Jun 16 12:14:41 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 16 12:14:41.862544 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe3325e-1445-454e-a661-aede97d80c7c None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:14:41.911644 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772ffdb3-2fe2-4b58-9cb2-8ae3ad2cb43e None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:14:41.923019 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:14:41.956395 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256a335b-c127-4b0d-97e3-8cccfbef60f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:14:41.957094 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256a335b-c127-4b0d-97e3-8cccfbef60f1 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:41.957377 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256a335b-c127-4b0d-97e3-8cccfbef60f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:41.957646 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256a335b-c127-4b0d-97e3-8cccfbef60f1 None admin] PATH_INFO: `/v3/services` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:41.958328 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256a335b-c127-4b0d-97e3-8cccfbef60f1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:14:41.959444 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:14:41.959691 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256a335b-c127-4b0d-97e3-8cccfbef60f1 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:14:41.966894 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 524/1036] 10.222.0.44 () {56 vars in 1087 bytes} [Thu Jun 16 12:14:41 2022] GET /identity/v3/services => generated 1957 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 12:14:41.983451 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe3325e-1445-454e-a661-aede97d80c7c None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:14:42.023391 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21364322-6f6c-41ee-bc7c-ad5ffbe18467 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:14:42.024211 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21364322-6f6c-41ee-bc7c-ad5ffbe18467 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:42.024491 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21364322-6f6c-41ee-bc7c-ad5ffbe18467 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:42.024783 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21364322-6f6c-41ee-bc7c-ad5ffbe18467 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:42.036450 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21364322-6f6c-41ee-bc7c-ad5ffbe18467 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:14:42.037954 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21364322-6f6c-41ee-bc7c-ad5ffbe18467 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:14:42.057492 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application [None req-21364322-6f6c-41ee-bc7c-ad5ffbe18467 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 12:14:42.057492 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 12:14:42.057492 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 12:14:42.057492 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 12:14:42.057492 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 12:14:42.057492 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 12:14:42.057492 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 12:14:42.057492 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 12:14:42.057492 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 12:14:42.057492 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 12:14:42.057492 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 12:14:42.057492 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 12:14:42.057492 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 12:14:42.057492 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 12:14:42.057492 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 12:14:42.058437 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 12:14:42.058437 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 12:14:42.058437 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 12:14:42.058437 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 12:14:42.058437 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 12:14:42.058437 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 12:14:42.058437 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 12:14:42.058437 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 12:14:42.058437 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application with Lock( Jun 16 12:14:42.058437 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 12:14:42.058437 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._enter() Jun 16 12:14:42.058437 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 12:14:42.058437 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 12:14:42.058437 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 12:14:42.058437 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.creator() Jun 16 12:14:42.058437 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 12:14:42.058437 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application created_value = creator( Jun 16 12:14:42.065152 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 12:14:42.065152 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 12:14:42.065152 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 12:14:42.065152 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application Jun 16 12:14:42.065152 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 513/1037] 10.222.0.44 () {56 vars in 1108 bytes} [Thu Jun 16 12:14:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 12:14:42.065436 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256a335b-c127-4b0d-97e3-8cccfbef60f1 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:14:42.171219 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256a335b-c127-4b0d-97e3-8cccfbef60f1 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:14:42.207954 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b12cde-8b4c-4af9-9d94-84c771ed33ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:14:42.208639 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b12cde-8b4c-4af9-9d94-84c771ed33ac None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:42.208943 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b12cde-8b4c-4af9-9d94-84c771ed33ac None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:42.209211 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b12cde-8b4c-4af9-9d94-84c771ed33ac None admin] PATH_INFO: `/v3/domains` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:42.209922 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b12cde-8b4c-4af9-9d94-84c771ed33ac None admin] RBAC: Adding query filter params (name=Default) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:14:42.210218 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b12cde-8b4c-4af9-9d94-84c771ed33ac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:14:42.211569 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b12cde-8b4c-4af9-9d94-84c771ed33ac None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:14:42.224703 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 525/1038] 10.222.0.44 () {56 vars in 1109 bytes} [Thu Jun 16 12:14:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 12:14:42.230240 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21364322-6f6c-41ee-bc7c-ad5ffbe18467 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:14:42.337224 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21364322-6f6c-41ee-bc7c-ad5ffbe18467 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:14:42.365354 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:14:42.372687 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ccac91-1e3f-4f99-9f6a-7a970f024c87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:14:42.373505 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ccac91-1e3f-4f99-9f6a-7a970f024c87 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:42.373785 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ccac91-1e3f-4f99-9f6a-7a970f024c87 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:42.374053 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ccac91-1e3f-4f99-9f6a-7a970f024c87 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:42.381360 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ccac91-1e3f-4f99-9f6a-7a970f024c87 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:14:42.382791 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ccac91-1e3f-4f99-9f6a-7a970f024c87 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:14:42.396375 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application [None req-33ccac91-1e3f-4f99-9f6a-7a970f024c87 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 12:14:42.396375 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 12:14:42.396375 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 12:14:42.396375 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 12:14:42.396375 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 12:14:42.396375 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 12:14:42.396375 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 12:14:42.396375 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 12:14:42.396375 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 12:14:42.396375 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 12:14:42.396375 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 12:14:42.396375 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 12:14:42.396375 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 12:14:42.396375 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 12:14:42.396375 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 12:14:42.397289 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 12:14:42.397289 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 12:14:42.397289 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 12:14:42.397289 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 12:14:42.397289 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 12:14:42.397289 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 12:14:42.397289 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 12:14:42.397289 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 12:14:42.397289 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application with Lock( Jun 16 12:14:42.397289 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 12:14:42.397289 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._enter() Jun 16 12:14:42.397289 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 12:14:42.397289 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 12:14:42.397289 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 12:14:42.397289 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.creator() Jun 16 12:14:42.397289 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 12:14:42.397289 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application created_value = creator( Jun 16 12:14:42.398185 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 12:14:42.398185 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 12:14:42.398185 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 12:14:42.398185 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 12:14:42.398185 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 12:14:42.398185 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 12:14:42.398185 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 12:14:42.398185 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application Jun 16 12:14:42.402290 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 514/1039] 10.222.0.44 () {56 vars in 1111 bytes} [Thu Jun 16 12:14:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 12:14:42.403766 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b12cde-8b4c-4af9-9d94-84c771ed33ac None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:14:42.436621 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:14:42.507710 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b12cde-8b4c-4af9-9d94-84c771ed33ac None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:14:42.541987 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d36951e-eaab-4b3c-a508-6b9a9da4e7af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:14:42.542905 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d36951e-eaab-4b3c-a508-6b9a9da4e7af None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:42.543182 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d36951e-eaab-4b3c-a508-6b9a9da4e7af None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:42.543452 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d36951e-eaab-4b3c-a508-6b9a9da4e7af None admin] PATH_INFO: `/v3/projects` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:42.544234 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d36951e-eaab-4b3c-a508-6b9a9da4e7af None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:14:42.544538 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d36951e-eaab-4b3c-a508-6b9a9da4e7af None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:14:42.546016 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d36951e-eaab-4b3c-a508-6b9a9da4e7af None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:14:42.562606 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 526/1040] 10.222.0.44 () {56 vars in 1148 bytes} [Thu Jun 16 12:14:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 12:14:42.564734 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ccac91-1e3f-4f99-9f6a-7a970f024c87 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:14:42.665958 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ccac91-1e3f-4f99-9f6a-7a970f024c87 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:14:42.700876 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a79be60-605c-40cf-999f-a1aa9a9a2675 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:14:42.701532 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a79be60-605c-40cf-999f-a1aa9a9a2675 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:42.701813 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a79be60-605c-40cf-999f-a1aa9a9a2675 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:42.702084 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a79be60-605c-40cf-999f-a1aa9a9a2675 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:42.702924 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a79be60-605c-40cf-999f-a1aa9a9a2675 None admin] RBAC: Adding query filter params (role.id=6b361854fbed4b698a92f8199670a956, scope.project.id=601361df39e34fcca71175aa94e425c4, user.id=edfb12d445e74136b90800e93941f468) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:14:42.703235 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a79be60-605c-40cf-999f-a1aa9a9a2675 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:14:42.704667 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a79be60-605c-40cf-999f-a1aa9a9a2675 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:14:42.711189 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 515/1041] 10.222.0.44 () {56 vars in 1374 bytes} [Thu Jun 16 12:14:42 2022] GET /identity/v3/role_assignments?user.id=edfb12d445e74136b90800e93941f468&scope.project.id=601361df39e34fcca71175aa94e425c4&role.id=6b361854fbed4b698a92f8199670a956 => generated 259 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:14:42.981726 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea75b7f-087d-4605-9e73-f6e92e96d7b9 None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:42.982051 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea75b7f-087d-4605-9e73-f6e92e96d7b9 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:42.982282 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea75b7f-087d-4605-9e73-f6e92e96d7b9 None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:42.983689 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 527/1042] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 12:14:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 12:14:42.989257 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9b02eb-a51a-4106-9780-ad8d589f52de None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:42.989542 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9b02eb-a51a-4106-9780-ad8d589f52de None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:42.989811 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9b02eb-a51a-4106-9780-ad8d589f52de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:43.006881 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-8d9b02eb-a51a-4106-9780-ad8d589f52de None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:14:43.008060 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-8d9b02eb-a51a-4106-9780-ad8d589f52de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:14:43.058074 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:14:43.078435 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 516/1043] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 12:14:42 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 12:14:43.102546 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea75b7f-087d-4605-9e73-f6e92e96d7b9 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:14:43.200441 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:14:43.211578 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea75b7f-087d-4605-9e73-f6e92e96d7b9 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:14:43.247324 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f43f328-e9ac-4d7d-941b-1b3e13d287c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:14:43.248128 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f43f328-e9ac-4d7d-941b-1b3e13d287c1 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:43.248398 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f43f328-e9ac-4d7d-941b-1b3e13d287c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:43.248672 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f43f328-e9ac-4d7d-941b-1b3e13d287c1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:43.249889 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f43f328-e9ac-4d7d-941b-1b3e13d287c1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:14:43.251373 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f43f328-e9ac-4d7d-941b-1b3e13d287c1 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:14:43.258033 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 528/1044] 10.222.0.44 () {56 vars in 1108 bytes} [Thu Jun 16 12:14:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:14:43.259229 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9b02eb-a51a-4106-9780-ad8d589f52de None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:14:43.358950 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9b02eb-a51a-4106-9780-ad8d589f52de None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:14:43.392940 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988bbd5e-04aa-48e7-9f5b-6982d253e591 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:14:43.393674 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988bbd5e-04aa-48e7-9f5b-6982d253e591 None admin] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:43.393884 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988bbd5e-04aa-48e7-9f5b-6982d253e591 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:43.394162 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988bbd5e-04aa-48e7-9f5b-6982d253e591 None admin] PATH_INFO: `/v3/users` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:43.394873 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988bbd5e-04aa-48e7-9f5b-6982d253e591 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:14:43.396292 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988bbd5e-04aa-48e7-9f5b-6982d253e591 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:14:43.416854 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 517/1045] 10.222.0.44 () {60 vars in 1132 bytes} [Thu Jun 16 12:14:43 2022] POST /identity/v3/users => generated 285 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 12:14:44.140724 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2133621-1383-4396-ac2e-dfb6f76fd977 None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:44.141263 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2133621-1383-4396-ac2e-dfb6f76fd977 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:44.141340 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2133621-1383-4396-ac2e-dfb6f76fd977 None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:44.143207 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 529/1046] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 12:14:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 12:14:44.148442 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0293e22b-b23e-43e8-9aa6-92e53789db49 None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:44.148731 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0293e22b-b23e-43e8-9aa6-92e53789db49 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:44.149043 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0293e22b-b23e-43e8-9aa6-92e53789db49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:44.165509 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-0293e22b-b23e-43e8-9aa6-92e53789db49 None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:14:44.166686 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-0293e22b-b23e-43e8-9aa6-92e53789db49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:14:44.201003 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:14:44.236596 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 518/1047] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 12:14:44 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 12:14:44.259974 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2133621-1383-4396-ac2e-dfb6f76fd977 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:14:44.362917 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2133621-1383-4396-ac2e-dfb6f76fd977 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:14:44.395685 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d7e770-9b49-4c98-81df-2298c0bf3c46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:14:44.396467 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d7e770-9b49-4c98-81df-2298c0bf3c46 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:44.396743 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d7e770-9b49-4c98-81df-2298c0bf3c46 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:44.397036 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d7e770-9b49-4c98-81df-2298c0bf3c46 None admin] PATH_INFO: `/v3/services/image` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:44.397677 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d7e770-9b49-4c98-81df-2298c0bf3c46 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:14:44.399040 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d7e770-9b49-4c98-81df-2298c0bf3c46 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:14:44.410466 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-30d7e770-9b49-4c98-81df-2298c0bf3c46 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 16 12:14:44.410466 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 12:14:44.410466 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 12:14:44.410466 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 12:14:44.410466 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 12:14:44.410466 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 12:14:44.410466 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 12:14:44.410466 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 12:14:44.410466 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 16 12:14:44.410466 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jun 16 12:14:44.410466 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 12:14:44.410466 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jun 16 12:14:44.410466 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 12:14:44.410466 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 12:14:44.410466 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 12:14:44.410466 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 12:14:44.410466 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 12:14:44.411424 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 12:14:44.411424 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 12:14:44.411424 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 12:14:44.411424 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 12:14:44.411424 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 12:14:44.411424 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 12:14:44.411424 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 12:14:44.411424 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 12:14:44.411424 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 12:14:44.411424 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 12:14:44.411424 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 12:14:44.411424 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 12:14:44.411424 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 12:14:44.411424 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 12:14:44.411424 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 12:14:44.411424 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 12:14:44.412365 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 12:14:44.412365 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jun 16 12:14:44.412365 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 12:14:44.412365 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jun 16 12:14:44.412365 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 12:14:44.412365 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 12:14:44.412365 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 12:14:44.412365 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jun 16 12:14:44.412365 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 12:14:44.412365 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jun 16 12:14:44.412365 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 12:14:44.412365 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 12:14:44.412365 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 16 12:14:44.412365 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jun 16 12:14:44.413804 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 530/1048] 10.222.0.44 () {56 vars in 1105 bytes} [Thu Jun 16 12:14:44 2022] GET /identity/v3/services/image => generated 86 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 12:14:44.417927 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0293e22b-b23e-43e8-9aa6-92e53789db49 None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:14:44.519187 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0293e22b-b23e-43e8-9aa6-92e53789db49 None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:14:44.554067 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f2c864-d6f7-4e8b-a672-fb31b542fb38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:14:44.554756 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f2c864-d6f7-4e8b-a672-fb31b542fb38 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:44.555039 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f2c864-d6f7-4e8b-a672-fb31b542fb38 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:44.555313 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f2c864-d6f7-4e8b-a672-fb31b542fb38 None admin] PATH_INFO: `/v3/services` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:44.556044 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f2c864-d6f7-4e8b-a672-fb31b542fb38 None admin] RBAC: Adding query filter params (name=image) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:14:44.556353 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f2c864-d6f7-4e8b-a672-fb31b542fb38 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:14:44.557831 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f2c864-d6f7-4e8b-a672-fb31b542fb38 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:14:44.568531 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 519/1049] 10.222.0.44 () {56 vars in 1108 bytes} [Thu Jun 16 12:14:44 2022] GET /identity/v3/services?name=image => generated 122 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:14:44.569793 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d7e770-9b49-4c98-81df-2298c0bf3c46 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:14:44.596102 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:14:44.672613 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d7e770-9b49-4c98-81df-2298c0bf3c46 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:14:44.707409 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72caa8d4-091b-4677-9147-12d878a4753a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:14:44.708073 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72caa8d4-091b-4677-9147-12d878a4753a None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:44.708349 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72caa8d4-091b-4677-9147-12d878a4753a None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:44.708618 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72caa8d4-091b-4677-9147-12d878a4753a None admin] PATH_INFO: `/v3/services` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:44.709338 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72caa8d4-091b-4677-9147-12d878a4753a None admin] RBAC: Adding query filter params (type=image) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:14:44.709640 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72caa8d4-091b-4677-9147-12d878a4753a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:14:44.711000 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72caa8d4-091b-4677-9147-12d878a4753a None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:14:44.716035 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 531/1050] 10.222.0.44 () {56 vars in 1108 bytes} [Thu Jun 16 12:14:44 2022] GET /identity/v3/services?type=image => generated 350 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:14:44.722289 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f2c864-d6f7-4e8b-a672-fb31b542fb38 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:14:44.759810 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:14:44.816346 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736caf19-14ec-4dfe-a109-a0266cfc47fe None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:44.816644 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736caf19-14ec-4dfe-a109-a0266cfc47fe None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:44.816849 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736caf19-14ec-4dfe-a109-a0266cfc47fe None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:44.818229 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 532/1051] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 12:14:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 12:14:44.823041 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f447d82-fd3b-4b60-be1d-3442166cdb02 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:44.823324 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f447d82-fd3b-4b60-be1d-3442166cdb02 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:44.823623 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f447d82-fd3b-4b60-be1d-3442166cdb02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:44.832214 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f2c864-d6f7-4e8b-a672-fb31b542fb38 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:14:44.840927 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-3f447d82-fd3b-4b60-be1d-3442166cdb02 None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:14:44.842119 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-3f447d82-fd3b-4b60-be1d-3442166cdb02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:14:44.868661 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842754da-bb42-4933-844e-6fc687bd6410 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:14:44.869348 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842754da-bb42-4933-844e-6fc687bd6410 None admin] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:44.869635 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842754da-bb42-4933-844e-6fc687bd6410 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:44.869913 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842754da-bb42-4933-844e-6fc687bd6410 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:44.870656 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842754da-bb42-4933-844e-6fc687bd6410 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:14:44.872019 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842754da-bb42-4933-844e-6fc687bd6410 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:14:44.891053 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 520/1052] 10.222.0.44 () {60 vars in 1144 bytes} [Thu Jun 16 12:14:44 2022] POST /identity/v3/endpoints => generated 327 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 12:14:44.924599 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 533/1053] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 12:14:44 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 12:14:44.948570 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842754da-bb42-4933-844e-6fc687bd6410 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:14:45.048067 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:14:45.061124 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842754da-bb42-4933-844e-6fc687bd6410 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:14:45.096651 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7efda9-19c5-4431-ab4f-a705bb35adc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:14:45.097413 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7efda9-19c5-4431-ab4f-a705bb35adc0 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:45.097696 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7efda9-19c5-4431-ab4f-a705bb35adc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:45.097966 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7efda9-19c5-4431-ab4f-a705bb35adc0 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:45.108255 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7efda9-19c5-4431-ab4f-a705bb35adc0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 12:14:45.117092 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application [None req-fb7efda9-19c5-4431-ab4f-a705bb35adc0 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 16 12:14:45.117092 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 12:14:45.117092 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 12:14:45.117092 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 12:14:45.117092 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 12:14:45.117092 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 12:14:45.117092 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 12:14:45.117092 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 12:14:45.117092 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 12:14:45.117092 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 12:14:45.117092 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 12:14:45.117092 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 12:14:45.117092 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 12:14:45.117092 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 12:14:45.117092 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 12:14:45.117092 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 12:14:45.118047 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 12:14:45.118047 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 12:14:45.118047 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 12:14:45.118047 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 12:14:45.118047 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 12:14:45.118047 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 12:14:45.118047 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 12:14:45.118047 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 12:14:45.118047 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 12:14:45.118047 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 12:14:45.118047 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 12:14:45.118047 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application with Lock( Jun 16 12:14:45.118047 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 12:14:45.118047 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._enter() Jun 16 12:14:45.118047 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 12:14:45.118047 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 12:14:45.118903 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 12:14:45.118903 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.creator() Jun 16 12:14:45.118903 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 12:14:45.118903 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application created_value = creator( Jun 16 12:14:45.118903 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 12:14:45.118903 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 12:14:45.118903 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 12:14:45.118903 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 12:14:45.118903 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 12:14:45.118903 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 12:14:45.118903 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 16 12:14:45.118903 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application Jun 16 12:14:45.118903 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 521/1054] 10.222.0.44 () {56 vars in 1120 bytes} [Thu Jun 16 12:14:44 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 12:14:45.124362 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f447d82-fd3b-4b60-be1d-3442166cdb02 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:14:45.140049 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:14:45.226066 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f447d82-fd3b-4b60-be1d-3442166cdb02 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:14:45.260992 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae25dcd-cb75-48c8-ac7c-2dec6c2ddcf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:14:45.261664 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae25dcd-cb75-48c8-ac7c-2dec6c2ddcf3 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:45.261943 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae25dcd-cb75-48c8-ac7c-2dec6c2ddcf3 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:45.262214 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae25dcd-cb75-48c8-ac7c-2dec6c2ddcf3 None admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:45.262956 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae25dcd-cb75-48c8-ac7c-2dec6c2ddcf3 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:14:45.263262 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae25dcd-cb75-48c8-ac7c-2dec6c2ddcf3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:14:45.264630 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae25dcd-cb75-48c8-ac7c-2dec6c2ddcf3 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:14:45.273019 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 534/1055] 10.222.0.44 () {56 vars in 1115 bytes} [Thu Jun 16 12:14:45 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 12:14:45.278497 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7efda9-19c5-4431-ab4f-a705bb35adc0 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:14:45.379087 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7efda9-19c5-4431-ab4f-a705bb35adc0 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:14:45.413986 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f43961-1fd7-474f-b553-aab117828ed1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:14:45.414785 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f43961-1fd7-474f-b553-aab117828ed1 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:45.415065 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f43961-1fd7-474f-b553-aab117828ed1 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:45.415336 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f43961-1fd7-474f-b553-aab117828ed1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:45.427211 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f43961-1fd7-474f-b553-aab117828ed1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:14:45.428658 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f43961-1fd7-474f-b553-aab117828ed1 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:14:45.446601 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application [None req-a3f43961-1fd7-474f-b553-aab117828ed1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 12:14:45.446601 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 12:14:45.446601 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 12:14:45.446601 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 12:14:45.446601 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 12:14:45.446601 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 12:14:45.446601 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 12:14:45.446601 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 12:14:45.446601 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 12:14:45.446601 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 12:14:45.446601 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 12:14:45.446601 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 12:14:45.446601 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 12:14:45.446601 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 12:14:45.446601 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 12:14:45.447505 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 12:14:45.447505 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 12:14:45.447505 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 12:14:45.447505 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 12:14:45.447505 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 12:14:45.447505 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 12:14:45.447505 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 12:14:45.447505 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 12:14:45.447505 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application with Lock( Jun 16 12:14:45.447505 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 12:14:45.447505 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._enter() Jun 16 12:14:45.447505 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 12:14:45.447505 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 12:14:45.447505 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 12:14:45.447505 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.creator() Jun 16 12:14:45.447505 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 12:14:45.447505 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application created_value = creator( Jun 16 12:14:45.448468 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 12:14:45.448468 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 12:14:45.448468 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 12:14:45.448468 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application Jun 16 12:14:45.448468 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 522/1056] 10.222.0.44 () {56 vars in 1108 bytes} [Thu Jun 16 12:14:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 12:14:45.453452 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae25dcd-cb75-48c8-ac7c-2dec6c2ddcf3 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:14:45.529419 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:14:45.556545 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae25dcd-cb75-48c8-ac7c-2dec6c2ddcf3 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:14:45.591578 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a199b14-5346-4ae0-9bf6-1c841e048f51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:14:45.592251 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a199b14-5346-4ae0-9bf6-1c841e048f51 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:45.592531 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a199b14-5346-4ae0-9bf6-1c841e048f51 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:45.592808 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a199b14-5346-4ae0-9bf6-1c841e048f51 None admin] PATH_INFO: `/v3/domains` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:45.593523 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a199b14-5346-4ae0-9bf6-1c841e048f51 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:14:45.593823 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a199b14-5346-4ae0-9bf6-1c841e048f51 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:14:45.595719 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a199b14-5346-4ae0-9bf6-1c841e048f51 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:14:45.607613 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 535/1057] 10.222.0.44 () {56 vars in 1109 bytes} [Thu Jun 16 12:14:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:14:45.609655 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b243c4-1827-4079-874e-443024380309 None None] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:45.610043 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b243c4-1827-4079-874e-443024380309 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:45.610392 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b243c4-1827-4079-874e-443024380309 None None] PATH_INFO: `/` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:45.612651 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 523/1058] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 12:14:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 12:14:45.613706 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a199b14-5346-4ae0-9bf6-1c841e048f51 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:14:45.617236 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1469744d-bdfe-4a4c-b519-03a7f984c32e None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:45.617521 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1469744d-bdfe-4a4c-b519-03a7f984c32e None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:45.617799 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1469744d-bdfe-4a4c-b519-03a7f984c32e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:45.622810 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:14:45.635505 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-1469744d-bdfe-4a4c-b519-03a7f984c32e None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:14:45.636617 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-1469744d-bdfe-4a4c-b519-03a7f984c32e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:14:45.707334 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 524/1059] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 12:14:45 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 16 12:14:45.718721 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a199b14-5346-4ae0-9bf6-1c841e048f51 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:14:45.730523 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1469744d-bdfe-4a4c-b519-03a7f984c32e None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:14:45.754644 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b83703-25e6-456f-88d6-347c2f886b67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:14:45.755468 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b83703-25e6-456f-88d6-347c2f886b67 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:45.755750 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b83703-25e6-456f-88d6-347c2f886b67 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:45.756019 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b83703-25e6-456f-88d6-347c2f886b67 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:45.758771 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:14:45.764592 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b83703-25e6-456f-88d6-347c2f886b67 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:14:45.766249 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b83703-25e6-456f-88d6-347c2f886b67 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:14:45.781070 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-54b83703-25e6-456f-88d6-347c2f886b67 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 16 12:14:45.781070 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 12:14:45.781070 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 12:14:45.781070 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 12:14:45.781070 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 12:14:45.781070 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 12:14:45.781070 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 12:14:45.781070 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 12:14:45.781070 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 12:14:45.781070 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 12:14:45.781070 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 12:14:45.781070 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 12:14:45.781070 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 12:14:45.781070 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 12:14:45.781070 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 12:14:45.781070 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 12:14:45.782215 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 12:14:45.782215 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 12:14:45.782215 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 12:14:45.782215 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 12:14:45.782215 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 12:14:45.782215 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 12:14:45.782215 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 12:14:45.782215 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 12:14:45.782215 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 12:14:45.782215 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 12:14:45.782215 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 12:14:45.782215 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jun 16 12:14:45.782215 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 12:14:45.782215 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jun 16 12:14:45.782215 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 12:14:45.782215 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 12:14:45.782215 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 12:14:45.782215 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jun 16 12:14:45.783416 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 12:14:45.783416 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jun 16 12:14:45.783416 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 12:14:45.783416 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 12:14:45.783416 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 12:14:45.783416 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 12:14:45.783416 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 12:14:45.783416 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 12:14:45.783416 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 16 12:14:45.783416 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jun 16 12:14:45.785650 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 536/1060] 10.222.0.44 () {56 vars in 1093 bytes} [Thu Jun 16 12:14:45 2022] GET /identity/v3/users/nova => generated 82 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 12:14:45.790948 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b83703-25e6-456f-88d6-347c2f886b67 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:14:45.839621 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1469744d-bdfe-4a4c-b519-03a7f984c32e None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:14:45.877397 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:14:45.885170 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d04cb7-2701-41d4-b62e-2a85bb27e7a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:14:45.886310 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d04cb7-2701-41d4-b62e-2a85bb27e7a1 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:45.886973 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d04cb7-2701-41d4-b62e-2a85bb27e7a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:45.887323 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d04cb7-2701-41d4-b62e-2a85bb27e7a1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:45.892850 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b83703-25e6-456f-88d6-347c2f886b67 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:14:45.898546 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d04cb7-2701-41d4-b62e-2a85bb27e7a1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 12:14:45.906144 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application [None req-83d04cb7-2701-41d4-b62e-2a85bb27e7a1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 12:14:45.906144 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 12:14:45.906144 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 12:14:45.906144 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 12:14:45.906144 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 12:14:45.906144 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 12:14:45.906144 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 12:14:45.906144 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 12:14:45.906144 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 12:14:45.906144 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 12:14:45.906144 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 12:14:45.906144 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 12:14:45.906144 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 12:14:45.906144 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 12:14:45.906144 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 12:14:45.906144 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 12:14:45.907230 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 12:14:45.907230 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 12:14:45.907230 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 12:14:45.907230 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 12:14:45.907230 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 12:14:45.907230 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 12:14:45.907230 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 12:14:45.907230 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 12:14:45.907230 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 12:14:45.907230 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 12:14:45.907230 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 12:14:45.907230 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application with Lock( Jun 16 12:14:45.907230 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 12:14:45.907230 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._enter() Jun 16 12:14:45.907230 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 12:14:45.907230 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 12:14:45.908251 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 12:14:45.908251 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.creator() Jun 16 12:14:45.908251 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 12:14:45.908251 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application created_value = creator( Jun 16 12:14:45.908251 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 12:14:45.908251 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 12:14:45.908251 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 12:14:45.908251 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 12:14:45.908251 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 12:14:45.908251 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 12:14:45.908251 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 12:14:45.908251 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application Jun 16 12:14:45.912408 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 525/1061] 10.222.0.44 () {56 vars in 1096 bytes} [Thu Jun 16 12:14:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 12:14:45.913083 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d04cb7-2701-41d4-b62e-2a85bb27e7a1 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:14:45.931390 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3a7a5d-ddf0-467e-90e7-d5b0c0e2a9ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:14:45.934641 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3a7a5d-ddf0-467e-90e7-d5b0c0e2a9ff None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:45.934641 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3a7a5d-ddf0-467e-90e7-d5b0c0e2a9ff None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:45.934641 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3a7a5d-ddf0-467e-90e7-d5b0c0e2a9ff None admin] PATH_INFO: `/v3/users` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:45.934641 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3a7a5d-ddf0-467e-90e7-d5b0c0e2a9ff None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:14:45.934641 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3a7a5d-ddf0-467e-90e7-d5b0c0e2a9ff None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:14:45.935244 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3a7a5d-ddf0-467e-90e7-d5b0c0e2a9ff None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:14:45.953897 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 537/1062] 10.222.0.44 () {56 vars in 1133 bytes} [Thu Jun 16 12:14:45 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 12:14:45.959499 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3a7a5d-ddf0-467e-90e7-d5b0c0e2a9ff None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:14:46.016855 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:14:46.029949 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d04cb7-2701-41d4-b62e-2a85bb27e7a1 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:14:46.065673 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c584ad73-b3d2-4b3f-9ab0-fdad301a0e9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:14:46.066090 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3a7a5d-ddf0-467e-90e7-d5b0c0e2a9ff None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:14:46.066334 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c584ad73-b3d2-4b3f-9ab0-fdad301a0e9d None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:46.066612 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c584ad73-b3d2-4b3f-9ab0-fdad301a0e9d None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:46.066887 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c584ad73-b3d2-4b3f-9ab0-fdad301a0e9d None admin] PATH_INFO: `/v3/roles` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:46.067627 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c584ad73-b3d2-4b3f-9ab0-fdad301a0e9d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:14:46.067927 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c584ad73-b3d2-4b3f-9ab0-fdad301a0e9d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:14:46.069321 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c584ad73-b3d2-4b3f-9ab0-fdad301a0e9d None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:14:46.080388 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 526/1063] 10.222.0.44 () {56 vars in 1099 bytes} [Thu Jun 16 12:14:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 12:14:46.085884 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c584ad73-b3d2-4b3f-9ab0-fdad301a0e9d None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:14:46.101483 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f0678c-9d8b-44f5-a44b-0be904768f33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:14:46.102269 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f0678c-9d8b-44f5-a44b-0be904768f33 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:46.102661 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f0678c-9d8b-44f5-a44b-0be904768f33 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:46.102812 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f0678c-9d8b-44f5-a44b-0be904768f33 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:46.114230 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f0678c-9d8b-44f5-a44b-0be904768f33 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:14:46.116409 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f0678c-9d8b-44f5-a44b-0be904768f33 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:14:46.139052 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-01f0678c-9d8b-44f5-a44b-0be904768f33 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 12:14:46.139052 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 12:14:46.139052 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 12:14:46.139052 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 12:14:46.139052 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 12:14:46.139052 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 12:14:46.139052 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 12:14:46.139052 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 12:14:46.139052 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 12:14:46.139052 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 12:14:46.139052 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 12:14:46.139052 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 12:14:46.139052 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 12:14:46.139052 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 12:14:46.139052 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 12:14:46.139990 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 12:14:46.139990 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 12:14:46.139990 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 12:14:46.139990 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 12:14:46.139990 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 12:14:46.139990 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 12:14:46.139990 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 12:14:46.139990 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 12:14:46.139990 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jun 16 12:14:46.139990 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 12:14:46.139990 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jun 16 12:14:46.139990 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 12:14:46.139990 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 12:14:46.139990 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 12:14:46.139990 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jun 16 12:14:46.139990 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 12:14:46.139990 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jun 16 12:14:46.141333 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 12:14:46.141333 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 12:14:46.141333 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 12:14:46.141333 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jun 16 12:14:46.141333 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 538/1064] 10.222.0.44 () {56 vars in 1108 bytes} [Thu Jun 16 12:14:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 12:14:46.142908 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:14:46.147202 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f0678c-9d8b-44f5-a44b-0be904768f33 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:14:46.192101 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c584ad73-b3d2-4b3f-9ab0-fdad301a0e9d None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:14:46.228297 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af134c3-a2ef-4095-9764-6ffb5a204c7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:14:46.229348 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af134c3-a2ef-4095-9764-6ffb5a204c7d None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:46.229633 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af134c3-a2ef-4095-9764-6ffb5a204c7d None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:46.229906 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af134c3-a2ef-4095-9764-6ffb5a204c7d None admin] PATH_INFO: `/v3/users/77a12bc090a54c0b8c919fe325e904d2` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:46.243886 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af134c3-a2ef-4095-9764-6ffb5a204c7d None admin] RBAC: Authorizing `identity:get_user(user_id=77a12bc090a54c0b8c919fe325e904d2)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:14:46.245483 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af134c3-a2ef-4095-9764-6ffb5a204c7d None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:14:46.251609 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 527/1065] 10.222.0.44 () {56 vars in 1177 bytes} [Thu Jun 16 12:14:46 2022] GET /identity/v3/users/77a12bc090a54c0b8c919fe325e904d2 => generated 285 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 12:14:46.252767 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af134c3-a2ef-4095-9764-6ffb5a204c7d None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:14:46.255132 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f0678c-9d8b-44f5-a44b-0be904768f33 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:14:46.262811 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:14:46.296835 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87d58ca-b7a1-4093-bb87-899350b87d9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:14:46.297778 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87d58ca-b7a1-4093-bb87-899350b87d9e None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:46.298062 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87d58ca-b7a1-4093-bb87-899350b87d9e None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:46.299154 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87d58ca-b7a1-4093-bb87-899350b87d9e None admin] PATH_INFO: `/v3/domains` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:46.299871 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87d58ca-b7a1-4093-bb87-899350b87d9e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:14:46.300172 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87d58ca-b7a1-4093-bb87-899350b87d9e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:14:46.302071 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87d58ca-b7a1-4093-bb87-899350b87d9e None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:14:46.315008 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 539/1066] 10.222.0.44 () {56 vars in 1109 bytes} [Thu Jun 16 12:14:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 12:14:46.320459 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87d58ca-b7a1-4093-bb87-899350b87d9e None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:14:46.358468 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af134c3-a2ef-4095-9764-6ffb5a204c7d None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:14:46.371854 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:14:46.394281 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f6d8ab-20fc-4a1d-bd3d-fd5b55d11148 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:14:46.394850 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f6d8ab-20fc-4a1d-bd3d-fd5b55d11148 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:46.395127 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f6d8ab-20fc-4a1d-bd3d-fd5b55d11148 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:46.395397 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f6d8ab-20fc-4a1d-bd3d-fd5b55d11148 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:46.426443 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87d58ca-b7a1-4093-bb87-899350b87d9e None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:14:46.465218 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282bc594-94c6-42ea-886b-c3c29a8f12ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:14:46.466010 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282bc594-94c6-42ea-886b-c3c29a8f12ab None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:46.466290 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282bc594-94c6-42ea-886b-c3c29a8f12ab None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:46.466559 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282bc594-94c6-42ea-886b-c3c29a8f12ab None admin] PATH_INFO: `/v3/projects/service` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:46.467708 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f6d8ab-20fc-4a1d-bd3d-fd5b55d11148 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:14:46.469194 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f6d8ab-20fc-4a1d-bd3d-fd5b55d11148 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:14:46.473942 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282bc594-94c6-42ea-886b-c3c29a8f12ab None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:14:46.475383 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282bc594-94c6-42ea-886b-c3c29a8f12ab None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:14:46.490776 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-282bc594-94c6-42ea-886b-c3c29a8f12ab None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 12:14:46.490776 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 12:14:46.490776 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 12:14:46.490776 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 12:14:46.490776 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 12:14:46.490776 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 12:14:46.490776 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 12:14:46.490776 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 12:14:46.490776 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 12:14:46.490776 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 12:14:46.490776 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 12:14:46.490776 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 12:14:46.490776 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 12:14:46.490776 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 12:14:46.490776 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 12:14:46.491661 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 12:14:46.491661 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 12:14:46.491661 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 12:14:46.491661 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 12:14:46.491661 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 12:14:46.491661 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 12:14:46.491661 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 12:14:46.491661 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 12:14:46.491661 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jun 16 12:14:46.491661 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 12:14:46.491661 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jun 16 12:14:46.491661 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 12:14:46.491661 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 12:14:46.491661 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 12:14:46.491661 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jun 16 12:14:46.491661 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 12:14:46.491661 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jun 16 12:14:46.497687 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 12:14:46.497687 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 12:14:46.497687 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 12:14:46.497687 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 12:14:46.497687 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 12:14:46.497687 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 12:14:46.497687 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 12:14:46.497687 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jun 16 12:14:46.497687 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 540/1067] 10.222.0.44 () {56 vars in 1111 bytes} [Thu Jun 16 12:14:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 12:14:46.498285 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282bc594-94c6-42ea-886b-c3c29a8f12ab None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:14:46.524289 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:14:46.587032 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 528/1068] 10.222.0.44 () {58 vars in 1282 bytes} [Thu Jun 16 12:14:46 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 16 12:14:46.592666 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f6d8ab-20fc-4a1d-bd3d-fd5b55d11148 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:14:46.608079 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:14:46.609366 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282bc594-94c6-42ea-886b-c3c29a8f12ab None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:14:46.647359 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0222fa5-5096-47ea-94ee-999c38752ce8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:14:46.648003 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0222fa5-5096-47ea-94ee-999c38752ce8 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:46.648284 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0222fa5-5096-47ea-94ee-999c38752ce8 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:46.648557 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0222fa5-5096-47ea-94ee-999c38752ce8 None admin] PATH_INFO: `/v3/projects` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:46.649433 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0222fa5-5096-47ea-94ee-999c38752ce8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:14:46.649741 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0222fa5-5096-47ea-94ee-999c38752ce8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:14:46.651284 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0222fa5-5096-47ea-94ee-999c38752ce8 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:14:46.664603 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 541/1069] 10.222.0.44 () {56 vars in 1148 bytes} [Thu Jun 16 12:14:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:14:46.670588 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0222fa5-5096-47ea-94ee-999c38752ce8 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:14:46.710472 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f6d8ab-20fc-4a1d-bd3d-fd5b55d11148 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:14:46.745750 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6972d7-f196-4668-8848-ac59878969ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:14:46.746581 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6972d7-f196-4668-8848-ac59878969ba None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:46.747521 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6972d7-f196-4668-8848-ac59878969ba None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:46.747521 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6972d7-f196-4668-8848-ac59878969ba None admin] PATH_INFO: `/v3/projects/44d10c7982f5414a8cc8f4b90ce35ba2` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:46.748286 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6972d7-f196-4668-8848-ac59878969ba None admin] RBAC: Authorizing `identity:get_project(project_id=44d10c7982f5414a8cc8f4b90ce35ba2)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:14:46.749739 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6972d7-f196-4668-8848-ac59878969ba None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:14:46.751735 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 529/1070] 10.222.0.44 () {56 vars in 1186 bytes} [Thu Jun 16 12:14:46 2022] GET /identity/v3/projects/44d10c7982f5414a8cc8f4b90ce35ba2 => generated 311 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 12:14:46.757517 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6972d7-f196-4668-8848-ac59878969ba None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:14:46.763414 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:14:46.780090 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0222fa5-5096-47ea-94ee-999c38752ce8 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:14:46.814800 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9daaf4ac-7170-4284-9cfb-24bccb7e0f92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:14:46.815687 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9daaf4ac-7170-4284-9cfb-24bccb7e0f92 None admin] REQUEST_METHOD: `PUT` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:46.815961 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9daaf4ac-7170-4284-9cfb-24bccb7e0f92 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:46.816237 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9daaf4ac-7170-4284-9cfb-24bccb7e0f92 None admin] PATH_INFO: `/v3/projects/601361df39e34fcca71175aa94e425c4/users/edfb12d445e74136b90800e93941f468/roles/6b361854fbed4b698a92f8199670a956` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:46.818426 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9daaf4ac-7170-4284-9cfb-24bccb7e0f92 None admin] RBAC: Authorizing `identity:create_grant(project_id=601361df39e34fcca71175aa94e425c4, user_id=edfb12d445e74136b90800e93941f468, role_id=6b361854fbed4b698a92f8199670a956)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:14:46.819850 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9daaf4ac-7170-4284-9cfb-24bccb7e0f92 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:14:46.833229 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 542/1071] 10.222.0.44 () {58 vars in 1439 bytes} [Thu Jun 16 12:14:46 2022] PUT /identity/v3/projects/601361df39e34fcca71175aa94e425c4/users/edfb12d445e74136b90800e93941f468/roles/6b361854fbed4b698a92f8199670a956 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 12:14:46.861654 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:14:46.883289 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6972d7-f196-4668-8848-ac59878969ba None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:14:46.927204 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fe432a-52f5-4d39-a093-180dc98e5a72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:14:46.927919 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fe432a-52f5-4d39-a093-180dc98e5a72 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:46.928206 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fe432a-52f5-4d39-a093-180dc98e5a72 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:46.928479 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fe432a-52f5-4d39-a093-180dc98e5a72 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:46.929381 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fe432a-52f5-4d39-a093-180dc98e5a72 None admin] RBAC: Adding query filter params (role.id=0688968254744e3f9913653cafea3091, scope.project.id=44d10c7982f5414a8cc8f4b90ce35ba2, user.id=77a12bc090a54c0b8c919fe325e904d2) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:14:46.929718 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fe432a-52f5-4d39-a093-180dc98e5a72 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:14:46.931179 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fe432a-52f5-4d39-a093-180dc98e5a72 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:14:46.946060 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 530/1072] 10.222.0.44 () {56 vars in 1374 bytes} [Thu Jun 16 12:14:46 2022] GET /identity/v3/role_assignments?user.id=77a12bc090a54c0b8c919fe325e904d2&scope.project.id=44d10c7982f5414a8cc8f4b90ce35ba2&role.id=0688968254744e3f9913653cafea3091 => generated 259 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:14:47.071267 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ba1016-81a2-4796-8292-ecd36b844c83 None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:47.071608 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ba1016-81a2-4796-8292-ecd36b844c83 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:47.071813 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ba1016-81a2-4796-8292-ecd36b844c83 None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:47.073466 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 543/1073] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 12:14:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 12:14:47.078901 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7e1c03-0577-4f70-a11c-948a245cd9cb None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:47.079183 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7e1c03-0577-4f70-a11c-948a245cd9cb None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:47.080032 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7e1c03-0577-4f70-a11c-948a245cd9cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:47.097689 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-2a7e1c03-0577-4f70-a11c-948a245cd9cb None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:14:47.098903 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-2a7e1c03-0577-4f70-a11c-948a245cd9cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:14:47.169646 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 531/1074] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 12:14:47 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 12:14:47.192163 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ba1016-81a2-4796-8292-ecd36b844c83 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:14:47.294419 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ba1016-81a2-4796-8292-ecd36b844c83 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:14:47.329064 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3828596a-36d7-4df6-b64e-ac67fcdbb10b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:14:47.330275 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3828596a-36d7-4df6-b64e-ac67fcdbb10b None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:47.330555 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3828596a-36d7-4df6-b64e-ac67fcdbb10b None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:47.330824 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3828596a-36d7-4df6-b64e-ac67fcdbb10b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:47.346208 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:14:47.400802 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3828596a-36d7-4df6-b64e-ac67fcdbb10b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:14:47.403670 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3828596a-36d7-4df6-b64e-ac67fcdbb10b None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:14:47.499690 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 544/1075] 10.222.0.44 () {58 vars in 1282 bytes} [Thu Jun 16 12:14:47 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 16 12:14:47.505837 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7e1c03-0577-4f70-a11c-948a245cd9cb None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:14:47.580511 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:14:47.605989 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7e1c03-0577-4f70-a11c-948a245cd9cb None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:14:47.640157 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c242eab9-fc01-4f05-94aa-99174cf438d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:14:47.640984 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c242eab9-fc01-4f05-94aa-99174cf438d9 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:47.641262 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c242eab9-fc01-4f05-94aa-99174cf438d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:47.641528 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c242eab9-fc01-4f05-94aa-99174cf438d9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:47.651628 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c242eab9-fc01-4f05-94aa-99174cf438d9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:14:47.653080 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c242eab9-fc01-4f05-94aa-99174cf438d9 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:14:47.670517 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application [None req-c242eab9-fc01-4f05-94aa-99174cf438d9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 12:14:47.670517 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 12:14:47.670517 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 12:14:47.670517 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 12:14:47.670517 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 12:14:47.670517 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 12:14:47.670517 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 12:14:47.670517 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 12:14:47.670517 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 12:14:47.670517 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 12:14:47.670517 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 12:14:47.670517 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 12:14:47.670517 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 12:14:47.670517 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 12:14:47.670517 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 12:14:47.671396 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 12:14:47.671396 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 12:14:47.671396 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 12:14:47.671396 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 12:14:47.671396 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 12:14:47.671396 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 12:14:47.671396 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 12:14:47.671396 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 12:14:47.671396 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application with Lock( Jun 16 12:14:47.671396 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 12:14:47.671396 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._enter() Jun 16 12:14:47.671396 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 12:14:47.671396 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 12:14:47.671396 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 12:14:47.671396 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.creator() Jun 16 12:14:47.671396 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 12:14:47.671396 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application created_value = creator( Jun 16 12:14:47.672267 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 12:14:47.672267 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 12:14:47.672267 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 12:14:47.672267 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application Jun 16 12:14:47.672267 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 532/1076] 10.222.0.44 () {56 vars in 1108 bytes} [Thu Jun 16 12:14:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 12:14:47.679101 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3828596a-36d7-4df6-b64e-ac67fcdbb10b None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:14:47.725498 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:14:47.777620 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3828596a-36d7-4df6-b64e-ac67fcdbb10b None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:14:47.810903 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac03f5d2-0369-4ba8-80f8-379babd94077 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:14:47.811549 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac03f5d2-0369-4ba8-80f8-379babd94077 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:47.811825 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac03f5d2-0369-4ba8-80f8-379babd94077 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:47.812094 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac03f5d2-0369-4ba8-80f8-379babd94077 None admin] PATH_INFO: `/v3/domains` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:47.812819 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac03f5d2-0369-4ba8-80f8-379babd94077 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:14:47.813121 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac03f5d2-0369-4ba8-80f8-379babd94077 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:14:47.814503 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac03f5d2-0369-4ba8-80f8-379babd94077 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:14:47.825520 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 545/1077] 10.222.0.44 () {56 vars in 1109 bytes} [Thu Jun 16 12:14:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:14:48.966778 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2a56be-6134-44f4-a3ab-642652fd31ee None None] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:48.967309 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2a56be-6134-44f4-a3ab-642652fd31ee None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:48.967309 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2a56be-6134-44f4-a3ab-642652fd31ee None None] PATH_INFO: `/` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:48.968853 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 533/1078] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 12:14:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 12:14:48.973859 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8889ad63-8836-4d26-8389-0e0d4c55722e None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:48.974239 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8889ad63-8836-4d26-8389-0e0d4c55722e None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:48.974407 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8889ad63-8836-4d26-8389-0e0d4c55722e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:48.992310 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-8889ad63-8836-4d26-8389-0e0d4c55722e None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:14:48.993569 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-8889ad63-8836-4d26-8389-0e0d4c55722e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:14:49.053906 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93de0f7f-6517-4e67-a1cb-bf8b4cdc506e None None] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:49.054189 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93de0f7f-6517-4e67-a1cb-bf8b4cdc506e None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:49.054473 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93de0f7f-6517-4e67-a1cb-bf8b4cdc506e None None] PATH_INFO: `/` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:49.055860 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 534/1079] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 12:14:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 12:14:49.060686 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9fb1bc-0b0f-45aa-9fad-8df361199a9f None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:49.061002 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9fb1bc-0b0f-45aa-9fad-8df361199a9f None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:49.061278 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9fb1bc-0b0f-45aa-9fad-8df361199a9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:49.061484 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 546/1080] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 12:14:48 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 12:14:49.077862 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-3e9fb1bc-0b0f-45aa-9fad-8df361199a9f None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:14:49.079043 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-3e9fb1bc-0b0f-45aa-9fad-8df361199a9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:14:49.084563 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8889ad63-8836-4d26-8389-0e0d4c55722e None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:14:49.118302 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:14:49.145996 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 535/1081] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 12:14:49 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 16 12:14:49.168577 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9fb1bc-0b0f-45aa-9fad-8df361199a9f None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:14:49.181476 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8889ad63-8836-4d26-8389-0e0d4c55722e None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:14:49.215213 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64f3dcb-1c2f-460f-821f-c7686bbfd8b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:14:49.216011 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64f3dcb-1c2f-460f-821f-c7686bbfd8b5 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:49.216294 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64f3dcb-1c2f-460f-821f-c7686bbfd8b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:49.216568 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64f3dcb-1c2f-460f-821f-c7686bbfd8b5 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:49.222211 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:14:49.227525 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64f3dcb-1c2f-460f-821f-c7686bbfd8b5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 12:14:49.235689 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-a64f3dcb-1c2f-460f-821f-c7686bbfd8b5 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 16 12:14:49.235689 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 12:14:49.235689 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 12:14:49.235689 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 12:14:49.235689 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 12:14:49.235689 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 12:14:49.235689 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 12:14:49.235689 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 12:14:49.235689 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 12:14:49.235689 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 12:14:49.235689 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 12:14:49.235689 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 12:14:49.235689 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 12:14:49.235689 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 12:14:49.235689 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 12:14:49.235689 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 12:14:49.236650 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 12:14:49.236650 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 12:14:49.236650 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 12:14:49.236650 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 12:14:49.236650 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 12:14:49.236650 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 12:14:49.236650 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 12:14:49.236650 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 12:14:49.236650 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 12:14:49.236650 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 12:14:49.236650 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 12:14:49.236650 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jun 16 12:14:49.236650 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 12:14:49.236650 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jun 16 12:14:49.236650 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 12:14:49.236650 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 12:14:49.237539 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 12:14:49.237539 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jun 16 12:14:49.237539 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 12:14:49.237539 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jun 16 12:14:49.237539 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 12:14:49.237539 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 12:14:49.237539 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 12:14:49.237539 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 12:14:49.237539 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 12:14:49.237539 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 12:14:49.237539 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 16 12:14:49.237539 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jun 16 12:14:49.237539 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 547/1082] 10.222.0.44 () {56 vars in 1120 bytes} [Thu Jun 16 12:14:49 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 12:14:49.242727 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64f3dcb-1c2f-460f-821f-c7686bbfd8b5 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:14:49.266324 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9fb1bc-0b0f-45aa-9fad-8df361199a9f None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:14:49.300389 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283037bc-19f6-4c7f-b3b9-a782e3ed85f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:14:49.301261 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283037bc-19f6-4c7f-b3b9-a782e3ed85f2 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:49.301538 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283037bc-19f6-4c7f-b3b9-a782e3ed85f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:49.301806 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283037bc-19f6-4c7f-b3b9-a782e3ed85f2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:49.311613 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283037bc-19f6-4c7f-b3b9-a782e3ed85f2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 12:14:49.319670 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application [None req-283037bc-19f6-4c7f-b3b9-a782e3ed85f2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 12:14:49.319670 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 12:14:49.319670 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 12:14:49.319670 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 12:14:49.319670 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 12:14:49.319670 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 12:14:49.319670 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 12:14:49.319670 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 12:14:49.319670 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 12:14:49.319670 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 12:14:49.319670 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 12:14:49.319670 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 12:14:49.319670 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 12:14:49.319670 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 12:14:49.319670 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 12:14:49.319670 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 12:14:49.320853 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 12:14:49.320853 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 12:14:49.320853 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 12:14:49.320853 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 12:14:49.320853 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 12:14:49.320853 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 12:14:49.320853 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 12:14:49.320853 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 12:14:49.320853 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 12:14:49.320853 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 12:14:49.320853 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 12:14:49.320853 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application with Lock( Jun 16 12:14:49.320853 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 12:14:49.320853 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._enter() Jun 16 12:14:49.320853 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 12:14:49.320853 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 12:14:49.321895 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 12:14:49.321895 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.creator() Jun 16 12:14:49.321895 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 12:14:49.321895 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application created_value = creator( Jun 16 12:14:49.321895 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 12:14:49.321895 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 12:14:49.321895 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 12:14:49.321895 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 12:14:49.321895 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 12:14:49.321895 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 12:14:49.321895 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 12:14:49.321895 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application Jun 16 12:14:49.321895 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 536/1083] 10.222.0.44 () {56 vars in 1096 bytes} [Thu Jun 16 12:14:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 12:14:49.326850 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283037bc-19f6-4c7f-b3b9-a782e3ed85f2 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:14:49.338989 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:14:49.345190 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64f3dcb-1c2f-460f-821f-c7686bbfd8b5 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:14:49.377513 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c30ce91-7e21-4e86-a181-7607f112fb6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:14:49.378169 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c30ce91-7e21-4e86-a181-7607f112fb6c None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:49.378444 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c30ce91-7e21-4e86-a181-7607f112fb6c None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:49.378714 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c30ce91-7e21-4e86-a181-7607f112fb6c None admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:49.379454 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c30ce91-7e21-4e86-a181-7607f112fb6c None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:14:49.379755 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c30ce91-7e21-4e86-a181-7607f112fb6c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:14:49.381148 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c30ce91-7e21-4e86-a181-7607f112fb6c None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:14:49.388840 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 548/1084] 10.222.0.44 () {56 vars in 1115 bytes} [Thu Jun 16 12:14:49 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 12:14:49.395700 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c30ce91-7e21-4e86-a181-7607f112fb6c None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:14:49.423581 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283037bc-19f6-4c7f-b3b9-a782e3ed85f2 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:14:49.439401 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:14:49.457827 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab94f7af-53db-444f-b5c9-99718593f8ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:14:49.458478 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab94f7af-53db-444f-b5c9-99718593f8ab None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:49.458759 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab94f7af-53db-444f-b5c9-99718593f8ab None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:49.459030 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab94f7af-53db-444f-b5c9-99718593f8ab None admin] PATH_INFO: `/v3/roles` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:49.459760 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab94f7af-53db-444f-b5c9-99718593f8ab None admin] RBAC: Adding query filter params (name=admin) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:14:49.460061 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab94f7af-53db-444f-b5c9-99718593f8ab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:14:49.461502 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab94f7af-53db-444f-b5c9-99718593f8ab None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:14:49.469341 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 537/1085] 10.222.0.44 () {56 vars in 1099 bytes} [Thu Jun 16 12:14:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 12:14:49.474907 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab94f7af-53db-444f-b5c9-99718593f8ab None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:14:49.493964 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c30ce91-7e21-4e86-a181-7607f112fb6c None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:14:49.527230 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87e911d-e97f-41a2-a398-3c82897f2011 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:14:49.528006 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87e911d-e97f-41a2-a398-3c82897f2011 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:49.528281 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87e911d-e97f-41a2-a398-3c82897f2011 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:49.528544 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87e911d-e97f-41a2-a398-3c82897f2011 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:49.538641 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87e911d-e97f-41a2-a398-3c82897f2011 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:14:49.540065 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87e911d-e97f-41a2-a398-3c82897f2011 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:14:49.556860 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-e87e911d-e97f-41a2-a398-3c82897f2011 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 12:14:49.556860 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 12:14:49.556860 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 12:14:49.556860 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 12:14:49.556860 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 12:14:49.556860 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 12:14:49.556860 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 12:14:49.556860 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 12:14:49.556860 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 12:14:49.556860 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 12:14:49.556860 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 12:14:49.556860 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 12:14:49.556860 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 12:14:49.556860 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 12:14:49.556860 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 12:14:49.557909 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 12:14:49.557909 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 12:14:49.557909 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 12:14:49.557909 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 12:14:49.557909 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 12:14:49.557909 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 12:14:49.557909 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 12:14:49.557909 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 12:14:49.557909 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jun 16 12:14:49.557909 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 12:14:49.557909 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jun 16 12:14:49.557909 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 12:14:49.557909 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 12:14:49.557909 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 12:14:49.557909 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jun 16 12:14:49.557909 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 12:14:49.557909 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jun 16 12:14:49.559153 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 12:14:49.559153 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 12:14:49.559153 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 12:14:49.559153 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jun 16 12:14:49.559153 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 549/1086] 10.222.0.44 () {56 vars in 1108 bytes} [Thu Jun 16 12:14:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 12:14:49.563534 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87e911d-e97f-41a2-a398-3c82897f2011 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:14:49.572480 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab94f7af-53db-444f-b5c9-99718593f8ab None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:14:49.575829 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:14:49.606151 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73de1387-5716-471a-b2fc-bbbfa82c8a33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:14:49.607002 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73de1387-5716-471a-b2fc-bbbfa82c8a33 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:49.607278 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73de1387-5716-471a-b2fc-bbbfa82c8a33 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:49.607548 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73de1387-5716-471a-b2fc-bbbfa82c8a33 None admin] PATH_INFO: `/v3/users/77a12bc090a54c0b8c919fe325e904d2` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:49.608725 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73de1387-5716-471a-b2fc-bbbfa82c8a33 None admin] RBAC: Authorizing `identity:get_user(user_id=77a12bc090a54c0b8c919fe325e904d2)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:14:49.610163 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73de1387-5716-471a-b2fc-bbbfa82c8a33 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:14:49.612300 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 538/1087] 10.222.0.44 () {56 vars in 1177 bytes} [Thu Jun 16 12:14:49 2022] GET /identity/v3/users/77a12bc090a54c0b8c919fe325e904d2 => generated 285 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 12:14:49.617850 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73de1387-5716-471a-b2fc-bbbfa82c8a33 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:14:49.662538 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:14:49.663298 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87e911d-e97f-41a2-a398-3c82897f2011 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:14:49.696476 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7cc89e-8bfc-4135-8932-859f55506d73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:14:49.697084 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7cc89e-8bfc-4135-8932-859f55506d73 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:49.697366 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7cc89e-8bfc-4135-8932-859f55506d73 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:49.697638 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7cc89e-8bfc-4135-8932-859f55506d73 None admin] PATH_INFO: `/v3/domains` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:49.698351 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7cc89e-8bfc-4135-8932-859f55506d73 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:14:49.698711 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7cc89e-8bfc-4135-8932-859f55506d73 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:14:49.700017 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7cc89e-8bfc-4135-8932-859f55506d73 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:14:49.711472 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 550/1088] 10.222.0.44 () {56 vars in 1109 bytes} [Thu Jun 16 12:14:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 12:14:49.716924 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7cc89e-8bfc-4135-8932-859f55506d73 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:14:49.719986 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73de1387-5716-471a-b2fc-bbbfa82c8a33 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:14:49.753673 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441ca234-2606-4e55-a0d9-fdfe332121a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:14:49.754512 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441ca234-2606-4e55-a0d9-fdfe332121a5 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:49.754786 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441ca234-2606-4e55-a0d9-fdfe332121a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:49.755053 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441ca234-2606-4e55-a0d9-fdfe332121a5 None admin] PATH_INFO: `/v3/projects/44d10c7982f5414a8cc8f4b90ce35ba2` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:49.756206 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441ca234-2606-4e55-a0d9-fdfe332121a5 None admin] RBAC: Authorizing `identity:get_project(project_id=44d10c7982f5414a8cc8f4b90ce35ba2)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:14:49.757659 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441ca234-2606-4e55-a0d9-fdfe332121a5 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:14:49.759323 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 539/1089] 10.222.0.44 () {56 vars in 1186 bytes} [Thu Jun 16 12:14:49 2022] GET /identity/v3/projects/44d10c7982f5414a8cc8f4b90ce35ba2 => generated 311 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 12:14:49.765061 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441ca234-2606-4e55-a0d9-fdfe332121a5 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:14:49.783711 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:14:49.815488 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7cc89e-8bfc-4135-8932-859f55506d73 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:14:49.848150 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbe1bba-40d5-456b-b3ec-e2ca470cb00e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:14:49.849106 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbe1bba-40d5-456b-b3ec-e2ca470cb00e None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:49.849389 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbe1bba-40d5-456b-b3ec-e2ca470cb00e None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:49.849664 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbe1bba-40d5-456b-b3ec-e2ca470cb00e None admin] PATH_INFO: `/v3/users/nova` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:49.856897 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbe1bba-40d5-456b-b3ec-e2ca470cb00e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:14:49.858339 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbe1bba-40d5-456b-b3ec-e2ca470cb00e None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:14:49.861770 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441ca234-2606-4e55-a0d9-fdfe332121a5 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:14:49.873063 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-afbe1bba-40d5-456b-b3ec-e2ca470cb00e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 16 12:14:49.873063 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 12:14:49.873063 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 12:14:49.873063 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 12:14:49.873063 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 12:14:49.873063 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 12:14:49.873063 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 12:14:49.873063 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 12:14:49.873063 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 12:14:49.873063 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 12:14:49.873063 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 12:14:49.873063 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 12:14:49.873063 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 12:14:49.873063 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 12:14:49.873063 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 12:14:49.873063 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 12:14:49.874149 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 12:14:49.874149 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 12:14:49.874149 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 12:14:49.874149 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 12:14:49.874149 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 12:14:49.874149 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 12:14:49.874149 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 12:14:49.874149 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 12:14:49.874149 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 12:14:49.874149 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 12:14:49.874149 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 12:14:49.874149 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jun 16 12:14:49.874149 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 12:14:49.874149 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jun 16 12:14:49.874149 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 12:14:49.874149 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 12:14:49.874149 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 12:14:49.874149 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jun 16 12:14:49.875316 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 12:14:49.875316 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jun 16 12:14:49.875316 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 12:14:49.875316 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 12:14:49.875316 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 12:14:49.875316 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 12:14:49.875316 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 12:14:49.875316 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 12:14:49.875316 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 16 12:14:49.875316 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jun 16 12:14:49.875316 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 551/1090] 10.222.0.44 () {56 vars in 1093 bytes} [Thu Jun 16 12:14:49 2022] GET /identity/v3/users/nova => generated 82 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 12:14:49.877538 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:14:49.880528 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbe1bba-40d5-456b-b3ec-e2ca470cb00e None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:14:49.897720 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4039053-f7b5-4d03-95cc-e5943381cf92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:14:49.898599 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4039053-f7b5-4d03-95cc-e5943381cf92 None admin] REQUEST_METHOD: `PUT` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:49.898882 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4039053-f7b5-4d03-95cc-e5943381cf92 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:49.899154 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4039053-f7b5-4d03-95cc-e5943381cf92 None admin] PATH_INFO: `/v3/projects/44d10c7982f5414a8cc8f4b90ce35ba2/users/77a12bc090a54c0b8c919fe325e904d2/roles/0688968254744e3f9913653cafea3091` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:49.901140 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4039053-f7b5-4d03-95cc-e5943381cf92 None admin] RBAC: Authorizing `identity:create_grant(project_id=44d10c7982f5414a8cc8f4b90ce35ba2, user_id=77a12bc090a54c0b8c919fe325e904d2, role_id=0688968254744e3f9913653cafea3091)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:14:49.902556 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4039053-f7b5-4d03-95cc-e5943381cf92 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:14:49.914773 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 540/1091] 10.222.0.44 () {58 vars in 1439 bytes} [Thu Jun 16 12:14:49 2022] PUT /identity/v3/projects/44d10c7982f5414a8cc8f4b90ce35ba2/users/77a12bc090a54c0b8c919fe325e904d2/roles/0688968254744e3f9913653cafea3091 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:14:49.983511 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbe1bba-40d5-456b-b3ec-e2ca470cb00e None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:14:50.014525 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:14:50.020979 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e15e4b5-534d-4f25-8ab1-0dac72e96736 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:14:50.021663 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e15e4b5-534d-4f25-8ab1-0dac72e96736 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:50.021942 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e15e4b5-534d-4f25-8ab1-0dac72e96736 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:50.022211 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e15e4b5-534d-4f25-8ab1-0dac72e96736 None admin] PATH_INFO: `/v3/users` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:50.023060 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e15e4b5-534d-4f25-8ab1-0dac72e96736 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:14:50.023365 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e15e4b5-534d-4f25-8ab1-0dac72e96736 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:14:50.024872 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e15e4b5-534d-4f25-8ab1-0dac72e96736 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:14:50.044281 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 552/1092] 10.222.0.44 () {56 vars in 1133 bytes} [Thu Jun 16 12:14:49 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:14:50.050984 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4039053-f7b5-4d03-95cc-e5943381cf92 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:14:50.150860 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4039053-f7b5-4d03-95cc-e5943381cf92 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:14:50.184083 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60af4b54-0ea6-4c5b-85c1-9391765a077e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:14:50.184727 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60af4b54-0ea6-4c5b-85c1-9391765a077e None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:50.185044 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60af4b54-0ea6-4c5b-85c1-9391765a077e None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:50.185312 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60af4b54-0ea6-4c5b-85c1-9391765a077e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:50.225999 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:14:50.251588 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60af4b54-0ea6-4c5b-85c1-9391765a077e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:14:50.252997 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60af4b54-0ea6-4c5b-85c1-9391765a077e None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:14:50.348149 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 541/1093] 10.222.0.44 () {58 vars in 1282 bytes} [Thu Jun 16 12:14:50 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 16 12:14:50.353832 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e15e4b5-534d-4f25-8ab1-0dac72e96736 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:14:50.449230 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e15e4b5-534d-4f25-8ab1-0dac72e96736 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:14:50.482175 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a6537d-a206-4472-a147-aa88ab571a01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:14:50.482954 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a6537d-a206-4472-a147-aa88ab571a01 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:50.483232 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a6537d-a206-4472-a147-aa88ab571a01 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:50.483504 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a6537d-a206-4472-a147-aa88ab571a01 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:50.493138 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a6537d-a206-4472-a147-aa88ab571a01 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:14:50.494569 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a6537d-a206-4472-a147-aa88ab571a01 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:14:50.511436 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-89a6537d-a206-4472-a147-aa88ab571a01 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 12:14:50.511436 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 12:14:50.511436 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 12:14:50.511436 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 12:14:50.511436 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 12:14:50.511436 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 12:14:50.511436 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 12:14:50.511436 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 12:14:50.511436 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 12:14:50.511436 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 12:14:50.511436 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 12:14:50.511436 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 12:14:50.511436 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 12:14:50.511436 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 12:14:50.511436 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 12:14:50.512465 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 12:14:50.512465 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 12:14:50.512465 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 12:14:50.512465 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 12:14:50.512465 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 12:14:50.512465 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 12:14:50.512465 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 12:14:50.512465 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 12:14:50.512465 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jun 16 12:14:50.512465 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 12:14:50.512465 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jun 16 12:14:50.512465 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 12:14:50.512465 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 12:14:50.512465 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 12:14:50.512465 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jun 16 12:14:50.512465 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 12:14:50.512465 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jun 16 12:14:50.513660 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 12:14:50.513660 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 12:14:50.513660 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 12:14:50.513660 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jun 16 12:14:50.513660 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 553/1094] 10.222.0.44 () {56 vars in 1108 bytes} [Thu Jun 16 12:14:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 12:14:50.518953 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60af4b54-0ea6-4c5b-85c1-9391765a077e None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:14:50.595974 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:14:50.620733 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60af4b54-0ea6-4c5b-85c1-9391765a077e None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:14:50.653103 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200630b1-f3eb-40eb-ad4a-0b14d9b742de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:14:50.653753 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200630b1-f3eb-40eb-ad4a-0b14d9b742de None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:50.654030 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200630b1-f3eb-40eb-ad4a-0b14d9b742de None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:50.654306 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200630b1-f3eb-40eb-ad4a-0b14d9b742de None admin] PATH_INFO: `/v3/domains` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:50.655018 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200630b1-f3eb-40eb-ad4a-0b14d9b742de None admin] RBAC: Adding query filter params (name=Default) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:14:50.655324 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200630b1-f3eb-40eb-ad4a-0b14d9b742de None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:14:50.656669 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200630b1-f3eb-40eb-ad4a-0b14d9b742de None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:14:50.668972 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 542/1095] 10.222.0.44 () {56 vars in 1109 bytes} [Thu Jun 16 12:14:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:14:50.674674 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a6537d-a206-4472-a147-aa88ab571a01 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:14:50.715116 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:14:50.771230 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a6537d-a206-4472-a147-aa88ab571a01 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:14:50.803254 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2be5486-a23b-484e-9033-78b441ff5bd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:14:50.804031 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2be5486-a23b-484e-9033-78b441ff5bd3 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:50.804311 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2be5486-a23b-484e-9033-78b441ff5bd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:50.804582 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2be5486-a23b-484e-9033-78b441ff5bd3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:50.811071 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2be5486-a23b-484e-9033-78b441ff5bd3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:14:50.812504 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2be5486-a23b-484e-9033-78b441ff5bd3 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:14:50.826466 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-c2be5486-a23b-484e-9033-78b441ff5bd3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 12:14:50.826466 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 12:14:50.826466 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 12:14:50.826466 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 12:14:50.826466 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 12:14:50.826466 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 12:14:50.826466 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 12:14:50.826466 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 12:14:50.826466 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 12:14:50.826466 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 12:14:50.826466 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 12:14:50.826466 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 12:14:50.826466 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 12:14:50.826466 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 12:14:50.826466 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 12:14:50.827496 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 12:14:50.827496 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 12:14:50.827496 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 12:14:50.827496 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 12:14:50.827496 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 12:14:50.827496 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 12:14:50.827496 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 12:14:50.827496 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 12:14:50.827496 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jun 16 12:14:50.827496 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 12:14:50.827496 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jun 16 12:14:50.827496 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 12:14:50.827496 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 12:14:50.827496 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 12:14:50.827496 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jun 16 12:14:50.827496 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 12:14:50.827496 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jun 16 12:14:50.828402 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 12:14:50.828402 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 12:14:50.828402 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 12:14:50.828402 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 12:14:50.828402 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 12:14:50.828402 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 12:14:50.828402 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 12:14:50.828402 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jun 16 12:14:50.828402 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 554/1096] 10.222.0.44 () {56 vars in 1111 bytes} [Thu Jun 16 12:14:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 12:14:50.833938 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200630b1-f3eb-40eb-ad4a-0b14d9b742de None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:14:50.933335 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200630b1-f3eb-40eb-ad4a-0b14d9b742de None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:14:50.968681 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad68b3d-50cf-4055-9c52-13792551a44d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:14:50.969355 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad68b3d-50cf-4055-9c52-13792551a44d None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:50.969637 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad68b3d-50cf-4055-9c52-13792551a44d None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:50.969939 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad68b3d-50cf-4055-9c52-13792551a44d None admin] PATH_INFO: `/v3/projects` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:50.970721 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad68b3d-50cf-4055-9c52-13792551a44d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:14:50.971028 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad68b3d-50cf-4055-9c52-13792551a44d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:14:50.972452 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad68b3d-50cf-4055-9c52-13792551a44d None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:14:50.974386 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:14:50.985855 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 543/1097] 10.222.0.44 () {56 vars in 1148 bytes} [Thu Jun 16 12:14:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:14:50.991928 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2be5486-a23b-484e-9033-78b441ff5bd3 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:14:51.087329 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:14:51.090405 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2be5486-a23b-484e-9033-78b441ff5bd3 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:14:51.123632 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8497575d-e788-442a-9d85-48ddae80f19a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:14:51.124277 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8497575d-e788-442a-9d85-48ddae80f19a None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:51.124556 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8497575d-e788-442a-9d85-48ddae80f19a None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:51.124862 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8497575d-e788-442a-9d85-48ddae80f19a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:51.125690 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8497575d-e788-442a-9d85-48ddae80f19a None admin] RBAC: Adding query filter params (role.id=6b361854fbed4b698a92f8199670a956, scope.project.id=601361df39e34fcca71175aa94e425c4, user.id=edfb12d445e74136b90800e93941f468) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:14:51.126081 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8497575d-e788-442a-9d85-48ddae80f19a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:14:51.127544 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8497575d-e788-442a-9d85-48ddae80f19a None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:14:51.133288 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 555/1098] 10.222.0.44 () {56 vars in 1374 bytes} [Thu Jun 16 12:14:50 2022] GET /identity/v3/role_assignments?user.id=edfb12d445e74136b90800e93941f468&scope.project.id=601361df39e34fcca71175aa94e425c4&role.id=6b361854fbed4b698a92f8199670a956 => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:14:52.021005 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d5e7f9-b763-4230-a12f-9f9e90149663 None None] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:52.021520 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d5e7f9-b763-4230-a12f-9f9e90149663 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:52.021626 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d5e7f9-b763-4230-a12f-9f9e90149663 None None] PATH_INFO: `/` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:52.022925 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 544/1099] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 12:14:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 12:14:52.028050 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a01f0bf-0848-451b-89ca-bc09e185990a None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:52.028424 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a01f0bf-0848-451b-89ca-bc09e185990a None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:52.028600 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a01f0bf-0848-451b-89ca-bc09e185990a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:52.045239 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-7a01f0bf-0848-451b-89ca-bc09e185990a None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:14:52.046416 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-7a01f0bf-0848-451b-89ca-bc09e185990a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:14:52.110977 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 556/1100] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 12:14:52 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 12:14:52.134499 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d5e7f9-b763-4230-a12f-9f9e90149663 None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:14:52.236479 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d5e7f9-b763-4230-a12f-9f9e90149663 None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:14:52.268529 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a38b769-f210-420a-9bb4-b024e4ed58a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:14:52.269345 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a38b769-f210-420a-9bb4-b024e4ed58a7 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:52.269630 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a38b769-f210-420a-9bb4-b024e4ed58a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:52.269906 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a38b769-f210-420a-9bb4-b024e4ed58a7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:52.279714 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a38b769-f210-420a-9bb4-b024e4ed58a7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 12:14:52.287928 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application [None req-2a38b769-f210-420a-9bb4-b024e4ed58a7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 12:14:52.287928 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 12:14:52.287928 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 12:14:52.287928 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 12:14:52.287928 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 12:14:52.287928 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 12:14:52.287928 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 12:14:52.287928 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 12:14:52.287928 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 12:14:52.287928 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 12:14:52.287928 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 12:14:52.287928 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 12:14:52.287928 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 12:14:52.287928 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 12:14:52.287928 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 12:14:52.287928 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 12:14:52.289119 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 12:14:52.289119 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 12:14:52.289119 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 12:14:52.289119 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 12:14:52.289119 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 12:14:52.289119 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 12:14:52.289119 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 12:14:52.289119 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 12:14:52.289119 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 12:14:52.289119 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 12:14:52.289119 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 12:14:52.289119 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application with Lock( Jun 16 12:14:52.289119 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 12:14:52.289119 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._enter() Jun 16 12:14:52.289119 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 12:14:52.289119 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 12:14:52.290064 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 12:14:52.290064 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.creator() Jun 16 12:14:52.290064 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 12:14:52.290064 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application created_value = creator( Jun 16 12:14:52.290064 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 12:14:52.290064 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 12:14:52.290064 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 12:14:52.290064 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 12:14:52.290064 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 12:14:52.290064 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 12:14:52.290064 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 12:14:52.290064 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application Jun 16 12:14:52.290064 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 545/1101] 10.222.0.44 () {56 vars in 1096 bytes} [Thu Jun 16 12:14:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 12:14:52.295421 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a01f0bf-0848-451b-89ca-bc09e185990a None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:14:52.384059 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:14:52.390533 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a01f0bf-0848-451b-89ca-bc09e185990a None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:14:52.424388 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c0a763-b268-4e21-91a7-79a0afd07a5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:14:52.425063 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c0a763-b268-4e21-91a7-79a0afd07a5c None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:52.425344 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c0a763-b268-4e21-91a7-79a0afd07a5c None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:52.425615 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c0a763-b268-4e21-91a7-79a0afd07a5c None admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:52.426351 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c0a763-b268-4e21-91a7-79a0afd07a5c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:14:52.426652 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c0a763-b268-4e21-91a7-79a0afd07a5c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:14:52.428008 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c0a763-b268-4e21-91a7-79a0afd07a5c None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:14:52.435735 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 557/1102] 10.222.0.44 () {56 vars in 1099 bytes} [Thu Jun 16 12:14:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:14:52.441349 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a38b769-f210-420a-9bb4-b024e4ed58a7 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:14:52.495450 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:14:52.538626 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a38b769-f210-420a-9bb4-b024e4ed58a7 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:14:52.571196 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2481588-cd18-4606-b849-fe3a0c926dd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:14:52.572050 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2481588-cd18-4606-b849-fe3a0c926dd2 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:52.572329 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2481588-cd18-4606-b849-fe3a0c926dd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:52.572599 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2481588-cd18-4606-b849-fe3a0c926dd2 None admin] PATH_INFO: `/v3/users/77a12bc090a54c0b8c919fe325e904d2` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:52.573805 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2481588-cd18-4606-b849-fe3a0c926dd2 None admin] RBAC: Authorizing `identity:get_user(user_id=77a12bc090a54c0b8c919fe325e904d2)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:14:52.575236 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2481588-cd18-4606-b849-fe3a0c926dd2 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:14:52.576851 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 546/1103] 10.222.0.44 () {56 vars in 1177 bytes} [Thu Jun 16 12:14:52 2022] GET /identity/v3/users/77a12bc090a54c0b8c919fe325e904d2 => generated 285 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:14:52.582412 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c0a763-b268-4e21-91a7-79a0afd07a5c None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:14:52.679029 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c0a763-b268-4e21-91a7-79a0afd07a5c None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:14:52.711448 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05e0696-f7c8-45fd-a14d-cac3974ba2a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:14:52.712081 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05e0696-f7c8-45fd-a14d-cac3974ba2a4 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:52.712360 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05e0696-f7c8-45fd-a14d-cac3974ba2a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:52.712634 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05e0696-f7c8-45fd-a14d-cac3974ba2a4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:52.736459 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:14:52.777124 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05e0696-f7c8-45fd-a14d-cac3974ba2a4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:14:52.778498 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05e0696-f7c8-45fd-a14d-cac3974ba2a4 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:14:52.871692 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 558/1104] 10.222.0.44 () {58 vars in 1282 bytes} [Thu Jun 16 12:14:52 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 16 12:14:52.877536 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2481588-cd18-4606-b849-fe3a0c926dd2 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:14:52.976491 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2481588-cd18-4606-b849-fe3a0c926dd2 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:14:52.997415 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:14:53.009417 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc0f8ed-3b3e-4ce4-a74f-fcb0120886be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:14:53.010257 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc0f8ed-3b3e-4ce4-a74f-fcb0120886be None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:53.010535 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc0f8ed-3b3e-4ce4-a74f-fcb0120886be None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:53.010806 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc0f8ed-3b3e-4ce4-a74f-fcb0120886be None admin] PATH_INFO: `/v3/projects/44d10c7982f5414a8cc8f4b90ce35ba2` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:53.011968 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc0f8ed-3b3e-4ce4-a74f-fcb0120886be None admin] RBAC: Authorizing `identity:get_project(project_id=44d10c7982f5414a8cc8f4b90ce35ba2)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:14:53.013435 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc0f8ed-3b3e-4ce4-a74f-fcb0120886be None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:14:53.015098 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 547/1105] 10.222.0.44 () {56 vars in 1186 bytes} [Thu Jun 16 12:14:52 2022] GET /identity/v3/projects/44d10c7982f5414a8cc8f4b90ce35ba2 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:14:53.021879 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05e0696-f7c8-45fd-a14d-cac3974ba2a4 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:14:53.075017 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:14:53.116705 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05e0696-f7c8-45fd-a14d-cac3974ba2a4 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:14:53.149989 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9d4942-3dd1-4da6-9e1d-4fd088f3771b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:14:53.150627 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9d4942-3dd1-4da6-9e1d-4fd088f3771b None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:53.150907 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9d4942-3dd1-4da6-9e1d-4fd088f3771b None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:53.151180 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9d4942-3dd1-4da6-9e1d-4fd088f3771b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:53.152005 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9d4942-3dd1-4da6-9e1d-4fd088f3771b None admin] RBAC: Adding query filter params (role.id=0688968254744e3f9913653cafea3091, scope.project.id=44d10c7982f5414a8cc8f4b90ce35ba2, user.id=77a12bc090a54c0b8c919fe325e904d2) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:14:53.152314 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9d4942-3dd1-4da6-9e1d-4fd088f3771b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:14:53.153764 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9d4942-3dd1-4da6-9e1d-4fd088f3771b None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:14:53.159412 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 559/1106] 10.222.0.44 () {56 vars in 1374 bytes} [Thu Jun 16 12:14:53 2022] GET /identity/v3/role_assignments?user.id=77a12bc090a54c0b8c919fe325e904d2&scope.project.id=44d10c7982f5414a8cc8f4b90ce35ba2&role.id=0688968254744e3f9913653cafea3091 => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:14:55.258600 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1d6bbf-81ca-41fe-8e6b-28539e934885 None None] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:55.259138 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1d6bbf-81ca-41fe-8e6b-28539e934885 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:55.259138 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1d6bbf-81ca-41fe-8e6b-28539e934885 None None] PATH_INFO: `/` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:55.260498 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 548/1107] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 12:14:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 12:14:55.265584 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfcbb09-0300-4894-8919-d43c5c5f732c None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:55.266021 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfcbb09-0300-4894-8919-d43c5c5f732c None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:55.266125 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfcbb09-0300-4894-8919-d43c5c5f732c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:55.282849 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-8dfcbb09-0300-4894-8919-d43c5c5f732c None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:14:55.284023 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-8dfcbb09-0300-4894-8919-d43c5c5f732c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:14:55.348698 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 560/1108] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 12:14:55 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 12:14:55.373166 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1d6bbf-81ca-41fe-8e6b-28539e934885 None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:14:55.470371 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1d6bbf-81ca-41fe-8e6b-28539e934885 None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:14:55.502618 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d690ee-8e55-4172-a665-12d2b4488cea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:14:55.503380 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d690ee-8e55-4172-a665-12d2b4488cea None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:55.503660 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d690ee-8e55-4172-a665-12d2b4488cea None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:55.503930 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d690ee-8e55-4172-a665-12d2b4488cea None admin] PATH_INFO: `/v3/domains/default` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:55.505099 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d690ee-8e55-4172-a665-12d2b4488cea None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:14:55.506510 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d690ee-8e55-4172-a665-12d2b4488cea None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:14:55.508069 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 549/1109] 10.222.0.44 () {56 vars in 1108 bytes} [Thu Jun 16 12:14:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:14:55.513640 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfcbb09-0300-4894-8919-d43c5c5f732c None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:14:55.561017 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:14:55.607865 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfcbb09-0300-4894-8919-d43c5c5f732c None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:14:55.640207 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a386bcb-e1c1-45fb-9f3d-c48bef4cf5b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:14:55.640883 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a386bcb-e1c1-45fb-9f3d-c48bef4cf5b6 None admin] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:55.641165 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a386bcb-e1c1-45fb-9f3d-c48bef4cf5b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:55.641945 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a386bcb-e1c1-45fb-9f3d-c48bef4cf5b6 None admin] PATH_INFO: `/v3/users` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:55.642647 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a386bcb-e1c1-45fb-9f3d-c48bef4cf5b6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:14:55.644062 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a386bcb-e1c1-45fb-9f3d-c48bef4cf5b6 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:14:55.663557 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 561/1110] 10.222.0.44 () {60 vars in 1132 bytes} [Thu Jun 16 12:14:55 2022] POST /identity/v3/users => generated 286 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 12:14:57.793038 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8943a5-4141-4cc7-8a81-3572e3ecd333 None None] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:57.793582 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8943a5-4141-4cc7-8a81-3572e3ecd333 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:57.793582 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8943a5-4141-4cc7-8a81-3572e3ecd333 None None] PATH_INFO: `/` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:57.794955 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 550/1111] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 12:14:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 12:14:57.800037 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cccc3f3-c435-42f8-8f11-16b202ba2e2a None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:57.800420 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cccc3f3-c435-42f8-8f11-16b202ba2e2a None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:57.800590 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cccc3f3-c435-42f8-8f11-16b202ba2e2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:57.818018 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-2cccc3f3-c435-42f8-8f11-16b202ba2e2a None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:14:57.819195 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-2cccc3f3-c435-42f8-8f11-16b202ba2e2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:14:57.883547 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 562/1112] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 12:14:57 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 12:14:57.906709 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8943a5-4141-4cc7-8a81-3572e3ecd333 None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:14:57.965617 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:14:58.007501 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8943a5-4141-4cc7-8a81-3572e3ecd333 None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:14:58.039424 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19df1829-372b-463c-9b87-17fc12699962 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:14:58.040266 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19df1829-372b-463c-9b87-17fc12699962 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:58.040542 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19df1829-372b-463c-9b87-17fc12699962 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:58.040841 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19df1829-372b-463c-9b87-17fc12699962 None admin] PATH_INFO: `/v3/roles/e24b3707bc514b1fa606efab092047e6` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:58.042561 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19df1829-372b-463c-9b87-17fc12699962 None admin] RBAC: Authorizing `identity:get_role(role_id=e24b3707bc514b1fa606efab092047e6)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:14:58.043961 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19df1829-372b-463c-9b87-17fc12699962 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:14:58.045298 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 551/1113] 10.222.0.44 () {56 vars in 1177 bytes} [Thu Jun 16 12:14:57 2022] GET /identity/v3/roles/e24b3707bc514b1fa606efab092047e6 => generated 223 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:14:58.051467 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cccc3f3-c435-42f8-8f11-16b202ba2e2a None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:14:58.084919 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:14:58.147328 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cccc3f3-c435-42f8-8f11-16b202ba2e2a None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:14:58.179759 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0828df1-efce-4a20-9ff4-028f19bfeb23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:14:58.180612 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0828df1-efce-4a20-9ff4-028f19bfeb23 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:58.180918 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0828df1-efce-4a20-9ff4-028f19bfeb23 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:58.181191 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0828df1-efce-4a20-9ff4-028f19bfeb23 None admin] PATH_INFO: `/v3/users/880b9c40e5f94a5fbedf2c9afe5c8e3a` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:58.194230 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0828df1-efce-4a20-9ff4-028f19bfeb23 None admin] RBAC: Authorizing `identity:get_user(user_id=880b9c40e5f94a5fbedf2c9afe5c8e3a)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:14:58.195660 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0828df1-efce-4a20-9ff4-028f19bfeb23 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:14:58.197319 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 563/1114] 10.222.0.44 () {56 vars in 1177 bytes} [Thu Jun 16 12:14:58 2022] GET /identity/v3/users/880b9c40e5f94a5fbedf2c9afe5c8e3a => generated 286 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:14:58.202828 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19df1829-372b-463c-9b87-17fc12699962 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:14:58.300019 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19df1829-372b-463c-9b87-17fc12699962 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:14:58.323969 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:14:58.332667 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506804ef-9536-4946-aa0c-baa1236ff730 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:14:58.333335 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506804ef-9536-4946-aa0c-baa1236ff730 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:58.333620 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506804ef-9536-4946-aa0c-baa1236ff730 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:58.333896 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506804ef-9536-4946-aa0c-baa1236ff730 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:58.398384 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506804ef-9536-4946-aa0c-baa1236ff730 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:14:58.399807 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506804ef-9536-4946-aa0c-baa1236ff730 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:14:58.494405 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 552/1115] 10.222.0.44 () {58 vars in 1282 bytes} [Thu Jun 16 12:14:58 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 16 12:14:58.500305 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0828df1-efce-4a20-9ff4-028f19bfeb23 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:14:58.589603 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:14:58.597112 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0828df1-efce-4a20-9ff4-028f19bfeb23 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:14:58.632254 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343c691e-1501-4d2b-8eb6-830faef5d613 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:14:58.633134 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343c691e-1501-4d2b-8eb6-830faef5d613 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:58.633415 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343c691e-1501-4d2b-8eb6-830faef5d613 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:58.633691 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343c691e-1501-4d2b-8eb6-830faef5d613 None admin] PATH_INFO: `/v3/projects/44d10c7982f5414a8cc8f4b90ce35ba2` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:58.634875 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343c691e-1501-4d2b-8eb6-830faef5d613 None admin] RBAC: Authorizing `identity:get_project(project_id=44d10c7982f5414a8cc8f4b90ce35ba2)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:14:58.636312 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343c691e-1501-4d2b-8eb6-830faef5d613 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:14:58.638034 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 564/1116] 10.222.0.44 () {56 vars in 1186 bytes} [Thu Jun 16 12:14:58 2022] GET /identity/v3/projects/44d10c7982f5414a8cc8f4b90ce35ba2 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:14:58.644776 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506804ef-9536-4946-aa0c-baa1236ff730 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:14:58.671120 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:14:58.741328 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506804ef-9536-4946-aa0c-baa1236ff730 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:14:58.773818 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd438ec-89db-4586-a5fe-467f38e8065d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:14:58.774453 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd438ec-89db-4586-a5fe-467f38e8065d None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:14:58.774735 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd438ec-89db-4586-a5fe-467f38e8065d None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:14:58.775011 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd438ec-89db-4586-a5fe-467f38e8065d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:14:58.775834 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd438ec-89db-4586-a5fe-467f38e8065d None admin] RBAC: Adding query filter params (role.id=e24b3707bc514b1fa606efab092047e6, scope.project.id=44d10c7982f5414a8cc8f4b90ce35ba2, user.id=880b9c40e5f94a5fbedf2c9afe5c8e3a) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:14:58.776145 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd438ec-89db-4586-a5fe-467f38e8065d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:14:58.777589 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd438ec-89db-4586-a5fe-467f38e8065d None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:14:58.783437 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 553/1117] 10.222.0.44 () {56 vars in 1374 bytes} [Thu Jun 16 12:14:58 2022] GET /identity/v3/role_assignments?user.id=880b9c40e5f94a5fbedf2c9afe5c8e3a&scope.project.id=44d10c7982f5414a8cc8f4b90ce35ba2&role.id=e24b3707bc514b1fa606efab092047e6 => generated 259 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:15:00.840110 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece6e3ce-5132-48e7-b74a-957f3bed9e14 None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:15:00.840670 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece6e3ce-5132-48e7-b74a-957f3bed9e14 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:15:00.840670 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece6e3ce-5132-48e7-b74a-957f3bed9e14 None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:15:00.842062 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 565/1118] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 12:15:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 12:15:00.847781 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77553319-d34d-4e87-9177-54036e4b9d4c None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:15:00.848159 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77553319-d34d-4e87-9177-54036e4b9d4c None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:15:00.848333 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77553319-d34d-4e87-9177-54036e4b9d4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:15:00.865189 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-77553319-d34d-4e87-9177-54036e4b9d4c None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:15:00.866361 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-77553319-d34d-4e87-9177-54036e4b9d4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:15:00.930948 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 554/1119] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 12:15:00 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 12:15:00.953922 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece6e3ce-5132-48e7-b74a-957f3bed9e14 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:15:01.052076 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece6e3ce-5132-48e7-b74a-957f3bed9e14 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:15:01.084501 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f1ba05-150b-42f0-9484-13141aae7d3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:15:01.085370 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f1ba05-150b-42f0-9484-13141aae7d3c None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:15:01.085651 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f1ba05-150b-42f0-9484-13141aae7d3c None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:15:01.085925 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f1ba05-150b-42f0-9484-13141aae7d3c None admin] PATH_INFO: `/v3/roles/e24b3707bc514b1fa606efab092047e6` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:15:01.087385 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f1ba05-150b-42f0-9484-13141aae7d3c None admin] RBAC: Authorizing `identity:get_role(role_id=e24b3707bc514b1fa606efab092047e6)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:15:01.088768 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f1ba05-150b-42f0-9484-13141aae7d3c None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:15:01.090171 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 566/1120] 10.222.0.44 () {56 vars in 1177 bytes} [Thu Jun 16 12:15:00 2022] GET /identity/v3/roles/e24b3707bc514b1fa606efab092047e6 => generated 223 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:15:01.096579 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77553319-d34d-4e87-9177-54036e4b9d4c None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:15:01.116995 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:15:01.191075 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77553319-d34d-4e87-9177-54036e4b9d4c None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:15:01.223937 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c369103-be6c-40cc-92a3-c163c7a8c6b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:15:01.224804 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c369103-be6c-40cc-92a3-c163c7a8c6b8 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:15:01.225083 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c369103-be6c-40cc-92a3-c163c7a8c6b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:15:01.225352 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c369103-be6c-40cc-92a3-c163c7a8c6b8 None admin] PATH_INFO: `/v3/users/880b9c40e5f94a5fbedf2c9afe5c8e3a` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:15:01.226521 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c369103-be6c-40cc-92a3-c163c7a8c6b8 None admin] RBAC: Authorizing `identity:get_user(user_id=880b9c40e5f94a5fbedf2c9afe5c8e3a)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:15:01.227950 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c369103-be6c-40cc-92a3-c163c7a8c6b8 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:15:01.229559 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 555/1121] 10.222.0.44 () {56 vars in 1177 bytes} [Thu Jun 16 12:15:01 2022] GET /identity/v3/users/880b9c40e5f94a5fbedf2c9afe5c8e3a => generated 286 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:15:01.235083 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f1ba05-150b-42f0-9484-13141aae7d3c None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:15:01.264744 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:15:01.332358 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f1ba05-150b-42f0-9484-13141aae7d3c None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:15:01.364558 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf82c7ab-87ee-4305-894c-924d3aa7fb4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:15:01.365362 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf82c7ab-87ee-4305-894c-924d3aa7fb4f None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:15:01.365644 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf82c7ab-87ee-4305-894c-924d3aa7fb4f None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:15:01.365920 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf82c7ab-87ee-4305-894c-924d3aa7fb4f None admin] PATH_INFO: `/v3/projects/44d10c7982f5414a8cc8f4b90ce35ba2` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:15:01.367089 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf82c7ab-87ee-4305-894c-924d3aa7fb4f None admin] RBAC: Authorizing `identity:get_project(project_id=44d10c7982f5414a8cc8f4b90ce35ba2)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:15:01.368516 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf82c7ab-87ee-4305-894c-924d3aa7fb4f None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:15:01.370203 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 567/1122] 10.222.0.44 () {56 vars in 1186 bytes} [Thu Jun 16 12:15:01 2022] GET /identity/v3/projects/44d10c7982f5414a8cc8f4b90ce35ba2 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:15:01.376546 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c369103-be6c-40cc-92a3-c163c7a8c6b8 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:15:01.461623 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:15:01.473894 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c369103-be6c-40cc-92a3-c163c7a8c6b8 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:15:01.506884 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ccedb2-a609-44c4-b901-53cca77a5414 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:15:01.507759 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ccedb2-a609-44c4-b901-53cca77a5414 None admin] REQUEST_METHOD: `PUT` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:15:01.508042 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ccedb2-a609-44c4-b901-53cca77a5414 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:15:01.508318 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ccedb2-a609-44c4-b901-53cca77a5414 None admin] PATH_INFO: `/v3/projects/44d10c7982f5414a8cc8f4b90ce35ba2/users/880b9c40e5f94a5fbedf2c9afe5c8e3a/roles/e24b3707bc514b1fa606efab092047e6` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:15:01.510515 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ccedb2-a609-44c4-b901-53cca77a5414 None admin] RBAC: Authorizing `identity:create_grant(project_id=44d10c7982f5414a8cc8f4b90ce35ba2, user_id=880b9c40e5f94a5fbedf2c9afe5c8e3a, role_id=e24b3707bc514b1fa606efab092047e6)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:15:01.511933 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ccedb2-a609-44c4-b901-53cca77a5414 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:15:01.524600 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 556/1123] 10.222.0.44 () {58 vars in 1439 bytes} [Thu Jun 16 12:15:01 2022] PUT /identity/v3/projects/44d10c7982f5414a8cc8f4b90ce35ba2/users/880b9c40e5f94a5fbedf2c9afe5c8e3a/roles/e24b3707bc514b1fa606efab092047e6 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:15:03.595838 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e71b0f-aa75-4e39-8d94-34e6b38b5485 None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:15:03.596393 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e71b0f-aa75-4e39-8d94-34e6b38b5485 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:15:03.596393 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e71b0f-aa75-4e39-8d94-34e6b38b5485 None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:15:03.597798 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 568/1124] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 12:15:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 12:15:03.602859 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b53068-43dc-4516-96cc-361722d936e1 None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:15:03.603223 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b53068-43dc-4516-96cc-361722d936e1 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:15:03.603409 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b53068-43dc-4516-96cc-361722d936e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:15:03.620264 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-21b53068-43dc-4516-96cc-361722d936e1 None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:15:03.621475 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-21b53068-43dc-4516-96cc-361722d936e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:15:03.685627 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 557/1125] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 12:15:03 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 12:15:03.709238 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e71b0f-aa75-4e39-8d94-34e6b38b5485 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:15:03.803037 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:15:03.807951 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e71b0f-aa75-4e39-8d94-34e6b38b5485 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:15:03.842838 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad108316-5606-446e-97dd-8a6e202f976f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:15:03.843678 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad108316-5606-446e-97dd-8a6e202f976f None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:15:03.844444 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad108316-5606-446e-97dd-8a6e202f976f None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:15:03.844713 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad108316-5606-446e-97dd-8a6e202f976f None admin] PATH_INFO: `/v3/roles/e24b3707bc514b1fa606efab092047e6` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:15:03.846250 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad108316-5606-446e-97dd-8a6e202f976f None admin] RBAC: Authorizing `identity:get_role(role_id=e24b3707bc514b1fa606efab092047e6)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:15:03.847553 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad108316-5606-446e-97dd-8a6e202f976f None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:15:03.848925 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 569/1126] 10.222.0.44 () {56 vars in 1177 bytes} [Thu Jun 16 12:15:03 2022] GET /identity/v3/roles/e24b3707bc514b1fa606efab092047e6 => generated 223 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:15:03.854581 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b53068-43dc-4516-96cc-361722d936e1 None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:15:03.930288 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:15:03.952530 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b53068-43dc-4516-96cc-361722d936e1 None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:15:03.986210 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3c63c0-41c1-4fbf-afcc-d403fd99cfaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:15:03.987071 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3c63c0-41c1-4fbf-afcc-d403fd99cfaf None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:15:03.987347 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3c63c0-41c1-4fbf-afcc-d403fd99cfaf None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:15:03.987615 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3c63c0-41c1-4fbf-afcc-d403fd99cfaf None admin] PATH_INFO: `/v3/users/880b9c40e5f94a5fbedf2c9afe5c8e3a` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:15:03.988821 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3c63c0-41c1-4fbf-afcc-d403fd99cfaf None admin] RBAC: Authorizing `identity:get_user(user_id=880b9c40e5f94a5fbedf2c9afe5c8e3a)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:15:03.990269 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3c63c0-41c1-4fbf-afcc-d403fd99cfaf None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:15:03.991873 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 558/1127] 10.222.0.44 () {56 vars in 1177 bytes} [Thu Jun 16 12:15:03 2022] GET /identity/v3/users/880b9c40e5f94a5fbedf2c9afe5c8e3a => generated 286 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:15:03.997525 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad108316-5606-446e-97dd-8a6e202f976f None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:15:04.092770 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad108316-5606-446e-97dd-8a6e202f976f None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:15:04.125326 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06383fd0-7d7b-443e-aeb0-72cb9ebf7f41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:15:04.125930 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06383fd0-7d7b-443e-aeb0-72cb9ebf7f41 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:15:04.126210 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06383fd0-7d7b-443e-aeb0-72cb9ebf7f41 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:15:04.126484 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06383fd0-7d7b-443e-aeb0-72cb9ebf7f41 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:15:04.158884 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:15:04.191778 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06383fd0-7d7b-443e-aeb0-72cb9ebf7f41 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:15:04.193255 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06383fd0-7d7b-443e-aeb0-72cb9ebf7f41 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:15:04.286753 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 570/1128] 10.222.0.44 () {58 vars in 1282 bytes} [Thu Jun 16 12:15:03 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 16 12:15:04.292849 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3c63c0-41c1-4fbf-afcc-d403fd99cfaf None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:15:04.388982 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3c63c0-41c1-4fbf-afcc-d403fd99cfaf None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:15:04.421611 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85fca83-f9e2-4881-93a7-fc9487dbb31a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:15:04.422453 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85fca83-f9e2-4881-93a7-fc9487dbb31a None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:15:04.422730 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85fca83-f9e2-4881-93a7-fc9487dbb31a None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:15:04.422997 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85fca83-f9e2-4881-93a7-fc9487dbb31a None admin] PATH_INFO: `/v3/projects/44d10c7982f5414a8cc8f4b90ce35ba2` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:15:04.424171 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85fca83-f9e2-4881-93a7-fc9487dbb31a None admin] RBAC: Authorizing `identity:get_project(project_id=44d10c7982f5414a8cc8f4b90ce35ba2)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:15:04.425618 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85fca83-f9e2-4881-93a7-fc9487dbb31a None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:15:04.427265 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 559/1129] 10.222.0.44 () {56 vars in 1186 bytes} [Thu Jun 16 12:15:04 2022] GET /identity/v3/projects/44d10c7982f5414a8cc8f4b90ce35ba2 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:15:04.433067 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06383fd0-7d7b-443e-aeb0-72cb9ebf7f41 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:15:04.494745 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:15:04.528252 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06383fd0-7d7b-443e-aeb0-72cb9ebf7f41 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:15:04.560238 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bdcde5-acae-47e3-87f5-ed0753ee75da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:15:04.560897 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bdcde5-acae-47e3-87f5-ed0753ee75da None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:15:04.561178 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bdcde5-acae-47e3-87f5-ed0753ee75da None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:15:04.561452 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bdcde5-acae-47e3-87f5-ed0753ee75da None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:15:04.562273 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bdcde5-acae-47e3-87f5-ed0753ee75da None admin] RBAC: Adding query filter params (role.id=e24b3707bc514b1fa606efab092047e6, scope.project.id=44d10c7982f5414a8cc8f4b90ce35ba2, user.id=880b9c40e5f94a5fbedf2c9afe5c8e3a) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:15:04.563108 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bdcde5-acae-47e3-87f5-ed0753ee75da None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:15:04.564517 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bdcde5-acae-47e3-87f5-ed0753ee75da None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:15:04.570145 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 571/1130] 10.222.0.44 () {56 vars in 1374 bytes} [Thu Jun 16 12:15:04 2022] GET /identity/v3/role_assignments?user.id=880b9c40e5f94a5fbedf2c9afe5c8e3a&scope.project.id=44d10c7982f5414a8cc8f4b90ce35ba2&role.id=e24b3707bc514b1fa606efab092047e6 => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:15:06.670743 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f3d40b-8a6d-4d08-854d-6b735d5a60e3 None None] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:15:06.671302 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f3d40b-8a6d-4d08-854d-6b735d5a60e3 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:15:06.671302 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f3d40b-8a6d-4d08-854d-6b735d5a60e3 None None] PATH_INFO: `/` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:15:06.673298 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 560/1131] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 12:15:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 12:15:06.678434 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f425014-0686-4a93-ac99-01efe6d7a5b7 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:15:06.678835 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f425014-0686-4a93-ac99-01efe6d7a5b7 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:15:06.678982 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f425014-0686-4a93-ac99-01efe6d7a5b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:15:06.695353 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-9f425014-0686-4a93-ac99-01efe6d7a5b7 None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:15:06.696530 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-9f425014-0686-4a93-ac99-01efe6d7a5b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:15:06.761712 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 572/1132] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 12:15:06 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 12:15:06.785473 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f3d40b-8a6d-4d08-854d-6b735d5a60e3 None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:15:06.801923 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:15:06.884608 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f3d40b-8a6d-4d08-854d-6b735d5a60e3 None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:15:06.918022 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc477f65-7d20-4c16-add0-32c6796aff1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:15:06.918804 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc477f65-7d20-4c16-add0-32c6796aff1e None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:15:06.919085 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc477f65-7d20-4c16-add0-32c6796aff1e None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:15:06.919382 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc477f65-7d20-4c16-add0-32c6796aff1e None admin] PATH_INFO: `/v3/domains/default` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:15:06.920562 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc477f65-7d20-4c16-add0-32c6796aff1e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:15:06.922276 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc477f65-7d20-4c16-add0-32c6796aff1e None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:15:06.923605 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 561/1133] 10.222.0.44 () {56 vars in 1108 bytes} [Thu Jun 16 12:15:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:15:06.929408 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f425014-0686-4a93-ac99-01efe6d7a5b7 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:15:06.985634 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:15:07.024079 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f425014-0686-4a93-ac99-01efe6d7a5b7 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:15:07.056366 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025f445d-aeda-4831-8ffb-0aee023f68c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:15:07.057032 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025f445d-aeda-4831-8ffb-0aee023f68c0 None admin] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:15:07.057312 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025f445d-aeda-4831-8ffb-0aee023f68c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:15:07.057582 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025f445d-aeda-4831-8ffb-0aee023f68c0 None admin] PATH_INFO: `/v3/projects` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:15:07.058280 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025f445d-aeda-4831-8ffb-0aee023f68c0 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:15:07.059700 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025f445d-aeda-4831-8ffb-0aee023f68c0 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:15:07.083979 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 573/1134] 10.222.0.44 () {60 vars in 1141 bytes} [Thu Jun 16 12:15:06 2022] POST /identity/v3/projects => generated 311 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 12:15:09.202782 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc13df72-17b2-4770-b22f-9330deede683 None None] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:15:09.203280 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc13df72-17b2-4770-b22f-9330deede683 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:15:09.203371 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc13df72-17b2-4770-b22f-9330deede683 None None] PATH_INFO: `/` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:15:09.204682 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 562/1135] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 12:15:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 12:15:09.209867 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691e0094-2f7c-4142-8d0d-360a5f206513 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:15:09.210226 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691e0094-2f7c-4142-8d0d-360a5f206513 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:15:09.210423 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691e0094-2f7c-4142-8d0d-360a5f206513 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:15:09.227374 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-691e0094-2f7c-4142-8d0d-360a5f206513 None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:15:09.228557 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-691e0094-2f7c-4142-8d0d-360a5f206513 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:15:09.292482 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 574/1136] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 12:15:09 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 12:15:09.317962 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc13df72-17b2-4770-b22f-9330deede683 None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:15:09.397093 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:15:09.415913 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc13df72-17b2-4770-b22f-9330deede683 None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:15:09.449372 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91cee16-e19b-4a3e-8d54-4d5aa6af532c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:15:09.450148 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91cee16-e19b-4a3e-8d54-4d5aa6af532c None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:15:09.450430 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91cee16-e19b-4a3e-8d54-4d5aa6af532c None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:15:09.450703 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91cee16-e19b-4a3e-8d54-4d5aa6af532c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:15:09.451866 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91cee16-e19b-4a3e-8d54-4d5aa6af532c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:15:09.453377 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91cee16-e19b-4a3e-8d54-4d5aa6af532c None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:15:09.454919 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 563/1137] 10.222.0.44 () {56 vars in 1108 bytes} [Thu Jun 16 12:15:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:15:09.460480 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691e0094-2f7c-4142-8d0d-360a5f206513 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:15:09.501720 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:15:09.556279 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691e0094-2f7c-4142-8d0d-360a5f206513 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:15:09.588142 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b8ae93-7c49-465a-ac4a-c7862503a888 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:15:09.588815 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b8ae93-7c49-465a-ac4a-c7862503a888 None admin] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:15:09.589098 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b8ae93-7c49-465a-ac4a-c7862503a888 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:15:09.589374 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b8ae93-7c49-465a-ac4a-c7862503a888 None admin] PATH_INFO: `/v3/users` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:15:09.590085 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b8ae93-7c49-465a-ac4a-c7862503a888 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:15:09.591510 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b8ae93-7c49-465a-ac4a-c7862503a888 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:15:09.610706 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 575/1138] 10.222.0.44 () {60 vars in 1132 bytes} [Thu Jun 16 12:15:09 2022] POST /identity/v3/users => generated 286 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 12:15:11.746196 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23cb93d-1649-4d08-ac2b-3330512f9ebf None None] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:15:11.746725 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23cb93d-1649-4d08-ac2b-3330512f9ebf None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:15:11.746725 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23cb93d-1649-4d08-ac2b-3330512f9ebf None None] PATH_INFO: `/` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:15:11.748094 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 564/1139] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 12:15:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 12:15:11.753222 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91b2ff0-45f5-4410-839f-afb007aaf9fe None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:15:11.753629 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91b2ff0-45f5-4410-839f-afb007aaf9fe None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:15:11.753777 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91b2ff0-45f5-4410-839f-afb007aaf9fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:15:11.769986 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-a91b2ff0-45f5-4410-839f-afb007aaf9fe None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:15:11.771169 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-a91b2ff0-45f5-4410-839f-afb007aaf9fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:15:11.835295 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 576/1140] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 12:15:11 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 12:15:11.859354 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23cb93d-1649-4d08-ac2b-3330512f9ebf None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:15:11.956776 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23cb93d-1649-4d08-ac2b-3330512f9ebf None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:15:11.989298 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ac0af1-8c99-4f40-92c7-cb9481cd47cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:15:11.990067 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ac0af1-8c99-4f40-92c7-cb9481cd47cc None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:15:11.990343 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ac0af1-8c99-4f40-92c7-cb9481cd47cc None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:15:11.990612 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ac0af1-8c99-4f40-92c7-cb9481cd47cc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:15:12.000326 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ac0af1-8c99-4f40-92c7-cb9481cd47cc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 12:15:12.007820 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application [None req-d8ac0af1-8c99-4f40-92c7-cb9481cd47cc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 12:15:12.007820 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 12:15:12.007820 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 12:15:12.007820 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 12:15:12.007820 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 12:15:12.007820 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 12:15:12.007820 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 12:15:12.007820 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 12:15:12.007820 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 12:15:12.007820 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 12:15:12.007820 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 12:15:12.007820 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 12:15:12.007820 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 12:15:12.007820 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 12:15:12.007820 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 12:15:12.007820 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 12:15:12.008910 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 12:15:12.008910 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 12:15:12.008910 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 12:15:12.008910 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 12:15:12.008910 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 12:15:12.008910 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 12:15:12.008910 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 12:15:12.008910 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 12:15:12.008910 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 12:15:12.008910 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 12:15:12.008910 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 12:15:12.008910 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application with Lock( Jun 16 12:15:12.008910 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 12:15:12.008910 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._enter() Jun 16 12:15:12.008910 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 12:15:12.008910 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 12:15:12.009787 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 12:15:12.009787 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.creator() Jun 16 12:15:12.009787 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 12:15:12.009787 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application created_value = creator( Jun 16 12:15:12.009787 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 12:15:12.009787 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 12:15:12.009787 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 12:15:12.009787 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 12:15:12.009787 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 12:15:12.009787 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 12:15:12.009787 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 12:15:12.009787 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application Jun 16 12:15:12.009787 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 565/1141] 10.222.0.44 () {56 vars in 1096 bytes} [Thu Jun 16 12:15:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 12:15:12.014952 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91b2ff0-45f5-4410-839f-afb007aaf9fe None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:15:12.041784 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:15:12.111175 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91b2ff0-45f5-4410-839f-afb007aaf9fe None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:15:12.143941 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f074665b-3029-4149-b7b1-7658e54462c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:15:12.144592 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f074665b-3029-4149-b7b1-7658e54462c5 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:15:12.144905 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f074665b-3029-4149-b7b1-7658e54462c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:15:12.145183 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f074665b-3029-4149-b7b1-7658e54462c5 None admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:15:12.145921 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f074665b-3029-4149-b7b1-7658e54462c5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:15:12.146226 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f074665b-3029-4149-b7b1-7658e54462c5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:15:12.147595 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f074665b-3029-4149-b7b1-7658e54462c5 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:15:12.155409 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 577/1142] 10.222.0.44 () {56 vars in 1099 bytes} [Thu Jun 16 12:15:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:15:12.161698 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ac0af1-8c99-4f40-92c7-cb9481cd47cc None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:15:12.174304 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:15:12.257332 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ac0af1-8c99-4f40-92c7-cb9481cd47cc None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:15:12.290090 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb50357-063e-4b70-b22e-0c595bdb8e36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:15:12.290772 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb50357-063e-4b70-b22e-0c595bdb8e36 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:15:12.291298 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb50357-063e-4b70-b22e-0c595bdb8e36 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:15:12.291569 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb50357-063e-4b70-b22e-0c595bdb8e36 None admin] PATH_INFO: `/v3/users/0377690b407a4b0580f849d8fd77467e` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:15:12.304113 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb50357-063e-4b70-b22e-0c595bdb8e36 None admin] RBAC: Authorizing `identity:get_user(user_id=0377690b407a4b0580f849d8fd77467e)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:15:12.305574 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb50357-063e-4b70-b22e-0c595bdb8e36 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:15:12.307177 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 566/1143] 10.222.0.44 () {56 vars in 1177 bytes} [Thu Jun 16 12:15:12 2022] GET /identity/v3/users/0377690b407a4b0580f849d8fd77467e => generated 286 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:15:12.312814 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f074665b-3029-4149-b7b1-7658e54462c5 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:15:12.397956 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:15:12.408322 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f074665b-3029-4149-b7b1-7658e54462c5 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:15:12.439847 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3878a71e-91c5-43d0-969b-6265e22d1e12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:15:12.440472 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3878a71e-91c5-43d0-969b-6265e22d1e12 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:15:12.440770 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3878a71e-91c5-43d0-969b-6265e22d1e12 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:15:12.441042 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3878a71e-91c5-43d0-969b-6265e22d1e12 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:15:12.505554 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3878a71e-91c5-43d0-969b-6265e22d1e12 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:15:12.506978 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3878a71e-91c5-43d0-969b-6265e22d1e12 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:15:12.592743 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:15:12.602739 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 578/1144] 10.222.0.44 () {58 vars in 1282 bytes} [Thu Jun 16 12:15:12 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 16 12:15:12.608544 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb50357-063e-4b70-b22e-0c595bdb8e36 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:15:12.673837 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:15:12.707268 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb50357-063e-4b70-b22e-0c595bdb8e36 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:15:12.739925 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da663ad-294e-44d9-bb4b-c06ea11640bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:15:12.740793 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da663ad-294e-44d9-bb4b-c06ea11640bb None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:15:12.741080 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da663ad-294e-44d9-bb4b-c06ea11640bb None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:15:12.741356 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da663ad-294e-44d9-bb4b-c06ea11640bb None admin] PATH_INFO: `/v3/projects/5ac0f21346c24a1ea4b5fa6b0facfd2a` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:15:12.742528 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da663ad-294e-44d9-bb4b-c06ea11640bb None admin] RBAC: Authorizing `identity:get_project(project_id=5ac0f21346c24a1ea4b5fa6b0facfd2a)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:15:12.743943 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da663ad-294e-44d9-bb4b-c06ea11640bb None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:15:12.745643 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 567/1145] 10.222.0.44 () {56 vars in 1186 bytes} [Thu Jun 16 12:15:12 2022] GET /identity/v3/projects/5ac0f21346c24a1ea4b5fa6b0facfd2a => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:15:12.752198 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3878a71e-91c5-43d0-969b-6265e22d1e12 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:15:12.845271 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3878a71e-91c5-43d0-969b-6265e22d1e12 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:15:12.877576 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f441eef5-a9b7-4890-b69f-0f79d1696b43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:15:12.878200 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f441eef5-a9b7-4890-b69f-0f79d1696b43 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:15:12.878473 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f441eef5-a9b7-4890-b69f-0f79d1696b43 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:15:12.878741 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f441eef5-a9b7-4890-b69f-0f79d1696b43 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:15:12.879551 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f441eef5-a9b7-4890-b69f-0f79d1696b43 None admin] RBAC: Adding query filter params (role.id=0688968254744e3f9913653cafea3091, scope.project.id=5ac0f21346c24a1ea4b5fa6b0facfd2a, user.id=0377690b407a4b0580f849d8fd77467e) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:15:12.879852 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f441eef5-a9b7-4890-b69f-0f79d1696b43 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:15:12.881301 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f441eef5-a9b7-4890-b69f-0f79d1696b43 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:15:12.886479 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 579/1146] 10.222.0.44 () {56 vars in 1374 bytes} [Thu Jun 16 12:15:12 2022] GET /identity/v3/role_assignments?user.id=0377690b407a4b0580f849d8fd77467e&scope.project.id=5ac0f21346c24a1ea4b5fa6b0facfd2a&role.id=0688968254744e3f9913653cafea3091 => generated 259 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:15:14.952955 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29454d1-5b10-4870-9c83-7c6dcfb354c3 None None] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:15:14.953388 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29454d1-5b10-4870-9c83-7c6dcfb354c3 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:15:14.953514 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29454d1-5b10-4870-9c83-7c6dcfb354c3 None None] PATH_INFO: `/` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:15:14.954884 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 568/1147] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 12:15:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 12:15:14.959988 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15620c3-0b46-4d66-b7bb-98e165f92414 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:15:14.960385 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15620c3-0b46-4d66-b7bb-98e165f92414 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:15:14.960524 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15620c3-0b46-4d66-b7bb-98e165f92414 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:15:14.976578 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-d15620c3-0b46-4d66-b7bb-98e165f92414 None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:15:14.977775 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-d15620c3-0b46-4d66-b7bb-98e165f92414 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:15:15.024741 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:15:15.041788 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 580/1148] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 12:15:14 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 12:15:15.064173 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29454d1-5b10-4870-9c83-7c6dcfb354c3 None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:15:15.161301 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29454d1-5b10-4870-9c83-7c6dcfb354c3 None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:15:15.194595 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3761db1a-c031-49f0-8e55-16f0afbda002 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:15:15.195309 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3761db1a-c031-49f0-8e55-16f0afbda002 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:15:15.195589 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3761db1a-c031-49f0-8e55-16f0afbda002 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:15:15.195861 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3761db1a-c031-49f0-8e55-16f0afbda002 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:15:15.198449 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:15:15.206486 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3761db1a-c031-49f0-8e55-16f0afbda002 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 12:15:15.214102 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application [None req-3761db1a-c031-49f0-8e55-16f0afbda002 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 12:15:15.214102 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 12:15:15.214102 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 12:15:15.214102 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 12:15:15.214102 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 12:15:15.214102 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 12:15:15.214102 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 12:15:15.214102 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 12:15:15.214102 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 12:15:15.214102 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 12:15:15.214102 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 12:15:15.214102 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 12:15:15.214102 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 12:15:15.214102 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 12:15:15.214102 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 12:15:15.214102 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 12:15:15.215182 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 12:15:15.215182 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 12:15:15.215182 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 12:15:15.215182 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 12:15:15.215182 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 12:15:15.215182 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 12:15:15.215182 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 12:15:15.215182 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 12:15:15.215182 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 12:15:15.215182 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 12:15:15.215182 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 12:15:15.215182 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application with Lock( Jun 16 12:15:15.215182 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 12:15:15.215182 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._enter() Jun 16 12:15:15.215182 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 12:15:15.215182 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 12:15:15.216396 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 12:15:15.216396 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.creator() Jun 16 12:15:15.216396 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 12:15:15.216396 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application created_value = creator( Jun 16 12:15:15.216396 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 12:15:15.216396 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 12:15:15.216396 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 12:15:15.216396 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 12:15:15.216396 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 12:15:15.216396 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 12:15:15.216396 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 12:15:15.216396 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application Jun 16 12:15:15.216396 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 569/1149] 10.222.0.44 () {56 vars in 1096 bytes} [Thu Jun 16 12:15:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 12:15:15.221366 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15620c3-0b46-4d66-b7bb-98e165f92414 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:15:15.316406 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15620c3-0b46-4d66-b7bb-98e165f92414 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:15:15.348103 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138ea545-c570-46ff-af86-34b1ac88a430 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:15:15.348835 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138ea545-c570-46ff-af86-34b1ac88a430 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:15:15.349053 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138ea545-c570-46ff-af86-34b1ac88a430 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:15:15.349325 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138ea545-c570-46ff-af86-34b1ac88a430 None admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:15:15.350061 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138ea545-c570-46ff-af86-34b1ac88a430 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:15:15.350363 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138ea545-c570-46ff-af86-34b1ac88a430 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:15:15.351717 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138ea545-c570-46ff-af86-34b1ac88a430 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:15:15.359955 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 581/1150] 10.222.0.44 () {56 vars in 1099 bytes} [Thu Jun 16 12:15:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:15:15.365430 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3761db1a-c031-49f0-8e55-16f0afbda002 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:15:15.460250 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3761db1a-c031-49f0-8e55-16f0afbda002 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:15:15.492355 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65ac7af-0b9d-446c-8303-192cfabdc7b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:15:15.493216 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65ac7af-0b9d-446c-8303-192cfabdc7b8 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:15:15.493491 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65ac7af-0b9d-446c-8303-192cfabdc7b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:15:15.493757 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65ac7af-0b9d-446c-8303-192cfabdc7b8 None admin] PATH_INFO: `/v3/users/0377690b407a4b0580f849d8fd77467e` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:15:15.494918 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65ac7af-0b9d-446c-8303-192cfabdc7b8 None admin] RBAC: Authorizing `identity:get_user(user_id=0377690b407a4b0580f849d8fd77467e)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:15:15.496313 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65ac7af-0b9d-446c-8303-192cfabdc7b8 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:15:15.497900 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 570/1151] 10.222.0.44 () {56 vars in 1177 bytes} [Thu Jun 16 12:15:15 2022] GET /identity/v3/users/0377690b407a4b0580f849d8fd77467e => generated 286 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:15:15.503356 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138ea545-c570-46ff-af86-34b1ac88a430 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:15:15.549219 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:15:15.600257 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138ea545-c570-46ff-af86-34b1ac88a430 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:15:15.632496 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f5ab98-1721-4267-a987-7c08df8ec05f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:15:15.633362 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f5ab98-1721-4267-a987-7c08df8ec05f None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:15:15.633640 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f5ab98-1721-4267-a987-7c08df8ec05f None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:15:15.633909 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f5ab98-1721-4267-a987-7c08df8ec05f None admin] PATH_INFO: `/v3/projects/5ac0f21346c24a1ea4b5fa6b0facfd2a` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:15:15.635071 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f5ab98-1721-4267-a987-7c08df8ec05f None admin] RBAC: Authorizing `identity:get_project(project_id=5ac0f21346c24a1ea4b5fa6b0facfd2a)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:15:15.636516 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f5ab98-1721-4267-a987-7c08df8ec05f None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:15:15.638203 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 582/1152] 10.222.0.44 () {56 vars in 1186 bytes} [Thu Jun 16 12:15:15 2022] GET /identity/v3/projects/5ac0f21346c24a1ea4b5fa6b0facfd2a => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:15:15.643845 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65ac7af-0b9d-446c-8303-192cfabdc7b8 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:15:15.703025 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:15:15.739885 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65ac7af-0b9d-446c-8303-192cfabdc7b8 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:15:15.770978 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb235a75-6970-4c26-8c85-56511f21d3b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:15:15.771845 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb235a75-6970-4c26-8c85-56511f21d3b2 None admin] REQUEST_METHOD: `PUT` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:15:15.772122 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb235a75-6970-4c26-8c85-56511f21d3b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:15:15.772390 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb235a75-6970-4c26-8c85-56511f21d3b2 None admin] PATH_INFO: `/v3/projects/5ac0f21346c24a1ea4b5fa6b0facfd2a/users/0377690b407a4b0580f849d8fd77467e/roles/0688968254744e3f9913653cafea3091` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:15:15.774328 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb235a75-6970-4c26-8c85-56511f21d3b2 None admin] RBAC: Authorizing `identity:create_grant(project_id=5ac0f21346c24a1ea4b5fa6b0facfd2a, user_id=0377690b407a4b0580f849d8fd77467e, role_id=0688968254744e3f9913653cafea3091)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:15:15.775725 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb235a75-6970-4c26-8c85-56511f21d3b2 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:15:15.789106 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 571/1153] 10.222.0.44 () {58 vars in 1439 bytes} [Thu Jun 16 12:15:15 2022] PUT /identity/v3/projects/5ac0f21346c24a1ea4b5fa6b0facfd2a/users/0377690b407a4b0580f849d8fd77467e/roles/0688968254744e3f9913653cafea3091 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:15:17.882984 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c4d1b9-234d-4f1c-9cb1-321816063271 None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:15:17.883516 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c4d1b9-234d-4f1c-9cb1-321816063271 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:15:17.883516 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c4d1b9-234d-4f1c-9cb1-321816063271 None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:15:17.884894 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 583/1154] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 12:15:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 12:15:17.890588 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de4906d-e9cf-4ae7-9d7d-53aba84f5827 None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:15:17.891006 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de4906d-e9cf-4ae7-9d7d-53aba84f5827 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:15:17.891112 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de4906d-e9cf-4ae7-9d7d-53aba84f5827 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:15:17.907336 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-6de4906d-e9cf-4ae7-9d7d-53aba84f5827 None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:15:17.908499 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-6de4906d-e9cf-4ae7-9d7d-53aba84f5827 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:15:17.972688 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 572/1155] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 12:15:17 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 12:15:17.995621 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c4d1b9-234d-4f1c-9cb1-321816063271 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:15:18.092695 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c4d1b9-234d-4f1c-9cb1-321816063271 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:15:18.105574 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:15:18.125623 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2d7577-9e58-469d-a754-c85e1eaf638c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:15:18.126395 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2d7577-9e58-469d-a754-c85e1eaf638c None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:15:18.126668 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2d7577-9e58-469d-a754-c85e1eaf638c None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:15:18.126936 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2d7577-9e58-469d-a754-c85e1eaf638c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:15:18.137005 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2d7577-9e58-469d-a754-c85e1eaf638c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 12:15:18.144443 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-0a2d7577-9e58-469d-a754-c85e1eaf638c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 12:15:18.144443 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 12:15:18.144443 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 12:15:18.144443 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 12:15:18.144443 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 12:15:18.144443 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 12:15:18.144443 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 12:15:18.144443 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 12:15:18.144443 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 12:15:18.144443 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 12:15:18.144443 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 12:15:18.144443 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 12:15:18.144443 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 12:15:18.144443 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 12:15:18.144443 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 12:15:18.144443 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 12:15:18.145674 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 12:15:18.145674 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 12:15:18.145674 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 12:15:18.145674 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 12:15:18.145674 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 12:15:18.145674 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 12:15:18.145674 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 12:15:18.145674 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 12:15:18.145674 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 12:15:18.145674 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 12:15:18.145674 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 12:15:18.145674 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jun 16 12:15:18.145674 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 12:15:18.145674 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jun 16 12:15:18.145674 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 12:15:18.145674 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 12:15:18.146915 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 12:15:18.146915 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jun 16 12:15:18.146915 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 12:15:18.146915 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jun 16 12:15:18.146915 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 12:15:18.146915 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 12:15:18.146915 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 12:15:18.146915 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 12:15:18.146915 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 12:15:18.146915 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 12:15:18.146915 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 12:15:18.146915 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jun 16 12:15:18.146915 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 584/1156] 10.222.0.44 () {56 vars in 1096 bytes} [Thu Jun 16 12:15:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 12:15:18.151778 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de4906d-e9cf-4ae7-9d7d-53aba84f5827 None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:15:18.204493 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:15:18.246724 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de4906d-e9cf-4ae7-9d7d-53aba84f5827 None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:15:18.278775 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db7f2d7-2fc0-4ea8-800f-e61fdcfc3c07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:15:18.279414 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db7f2d7-2fc0-4ea8-800f-e61fdcfc3c07 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:15:18.279690 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db7f2d7-2fc0-4ea8-800f-e61fdcfc3c07 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:15:18.279956 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db7f2d7-2fc0-4ea8-800f-e61fdcfc3c07 None admin] PATH_INFO: `/v3/roles` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:15:18.280711 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db7f2d7-2fc0-4ea8-800f-e61fdcfc3c07 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:15:18.281047 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db7f2d7-2fc0-4ea8-800f-e61fdcfc3c07 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:15:18.282385 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db7f2d7-2fc0-4ea8-800f-e61fdcfc3c07 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:15:18.290055 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 573/1157] 10.222.0.44 () {56 vars in 1099 bytes} [Thu Jun 16 12:15:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:15:18.296383 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2d7577-9e58-469d-a754-c85e1eaf638c None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:15:18.391450 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2d7577-9e58-469d-a754-c85e1eaf638c None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:15:18.423720 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e47108e-d1b3-419d-bf18-c22d6a4dde4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:15:18.424558 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e47108e-d1b3-419d-bf18-c22d6a4dde4f None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:15:18.424866 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e47108e-d1b3-419d-bf18-c22d6a4dde4f None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:15:18.425140 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e47108e-d1b3-419d-bf18-c22d6a4dde4f None admin] PATH_INFO: `/v3/users/0377690b407a4b0580f849d8fd77467e` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:15:18.426315 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e47108e-d1b3-419d-bf18-c22d6a4dde4f None admin] RBAC: Authorizing `identity:get_user(user_id=0377690b407a4b0580f849d8fd77467e)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:15:18.427732 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e47108e-d1b3-419d-bf18-c22d6a4dde4f None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:15:18.429337 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 585/1158] 10.222.0.44 () {56 vars in 1177 bytes} [Thu Jun 16 12:15:18 2022] GET /identity/v3/users/0377690b407a4b0580f849d8fd77467e => generated 286 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:15:18.434805 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db7f2d7-2fc0-4ea8-800f-e61fdcfc3c07 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:15:18.530451 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db7f2d7-2fc0-4ea8-800f-e61fdcfc3c07 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:15:18.546215 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:15:18.562965 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227a2762-4541-4a96-995a-2a32465df996 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:15:18.563583 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227a2762-4541-4a96-995a-2a32465df996 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:15:18.563858 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227a2762-4541-4a96-995a-2a32465df996 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:15:18.564125 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227a2762-4541-4a96-995a-2a32465df996 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:15:18.627500 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227a2762-4541-4a96-995a-2a32465df996 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:15:18.628932 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227a2762-4541-4a96-995a-2a32465df996 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:15:18.722395 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 574/1159] 10.222.0.44 () {58 vars in 1282 bytes} [Thu Jun 16 12:15:18 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 16 12:15:18.731187 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e47108e-d1b3-419d-bf18-c22d6a4dde4f None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:15:18.772810 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:15:18.826497 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e47108e-d1b3-419d-bf18-c22d6a4dde4f None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:15:18.859148 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0158688b-de51-4a82-9d15-9c204af14595 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:15:18.859974 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0158688b-de51-4a82-9d15-9c204af14595 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:15:18.860250 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0158688b-de51-4a82-9d15-9c204af14595 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:15:18.860520 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0158688b-de51-4a82-9d15-9c204af14595 None admin] PATH_INFO: `/v3/projects/5ac0f21346c24a1ea4b5fa6b0facfd2a` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:15:18.861708 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0158688b-de51-4a82-9d15-9c204af14595 None admin] RBAC: Authorizing `identity:get_project(project_id=5ac0f21346c24a1ea4b5fa6b0facfd2a)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:15:18.863131 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0158688b-de51-4a82-9d15-9c204af14595 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:15:18.864813 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 586/1160] 10.222.0.44 () {56 vars in 1186 bytes} [Thu Jun 16 12:15:18 2022] GET /identity/v3/projects/5ac0f21346c24a1ea4b5fa6b0facfd2a => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:15:18.870892 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227a2762-4541-4a96-995a-2a32465df996 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:15:18.887684 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:15:18.966429 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227a2762-4541-4a96-995a-2a32465df996 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:15:18.999081 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aef1342-e2d2-4af6-8224-4d2bc1cb8217 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:15:18.999663 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aef1342-e2d2-4af6-8224-4d2bc1cb8217 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:15:18.999941 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aef1342-e2d2-4af6-8224-4d2bc1cb8217 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:15:19.000215 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aef1342-e2d2-4af6-8224-4d2bc1cb8217 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:15:19.001065 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aef1342-e2d2-4af6-8224-4d2bc1cb8217 None admin] RBAC: Adding query filter params (role.id=0688968254744e3f9913653cafea3091, scope.project.id=5ac0f21346c24a1ea4b5fa6b0facfd2a, user.id=0377690b407a4b0580f849d8fd77467e) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:15:19.001374 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aef1342-e2d2-4af6-8224-4d2bc1cb8217 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:15:19.002786 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aef1342-e2d2-4af6-8224-4d2bc1cb8217 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:15:19.008417 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 575/1161] 10.222.0.44 () {56 vars in 1374 bytes} [Thu Jun 16 12:15:18 2022] GET /identity/v3/role_assignments?user.id=0377690b407a4b0580f849d8fd77467e&scope.project.id=5ac0f21346c24a1ea4b5fa6b0facfd2a&role.id=0688968254744e3f9913653cafea3091 => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:15:21.110708 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97d38f8-5a04-4733-ad23-aa49cc12bb51 None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:15:21.111228 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97d38f8-5a04-4733-ad23-aa49cc12bb51 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:15:21.111228 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97d38f8-5a04-4733-ad23-aa49cc12bb51 None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:15:21.112612 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 587/1162] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 12:15:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 12:15:21.117811 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d58ad9e-144e-450e-882a-43a120caf11b None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:15:21.118230 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d58ad9e-144e-450e-882a-43a120caf11b None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:15:21.118361 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d58ad9e-144e-450e-882a-43a120caf11b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:15:21.134600 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-7d58ad9e-144e-450e-882a-43a120caf11b None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:15:21.135771 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-7d58ad9e-144e-450e-882a-43a120caf11b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:15:21.199656 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 576/1163] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 12:15:21 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 12:15:21.222773 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97d38f8-5a04-4733-ad23-aa49cc12bb51 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:15:21.319247 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97d38f8-5a04-4733-ad23-aa49cc12bb51 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:15:21.329837 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:15:21.352843 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837ebe1d-8b9e-4a3c-8c62-7b3619fa7c8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:15:21.353469 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837ebe1d-8b9e-4a3c-8c62-7b3619fa7c8d None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:15:21.353747 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837ebe1d-8b9e-4a3c-8c62-7b3619fa7c8d None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:15:21.354018 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837ebe1d-8b9e-4a3c-8c62-7b3619fa7c8d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:15:21.418300 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837ebe1d-8b9e-4a3c-8c62-7b3619fa7c8d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:15:21.419731 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837ebe1d-8b9e-4a3c-8c62-7b3619fa7c8d None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:15:21.512109 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 588/1164] 10.222.0.44 () {58 vars in 1282 bytes} [Thu Jun 16 12:15:21 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 16 12:15:21.518467 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d58ad9e-144e-450e-882a-43a120caf11b None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:15:21.529733 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:15:21.613434 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d58ad9e-144e-450e-882a-43a120caf11b None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:15:21.646214 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d9ede7-bbff-4f9a-a590-27003f0414ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:15:21.646994 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d9ede7-bbff-4f9a-a590-27003f0414ce None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:15:21.647272 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d9ede7-bbff-4f9a-a590-27003f0414ce None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:15:21.647541 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d9ede7-bbff-4f9a-a590-27003f0414ce None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:15:21.654114 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d9ede7-bbff-4f9a-a590-27003f0414ce None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:15:21.655577 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d9ede7-bbff-4f9a-a590-27003f0414ce None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:15:21.669473 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application [None req-40d9ede7-bbff-4f9a-a590-27003f0414ce None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Jun 16 12:15:21.669473 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 12:15:21.669473 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jun 16 12:15:21.669473 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jun 16 12:15:21.669473 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 12:15:21.669473 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 12:15:21.669473 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 12:15:21.669473 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 12:15:21.669473 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Jun 16 12:15:21.669473 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application Jun 16 12:15:21.669473 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 12:15:21.669473 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application Jun 16 12:15:21.669473 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 12:15:21.669473 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 12:15:21.669473 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 12:15:21.669473 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 12:15:21.669473 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 12:15:21.670645 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 12:15:21.670645 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 12:15:21.670645 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 12:15:21.670645 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 12:15:21.670645 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 12:15:21.670645 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 12:15:21.670645 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 12:15:21.670645 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 12:15:21.670645 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 12:15:21.670645 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 12:15:21.670645 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 12:15:21.670645 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 12:15:21.670645 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 12:15:21.670645 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 12:15:21.670645 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 12:15:21.670645 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 12:15:21.671882 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 12:15:21.671882 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application with Lock( Jun 16 12:15:21.671882 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 12:15:21.671882 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._enter() Jun 16 12:15:21.671882 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 12:15:21.671882 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 12:15:21.671882 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 12:15:21.671882 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.creator() Jun 16 12:15:21.671882 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 12:15:21.671882 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application created_value = creator( Jun 16 12:15:21.671882 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jun 16 12:15:21.671882 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 12:15:21.671882 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Jun 16 12:15:21.671882 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application Jun 16 12:15:21.671882 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 577/1165] 10.222.0.44 () {56 vars in 1117 bytes} [Thu Jun 16 12:15:21 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 12:15:21.676407 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837ebe1d-8b9e-4a3c-8c62-7b3619fa7c8d None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:15:21.688072 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:15:21.771956 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837ebe1d-8b9e-4a3c-8c62-7b3619fa7c8d None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:15:21.804167 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0fe5d1-0bee-4daa-80db-2bc245665e68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:15:21.804835 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0fe5d1-0bee-4daa-80db-2bc245665e68 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:15:21.805116 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0fe5d1-0bee-4daa-80db-2bc245665e68 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:15:21.805390 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0fe5d1-0bee-4daa-80db-2bc245665e68 None admin] PATH_INFO: `/v3/domains` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:15:21.806099 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0fe5d1-0bee-4daa-80db-2bc245665e68 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:15:21.806400 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0fe5d1-0bee-4daa-80db-2bc245665e68 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:15:21.807762 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0fe5d1-0bee-4daa-80db-2bc245665e68 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:15:21.815236 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 589/1166] 10.222.0.44 () {56 vars in 1115 bytes} [Thu Jun 16 12:15:21 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:15:23.883404 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5ed7e5-ad5a-4658-8852-5ff700f3293d None None] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:15:23.883988 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5ed7e5-ad5a-4658-8852-5ff700f3293d None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:15:23.883988 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5ed7e5-ad5a-4658-8852-5ff700f3293d None None] PATH_INFO: `/` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:15:23.885329 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 578/1167] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 12:15:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 12:15:23.890540 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b55e983-bef8-4205-ab12-61b95ddad958 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:15:23.890949 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b55e983-bef8-4205-ab12-61b95ddad958 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:15:23.891082 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b55e983-bef8-4205-ab12-61b95ddad958 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:15:23.907733 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-5b55e983-bef8-4205-ab12-61b95ddad958 None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:15:23.908930 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-5b55e983-bef8-4205-ab12-61b95ddad958 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:15:23.974009 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 590/1168] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 12:15:23 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 12:15:23.996921 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5ed7e5-ad5a-4658-8852-5ff700f3293d None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:15:24.065658 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:15:24.096377 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5ed7e5-ad5a-4658-8852-5ff700f3293d None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:15:24.128386 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8024515-9614-48c4-9b32-5bf5b02e6194 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:15:24.129052 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8024515-9614-48c4-9b32-5bf5b02e6194 None admin] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:15:24.129329 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8024515-9614-48c4-9b32-5bf5b02e6194 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:15:24.129597 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8024515-9614-48c4-9b32-5bf5b02e6194 None admin] PATH_INFO: `/v3/domains` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:15:24.130326 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8024515-9614-48c4-9b32-5bf5b02e6194 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:15:24.131678 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8024515-9614-48c4-9b32-5bf5b02e6194 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:15:24.145422 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 579/1169] 10.222.0.44 () {60 vars in 1138 bytes} [Thu Jun 16 12:15:23 2022] POST /identity/v3/domains => generated 267 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 12:15:26.245896 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdee463e-5ce1-4eed-a014-5b0d7ac01df3 None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:15:26.246442 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdee463e-5ce1-4eed-a014-5b0d7ac01df3 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:15:26.246442 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdee463e-5ce1-4eed-a014-5b0d7ac01df3 None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:15:26.247797 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 591/1170] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 12:15:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 12:15:26.253491 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3d5911-cde2-4a12-9ace-da4718e1cf4a None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:15:26.253895 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3d5911-cde2-4a12-9ace-da4718e1cf4a None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:15:26.254037 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3d5911-cde2-4a12-9ace-da4718e1cf4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:15:26.270927 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-df3d5911-cde2-4a12-9ace-da4718e1cf4a None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:15:26.272097 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-df3d5911-cde2-4a12-9ace-da4718e1cf4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:15:26.336492 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 580/1171] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 12:15:26 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 12:15:26.360367 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdee463e-5ce1-4eed-a014-5b0d7ac01df3 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:15:26.364159 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:15:26.459484 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdee463e-5ce1-4eed-a014-5b0d7ac01df3 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:15:26.491523 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf170206-a4d0-40a8-bb3e-47c53ebdcfc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:15:26.492357 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf170206-a4d0-40a8-bb3e-47c53ebdcfc1 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:15:26.492634 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf170206-a4d0-40a8-bb3e-47c53ebdcfc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:15:26.492935 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf170206-a4d0-40a8-bb3e-47c53ebdcfc1 None admin] PATH_INFO: `/v3/domains/96eac6b6494246e3997e1203452c626e` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:15:26.503548 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf170206-a4d0-40a8-bb3e-47c53ebdcfc1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=96eac6b6494246e3997e1203452c626e)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:15:26.504965 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf170206-a4d0-40a8-bb3e-47c53ebdcfc1 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:15:26.506566 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 592/1172] 10.222.0.44 () {56 vars in 1183 bytes} [Thu Jun 16 12:15:26 2022] GET /identity/v3/domains/96eac6b6494246e3997e1203452c626e => generated 267 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:15:26.512162 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3d5911-cde2-4a12-9ace-da4718e1cf4a None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:15:26.568676 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:15:26.608194 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3d5911-cde2-4a12-9ace-da4718e1cf4a None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:15:26.640439 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b52821c-f81e-4db3-b598-d805633101df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:15:26.641110 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b52821c-f81e-4db3-b598-d805633101df None admin] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:15:26.641392 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b52821c-f81e-4db3-b598-d805633101df None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:15:26.641664 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b52821c-f81e-4db3-b598-d805633101df None admin] PATH_INFO: `/v3/projects` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:15:26.642365 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b52821c-f81e-4db3-b598-d805633101df None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:15:26.643786 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b52821c-f81e-4db3-b598-d805633101df None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:15:26.667805 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 581/1173] 10.222.0.44 () {60 vars in 1141 bytes} [Thu Jun 16 12:15:26 2022] POST /identity/v3/projects => generated 361 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 12:15:28.794476 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0896de5-6f1d-4283-8942-bb8b5726dbbf None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:15:28.795533 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0896de5-6f1d-4283-8942-bb8b5726dbbf None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:15:28.795533 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0896de5-6f1d-4283-8942-bb8b5726dbbf None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:15:28.796916 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 593/1174] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 12:15:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 12:15:28.802119 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2714b6-69e8-45fd-ab0b-8a9a926d76c1 None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:15:28.802532 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2714b6-69e8-45fd-ab0b-8a9a926d76c1 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:15:28.802671 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2714b6-69e8-45fd-ab0b-8a9a926d76c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:15:28.819622 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-0d2714b6-69e8-45fd-ab0b-8a9a926d76c1 None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:15:28.820838 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-0d2714b6-69e8-45fd-ab0b-8a9a926d76c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:15:28.884700 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 582/1175] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 12:15:28 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 12:15:28.909339 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0896de5-6f1d-4283-8942-bb8b5726dbbf None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:15:28.971833 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:15:29.009463 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0896de5-6f1d-4283-8942-bb8b5726dbbf None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:15:29.041684 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28925ce2-53ef-4218-a3e5-8edcc97e5207 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:15:29.042536 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28925ce2-53ef-4218-a3e5-8edcc97e5207 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:15:29.042817 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28925ce2-53ef-4218-a3e5-8edcc97e5207 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:15:29.043091 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28925ce2-53ef-4218-a3e5-8edcc97e5207 None admin] PATH_INFO: `/v3/domains/96eac6b6494246e3997e1203452c626e` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:15:29.044263 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28925ce2-53ef-4218-a3e5-8edcc97e5207 None admin] RBAC: Authorizing `identity:get_domain(domain_id=96eac6b6494246e3997e1203452c626e)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:15:29.046353 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28925ce2-53ef-4218-a3e5-8edcc97e5207 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:15:29.047910 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 594/1176] 10.222.0.44 () {56 vars in 1183 bytes} [Thu Jun 16 12:15:28 2022] GET /identity/v3/domains/96eac6b6494246e3997e1203452c626e => generated 267 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:15:29.053628 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2714b6-69e8-45fd-ab0b-8a9a926d76c1 None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:15:29.095402 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:15:29.150424 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2714b6-69e8-45fd-ab0b-8a9a926d76c1 None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:15:29.184159 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a248af-e98c-4ab9-8a4b-3bcdfcc2e124 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:15:29.184840 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a248af-e98c-4ab9-8a4b-3bcdfcc2e124 None admin] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:15:29.185123 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a248af-e98c-4ab9-8a4b-3bcdfcc2e124 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:15:29.185908 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a248af-e98c-4ab9-8a4b-3bcdfcc2e124 None admin] PATH_INFO: `/v3/users` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:15:29.186619 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a248af-e98c-4ab9-8a4b-3bcdfcc2e124 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:15:29.188035 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a248af-e98c-4ab9-8a4b-3bcdfcc2e124 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:15:29.207746 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 583/1177] 10.222.0.44 () {60 vars in 1132 bytes} [Thu Jun 16 12:15:29 2022] POST /identity/v3/users => generated 311 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 12:15:31.328900 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f20a315-931c-4d28-8608-d744905b273a None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:15:31.329464 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f20a315-931c-4d28-8608-d744905b273a None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:15:31.329464 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f20a315-931c-4d28-8608-d744905b273a None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:15:31.330806 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 595/1178] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 12:15:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 12:15:31.335854 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456270e4-61df-478e-91fd-3fdd349722a5 None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:15:31.336229 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456270e4-61df-478e-91fd-3fdd349722a5 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:15:31.336400 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456270e4-61df-478e-91fd-3fdd349722a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:15:31.353491 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-456270e4-61df-478e-91fd-3fdd349722a5 None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:15:31.354663 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-456270e4-61df-478e-91fd-3fdd349722a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:15:31.418590 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 584/1179] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 12:15:31 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 12:15:31.442053 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f20a315-931c-4d28-8608-d744905b273a None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:15:31.539247 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f20a315-931c-4d28-8608-d744905b273a None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:15:31.567142 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:15:31.572097 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfeb967c-0f07-499f-a05f-8c78a0582f90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:15:31.572898 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfeb967c-0f07-499f-a05f-8c78a0582f90 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:15:31.573177 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfeb967c-0f07-499f-a05f-8c78a0582f90 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:15:31.573447 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfeb967c-0f07-499f-a05f-8c78a0582f90 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:15:31.583813 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfeb967c-0f07-499f-a05f-8c78a0582f90 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 12:15:31.591317 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-bfeb967c-0f07-499f-a05f-8c78a0582f90 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 12:15:31.591317 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 12:15:31.591317 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 12:15:31.591317 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 12:15:31.591317 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 12:15:31.591317 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 12:15:31.591317 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 12:15:31.591317 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 12:15:31.591317 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 12:15:31.591317 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 12:15:31.591317 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 12:15:31.591317 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 12:15:31.591317 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 12:15:31.591317 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 12:15:31.591317 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 12:15:31.591317 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 12:15:31.593033 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 12:15:31.593033 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 12:15:31.593033 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 12:15:31.593033 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 12:15:31.593033 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 12:15:31.593033 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 12:15:31.593033 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 12:15:31.593033 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 12:15:31.593033 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 12:15:31.593033 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 12:15:31.593033 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 12:15:31.593033 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jun 16 12:15:31.593033 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 12:15:31.593033 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jun 16 12:15:31.593033 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 12:15:31.593033 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 12:15:31.594289 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 12:15:31.594289 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jun 16 12:15:31.594289 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 12:15:31.594289 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jun 16 12:15:31.594289 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 12:15:31.594289 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 12:15:31.594289 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 12:15:31.594289 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 12:15:31.594289 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 12:15:31.594289 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 12:15:31.594289 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 12:15:31.594289 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jun 16 12:15:31.594289 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 596/1180] 10.222.0.44 () {56 vars in 1096 bytes} [Thu Jun 16 12:15:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 12:15:31.598892 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456270e4-61df-478e-91fd-3fdd349722a5 None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:15:31.625701 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:15:31.694596 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456270e4-61df-478e-91fd-3fdd349722a5 None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:15:31.727655 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9824cf-7075-4490-83f0-6232eb152fff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:15:31.728308 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9824cf-7075-4490-83f0-6232eb152fff None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:15:31.728588 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9824cf-7075-4490-83f0-6232eb152fff None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:15:31.728891 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9824cf-7075-4490-83f0-6232eb152fff None admin] PATH_INFO: `/v3/roles` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:15:31.729627 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9824cf-7075-4490-83f0-6232eb152fff None admin] RBAC: Adding query filter params (name=admin) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:15:31.729930 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9824cf-7075-4490-83f0-6232eb152fff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:15:31.731287 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9824cf-7075-4490-83f0-6232eb152fff None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:15:31.739128 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 585/1181] 10.222.0.44 () {56 vars in 1099 bytes} [Thu Jun 16 12:15:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:15:31.744903 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfeb967c-0f07-499f-a05f-8c78a0582f90 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:15:31.839933 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfeb967c-0f07-499f-a05f-8c78a0582f90 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:15:31.872226 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f060f9c-768e-400c-9801-71d7133caa82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:15:31.873118 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f060f9c-768e-400c-9801-71d7133caa82 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:15:31.873395 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f060f9c-768e-400c-9801-71d7133caa82 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:15:31.873666 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f060f9c-768e-400c-9801-71d7133caa82 None admin] PATH_INFO: `/v3/users/3818edc0de864debaf80858367d30e63` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:15:31.886038 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f060f9c-768e-400c-9801-71d7133caa82 None admin] RBAC: Authorizing `identity:get_user(user_id=3818edc0de864debaf80858367d30e63)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:15:31.887468 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f060f9c-768e-400c-9801-71d7133caa82 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:15:31.889614 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 597/1182] 10.222.0.44 () {56 vars in 1177 bytes} [Thu Jun 16 12:15:31 2022] GET /identity/v3/users/3818edc0de864debaf80858367d30e63 => generated 311 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:15:31.895154 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9824cf-7075-4490-83f0-6232eb152fff None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:15:31.982761 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:15:31.992394 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9824cf-7075-4490-83f0-6232eb152fff None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:15:32.025245 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b20faf-ecf0-4b16-be52-5c1e62dfb49c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:15:32.025876 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b20faf-ecf0-4b16-be52-5c1e62dfb49c None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:15:32.026157 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b20faf-ecf0-4b16-be52-5c1e62dfb49c None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:15:32.026431 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b20faf-ecf0-4b16-be52-5c1e62dfb49c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:15:32.090580 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b20faf-ecf0-4b16-be52-5c1e62dfb49c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:15:32.092006 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b20faf-ecf0-4b16-be52-5c1e62dfb49c None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:15:32.175696 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:15:32.186709 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 586/1183] 10.222.0.44 () {58 vars in 1282 bytes} [Thu Jun 16 12:15:31 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 16 12:15:32.192648 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f060f9c-768e-400c-9801-71d7133caa82 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:15:32.240445 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:15:32.288031 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f060f9c-768e-400c-9801-71d7133caa82 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:15:32.321317 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8d26ca-bf07-46f1-aa6d-7424269ec233 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:15:32.322147 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8d26ca-bf07-46f1-aa6d-7424269ec233 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:15:32.322424 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8d26ca-bf07-46f1-aa6d-7424269ec233 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:15:32.322693 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8d26ca-bf07-46f1-aa6d-7424269ec233 None admin] PATH_INFO: `/v3/projects/72fefca8c3794bcaa2a77af459bb881d` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:15:32.323852 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8d26ca-bf07-46f1-aa6d-7424269ec233 None admin] RBAC: Authorizing `identity:get_project(project_id=72fefca8c3794bcaa2a77af459bb881d)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:15:32.325314 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8d26ca-bf07-46f1-aa6d-7424269ec233 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:15:32.327549 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 598/1184] 10.222.0.44 () {56 vars in 1186 bytes} [Thu Jun 16 12:15:32 2022] GET /identity/v3/projects/72fefca8c3794bcaa2a77af459bb881d => generated 361 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:15:32.333551 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b20faf-ecf0-4b16-be52-5c1e62dfb49c None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:15:32.428717 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b20faf-ecf0-4b16-be52-5c1e62dfb49c None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:15:32.461380 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d49a1f7-0511-402b-94af-a37f3a57b65a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:15:32.462016 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d49a1f7-0511-402b-94af-a37f3a57b65a None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:15:32.462298 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d49a1f7-0511-402b-94af-a37f3a57b65a None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:15:32.462574 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d49a1f7-0511-402b-94af-a37f3a57b65a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:15:32.463397 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d49a1f7-0511-402b-94af-a37f3a57b65a None admin] RBAC: Adding query filter params (role.id=0688968254744e3f9913653cafea3091, scope.project.id=72fefca8c3794bcaa2a77af459bb881d, user.id=3818edc0de864debaf80858367d30e63) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:15:32.463709 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d49a1f7-0511-402b-94af-a37f3a57b65a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:15:32.465150 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d49a1f7-0511-402b-94af-a37f3a57b65a None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:15:32.470409 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 587/1185] 10.222.0.44 () {56 vars in 1374 bytes} [Thu Jun 16 12:15:32 2022] GET /identity/v3/role_assignments?user.id=3818edc0de864debaf80858367d30e63&scope.project.id=72fefca8c3794bcaa2a77af459bb881d&role.id=0688968254744e3f9913653cafea3091 => generated 259 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:15:34.535125 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c684a1-3453-45d1-aceb-18a6c4fb7370 None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:15:34.535648 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c684a1-3453-45d1-aceb-18a6c4fb7370 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:15:34.535755 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c684a1-3453-45d1-aceb-18a6c4fb7370 None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:15:34.537089 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 599/1186] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 12:15:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 12:15:34.542350 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dcc29d-ec8e-47e0-8dc1-db5d5191eb29 None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:15:34.542772 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dcc29d-ec8e-47e0-8dc1-db5d5191eb29 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:15:34.542897 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dcc29d-ec8e-47e0-8dc1-db5d5191eb29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:15:34.559138 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-56dcc29d-ec8e-47e0-8dc1-db5d5191eb29 None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:15:34.560845 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-56dcc29d-ec8e-47e0-8dc1-db5d5191eb29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:15:34.608313 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:15:34.625341 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 588/1187] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 12:15:34 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 12:15:34.647147 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c684a1-3453-45d1-aceb-18a6c4fb7370 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:15:34.745345 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c684a1-3453-45d1-aceb-18a6c4fb7370 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:15:34.762325 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:15:34.782766 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed87b5d3-c0d5-42bd-aeaa-9285a4261a30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:15:34.783551 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed87b5d3-c0d5-42bd-aeaa-9285a4261a30 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:15:34.783834 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed87b5d3-c0d5-42bd-aeaa-9285a4261a30 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:15:34.784109 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed87b5d3-c0d5-42bd-aeaa-9285a4261a30 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:15:34.794729 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed87b5d3-c0d5-42bd-aeaa-9285a4261a30 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 12:15:34.802550 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-ed87b5d3-c0d5-42bd-aeaa-9285a4261a30 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 12:15:34.802550 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 12:15:34.802550 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 12:15:34.802550 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 12:15:34.802550 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 12:15:34.802550 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 12:15:34.802550 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 12:15:34.802550 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 12:15:34.802550 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 12:15:34.802550 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 12:15:34.802550 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 12:15:34.802550 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 12:15:34.802550 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 12:15:34.802550 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 12:15:34.802550 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 12:15:34.802550 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 12:15:34.803636 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 12:15:34.803636 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 12:15:34.803636 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 12:15:34.803636 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 12:15:34.803636 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 12:15:34.803636 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 12:15:34.803636 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 12:15:34.803636 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 12:15:34.803636 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 12:15:34.803636 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 12:15:34.803636 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 12:15:34.803636 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jun 16 12:15:34.803636 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 12:15:34.803636 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jun 16 12:15:34.803636 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 12:15:34.803636 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 12:15:34.804664 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 12:15:34.804664 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jun 16 12:15:34.804664 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 12:15:34.804664 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jun 16 12:15:34.804664 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 12:15:34.804664 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 12:15:34.804664 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 12:15:34.804664 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 12:15:34.804664 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 12:15:34.804664 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 12:15:34.804664 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 12:15:34.804664 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jun 16 12:15:34.804664 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 600/1188] 10.222.0.44 () {56 vars in 1096 bytes} [Thu Jun 16 12:15:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 12:15:34.810676 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56dcc29d-ec8e-47e0-8dc1-db5d5191eb29 None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:15:34.904913 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56dcc29d-ec8e-47e0-8dc1-db5d5191eb29 None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:15:34.939794 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb9076f-73b0-4c3d-97b3-97212b2ac5bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:15:34.940454 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb9076f-73b0-4c3d-97b3-97212b2ac5bb None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:15:34.940732 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb9076f-73b0-4c3d-97b3-97212b2ac5bb None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:15:34.941029 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb9076f-73b0-4c3d-97b3-97212b2ac5bb None admin] PATH_INFO: `/v3/roles` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:15:34.941847 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb9076f-73b0-4c3d-97b3-97212b2ac5bb None admin] RBAC: Adding query filter params (name=admin) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:15:34.942202 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb9076f-73b0-4c3d-97b3-97212b2ac5bb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:15:34.943654 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb9076f-73b0-4c3d-97b3-97212b2ac5bb None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:15:34.951872 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 589/1189] 10.222.0.44 () {56 vars in 1099 bytes} [Thu Jun 16 12:15:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:15:34.957510 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed87b5d3-c0d5-42bd-aeaa-9285a4261a30 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:15:35.053570 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed87b5d3-c0d5-42bd-aeaa-9285a4261a30 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:15:35.084566 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6afece4-fb3b-4ddd-93c6-498c130690e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:15:35.085422 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6afece4-fb3b-4ddd-93c6-498c130690e8 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:15:35.085699 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6afece4-fb3b-4ddd-93c6-498c130690e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:15:35.085967 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6afece4-fb3b-4ddd-93c6-498c130690e8 None admin] PATH_INFO: `/v3/users/3818edc0de864debaf80858367d30e63` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:15:35.087124 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6afece4-fb3b-4ddd-93c6-498c130690e8 None admin] RBAC: Authorizing `identity:get_user(user_id=3818edc0de864debaf80858367d30e63)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:15:35.088530 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6afece4-fb3b-4ddd-93c6-498c130690e8 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:15:35.090131 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 601/1190] 10.222.0.44 () {56 vars in 1177 bytes} [Thu Jun 16 12:15:34 2022] GET /identity/v3/users/3818edc0de864debaf80858367d30e63 => generated 311 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:15:35.096117 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb9076f-73b0-4c3d-97b3-97212b2ac5bb None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:15:35.140641 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:15:35.191916 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb9076f-73b0-4c3d-97b3-97212b2ac5bb None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:15:35.224155 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2f902f-00d9-4080-8529-6459f801eb91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:15:35.225009 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2f902f-00d9-4080-8529-6459f801eb91 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:15:35.225284 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2f902f-00d9-4080-8529-6459f801eb91 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:15:35.225550 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2f902f-00d9-4080-8529-6459f801eb91 None admin] PATH_INFO: `/v3/projects/72fefca8c3794bcaa2a77af459bb881d` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:15:35.226707 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2f902f-00d9-4080-8529-6459f801eb91 None admin] RBAC: Authorizing `identity:get_project(project_id=72fefca8c3794bcaa2a77af459bb881d)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:15:35.228120 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2f902f-00d9-4080-8529-6459f801eb91 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:15:35.229779 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 590/1191] 10.222.0.44 () {56 vars in 1186 bytes} [Thu Jun 16 12:15:35 2022] GET /identity/v3/projects/72fefca8c3794bcaa2a77af459bb881d => generated 361 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:15:35.236120 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6afece4-fb3b-4ddd-93c6-498c130690e8 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:15:35.280704 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:15:35.332587 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6afece4-fb3b-4ddd-93c6-498c130690e8 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:15:35.365543 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22ed942-bb85-4107-be24-b8bbb7bc416f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:15:35.366414 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22ed942-bb85-4107-be24-b8bbb7bc416f None admin] REQUEST_METHOD: `PUT` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:15:35.366694 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22ed942-bb85-4107-be24-b8bbb7bc416f None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:15:35.366966 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22ed942-bb85-4107-be24-b8bbb7bc416f None admin] PATH_INFO: `/v3/projects/72fefca8c3794bcaa2a77af459bb881d/users/3818edc0de864debaf80858367d30e63/roles/0688968254744e3f9913653cafea3091` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:15:35.368914 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22ed942-bb85-4107-be24-b8bbb7bc416f None admin] RBAC: Authorizing `identity:create_grant(project_id=72fefca8c3794bcaa2a77af459bb881d, user_id=3818edc0de864debaf80858367d30e63, role_id=0688968254744e3f9913653cafea3091)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:15:35.370342 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22ed942-bb85-4107-be24-b8bbb7bc416f None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:15:35.382197 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 602/1192] 10.222.0.44 () {58 vars in 1439 bytes} [Thu Jun 16 12:15:35 2022] PUT /identity/v3/projects/72fefca8c3794bcaa2a77af459bb881d/users/3818edc0de864debaf80858367d30e63/roles/0688968254744e3f9913653cafea3091 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:15:37.446548 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850b8fed-eaf2-434f-884b-6174e6915f03 None None] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:15:37.447072 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850b8fed-eaf2-434f-884b-6174e6915f03 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:15:37.447188 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850b8fed-eaf2-434f-884b-6174e6915f03 None None] PATH_INFO: `/` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:15:37.448458 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 591/1193] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 12:15:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 12:15:37.454244 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80551d64-8886-4c91-ac29-eec9327942c5 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:15:37.454626 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80551d64-8886-4c91-ac29-eec9327942c5 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:15:37.454804 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80551d64-8886-4c91-ac29-eec9327942c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:15:37.471129 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-80551d64-8886-4c91-ac29-eec9327942c5 None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:15:37.472302 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-80551d64-8886-4c91-ac29-eec9327942c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:15:37.535076 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 603/1194] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 12:15:37 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 12:15:37.558299 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850b8fed-eaf2-434f-884b-6174e6915f03 None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:15:37.657127 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850b8fed-eaf2-434f-884b-6174e6915f03 None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:15:37.671333 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:15:37.691408 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85c8d2a-92d1-420b-9787-064eb0836171 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:15:37.692183 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85c8d2a-92d1-420b-9787-064eb0836171 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:15:37.692467 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85c8d2a-92d1-420b-9787-064eb0836171 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:15:37.692742 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85c8d2a-92d1-420b-9787-064eb0836171 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:15:37.702612 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85c8d2a-92d1-420b-9787-064eb0836171 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 12:15:37.710622 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application [None req-c85c8d2a-92d1-420b-9787-064eb0836171 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 12:15:37.710622 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 12:15:37.710622 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 12:15:37.710622 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 12:15:37.710622 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 12:15:37.710622 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 12:15:37.710622 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 12:15:37.710622 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 12:15:37.710622 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 12:15:37.710622 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 12:15:37.710622 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 12:15:37.710622 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 12:15:37.710622 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 12:15:37.710622 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 12:15:37.710622 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 12:15:37.710622 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 12:15:37.711709 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 12:15:37.711709 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 12:15:37.711709 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 12:15:37.711709 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 12:15:37.711709 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 12:15:37.711709 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 12:15:37.711709 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 12:15:37.711709 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 12:15:37.711709 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 12:15:37.711709 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 12:15:37.711709 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 12:15:37.711709 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application with Lock( Jun 16 12:15:37.711709 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 12:15:37.711709 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._enter() Jun 16 12:15:37.711709 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 12:15:37.711709 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 12:15:37.712855 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 12:15:37.712855 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.creator() Jun 16 12:15:37.712855 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 12:15:37.712855 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application created_value = creator( Jun 16 12:15:37.712855 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 12:15:37.712855 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 12:15:37.712855 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 12:15:37.712855 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 12:15:37.712855 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 12:15:37.712855 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 12:15:37.712855 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 12:15:37.712855 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application Jun 16 12:15:37.712855 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 592/1195] 10.222.0.44 () {56 vars in 1096 bytes} [Thu Jun 16 12:15:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 12:15:37.717791 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80551d64-8886-4c91-ac29-eec9327942c5 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:15:37.751345 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:15:37.813955 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80551d64-8886-4c91-ac29-eec9327942c5 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:15:37.845793 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac0027b-c967-4092-944d-178fc4b1d1ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:15:37.846437 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac0027b-c967-4092-944d-178fc4b1d1ad None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:15:37.846714 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac0027b-c967-4092-944d-178fc4b1d1ad None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:15:37.846986 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac0027b-c967-4092-944d-178fc4b1d1ad None admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:15:37.847720 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac0027b-c967-4092-944d-178fc4b1d1ad None admin] RBAC: Adding query filter params (name=admin) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:15:37.848051 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac0027b-c967-4092-944d-178fc4b1d1ad None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:15:37.849444 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac0027b-c967-4092-944d-178fc4b1d1ad None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:15:37.857761 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 604/1196] 10.222.0.44 () {56 vars in 1099 bytes} [Thu Jun 16 12:15:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:15:37.863602 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85c8d2a-92d1-420b-9787-064eb0836171 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:15:37.959430 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85c8d2a-92d1-420b-9787-064eb0836171 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:15:37.991712 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5f9b1f-dd78-4a66-b670-8c61d1a447a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:15:37.992557 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5f9b1f-dd78-4a66-b670-8c61d1a447a1 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:15:37.992854 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5f9b1f-dd78-4a66-b670-8c61d1a447a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:15:37.993126 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5f9b1f-dd78-4a66-b670-8c61d1a447a1 None admin] PATH_INFO: `/v3/users/3818edc0de864debaf80858367d30e63` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:15:37.994291 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5f9b1f-dd78-4a66-b670-8c61d1a447a1 None admin] RBAC: Authorizing `identity:get_user(user_id=3818edc0de864debaf80858367d30e63)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:15:37.995704 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5f9b1f-dd78-4a66-b670-8c61d1a447a1 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:15:37.997355 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 593/1197] 10.222.0.44 () {56 vars in 1177 bytes} [Thu Jun 16 12:15:37 2022] GET /identity/v3/users/3818edc0de864debaf80858367d30e63 => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:15:38.002931 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac0027b-c967-4092-944d-178fc4b1d1ad None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:15:38.094948 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:15:38.098731 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac0027b-c967-4092-944d-178fc4b1d1ad None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:15:38.130750 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4dae990-ebfe-44e9-9eca-3b6590d4bcba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:15:38.131373 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dae990-ebfe-44e9-9eca-3b6590d4bcba None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:15:38.131648 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dae990-ebfe-44e9-9eca-3b6590d4bcba None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:15:38.131917 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dae990-ebfe-44e9-9eca-3b6590d4bcba None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:15:38.195292 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4dae990-ebfe-44e9-9eca-3b6590d4bcba None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:15:38.196713 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4dae990-ebfe-44e9-9eca-3b6590d4bcba None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:15:38.284999 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:15:38.289940 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 605/1198] 10.222.0.44 () {58 vars in 1282 bytes} [Thu Jun 16 12:15:38 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 16 12:15:38.296043 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5f9b1f-dd78-4a66-b670-8c61d1a447a1 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:15:38.337177 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:15:38.392778 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5f9b1f-dd78-4a66-b670-8c61d1a447a1 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:15:38.425378 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b199c056-e497-4f32-b460-7e7c08f7e8ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:15:38.426205 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b199c056-e497-4f32-b460-7e7c08f7e8ab None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:15:38.426483 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b199c056-e497-4f32-b460-7e7c08f7e8ab None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:15:38.426749 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b199c056-e497-4f32-b460-7e7c08f7e8ab None admin] PATH_INFO: `/v3/projects/72fefca8c3794bcaa2a77af459bb881d` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:15:38.427909 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b199c056-e497-4f32-b460-7e7c08f7e8ab None admin] RBAC: Authorizing `identity:get_project(project_id=72fefca8c3794bcaa2a77af459bb881d)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:15:38.429368 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b199c056-e497-4f32-b460-7e7c08f7e8ab None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:15:38.431010 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 594/1199] 10.222.0.44 () {56 vars in 1186 bytes} [Thu Jun 16 12:15:38 2022] GET /identity/v3/projects/72fefca8c3794bcaa2a77af459bb881d => generated 361 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:15:38.436877 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4dae990-ebfe-44e9-9eca-3b6590d4bcba None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:15:38.532547 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4dae990-ebfe-44e9-9eca-3b6590d4bcba None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:15:38.565175 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a810936b-407e-4d9c-8b0a-6c87f720bfdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:15:38.565779 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a810936b-407e-4d9c-8b0a-6c87f720bfdf None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:15:38.566060 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a810936b-407e-4d9c-8b0a-6c87f720bfdf None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:15:38.566334 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a810936b-407e-4d9c-8b0a-6c87f720bfdf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:15:38.567187 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a810936b-407e-4d9c-8b0a-6c87f720bfdf None admin] RBAC: Adding query filter params (role.id=0688968254744e3f9913653cafea3091, scope.project.id=72fefca8c3794bcaa2a77af459bb881d, user.id=3818edc0de864debaf80858367d30e63) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:15:38.567495 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a810936b-407e-4d9c-8b0a-6c87f720bfdf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:15:38.568946 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a810936b-407e-4d9c-8b0a-6c87f720bfdf None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:15:38.574640 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 606/1200] 10.222.0.44 () {56 vars in 1374 bytes} [Thu Jun 16 12:15:38 2022] GET /identity/v3/role_assignments?user.id=3818edc0de864debaf80858367d30e63&scope.project.id=72fefca8c3794bcaa2a77af459bb881d&role.id=0688968254744e3f9913653cafea3091 => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 12:15:48.421346 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=45 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:15:48.572005 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=69 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:16:33.859471 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d3d1dc-4d79-46a8-919f-254845f6c722 None None] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:16:33.860072 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d3d1dc-4d79-46a8-919f-254845f6c722 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:16:33.860072 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d3d1dc-4d79-46a8-919f-254845f6c722 None None] PATH_INFO: `/` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:16:33.861605 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 595/1201] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 12:16:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 12:16:33.866634 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefb1c7e-edc2-4546-84b6-a7115b7a918c None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:16:33.867126 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefb1c7e-edc2-4546-84b6-a7115b7a918c None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:16:33.867234 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefb1c7e-edc2-4546-84b6-a7115b7a918c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:16:33.884499 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-aefb1c7e-edc2-4546-84b6-a7115b7a918c None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:16:33.885822 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-aefb1c7e-edc2-4546-84b6-a7115b7a918c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:16:33.975515 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 607/1202] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 12:16:33 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 12:16:34.002164 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d3d1dc-4d79-46a8-919f-254845f6c722 None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:16:34.125292 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d3d1dc-4d79-46a8-919f-254845f6c722 None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:16:34.171071 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d365d1-6924-4fad-b2c0-c9ae1a374862 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:16:34.171071 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d365d1-6924-4fad-b2c0-c9ae1a374862 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:16:34.171071 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d365d1-6924-4fad-b2c0-c9ae1a374862 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:16:34.171071 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d365d1-6924-4fad-b2c0-c9ae1a374862 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:16:34.183699 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d365d1-6924-4fad-b2c0-c9ae1a374862 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:16:34.185228 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d365d1-6924-4fad-b2c0-c9ae1a374862 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:16:34.208088 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application [None req-f3d365d1-6924-4fad-b2c0-c9ae1a374862 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 12:16:34.208088 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 12:16:34.208088 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 12:16:34.208088 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 12:16:34.208088 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 12:16:34.208088 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 12:16:34.208088 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 12:16:34.208088 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 12:16:34.208088 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 12:16:34.208088 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 12:16:34.208088 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 12:16:34.208088 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 12:16:34.208088 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 12:16:34.208088 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 12:16:34.208088 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 12:16:34.209158 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 12:16:34.209158 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 12:16:34.209158 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 12:16:34.209158 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 12:16:34.209158 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 12:16:34.209158 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 12:16:34.209158 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 12:16:34.209158 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 12:16:34.209158 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application with Lock( Jun 16 12:16:34.209158 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 12:16:34.209158 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._enter() Jun 16 12:16:34.209158 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 12:16:34.209158 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 12:16:34.209158 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 12:16:34.209158 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.creator() Jun 16 12:16:34.209158 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 12:16:34.209158 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application created_value = creator( Jun 16 12:16:34.219135 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 12:16:34.219135 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 12:16:34.219135 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 12:16:34.219135 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application Jun 16 12:16:34.219135 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 596/1203] 10.222.0.44 () {56 vars in 1108 bytes} [Thu Jun 16 12:16:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 12:16:34.219442 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefb1c7e-edc2-4546-84b6-a7115b7a918c None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:16:34.347804 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefb1c7e-edc2-4546-84b6-a7115b7a918c None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:16:34.384979 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:16:34.392529 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6603dea7-a029-4459-800e-9f15d6769ff9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:16:34.393484 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6603dea7-a029-4459-800e-9f15d6769ff9 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:16:34.393848 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6603dea7-a029-4459-800e-9f15d6769ff9 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:16:34.394013 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6603dea7-a029-4459-800e-9f15d6769ff9 None admin] PATH_INFO: `/v3/domains` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:16:34.394813 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6603dea7-a029-4459-800e-9f15d6769ff9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:16:34.395183 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6603dea7-a029-4459-800e-9f15d6769ff9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:16:34.396668 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6603dea7-a029-4459-800e-9f15d6769ff9 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:16:34.412332 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 608/1204] 10.222.0.44 () {56 vars in 1109 bytes} [Thu Jun 16 12:16:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:16:34.419437 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d365d1-6924-4fad-b2c0-c9ae1a374862 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:16:34.500790 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:16:34.561563 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d365d1-6924-4fad-b2c0-c9ae1a374862 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:16:34.612660 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458abc6e-3705-4492-a613-0f726d7f5308 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:16:34.613431 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458abc6e-3705-4492-a613-0f726d7f5308 None admin] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:16:34.613729 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458abc6e-3705-4492-a613-0f726d7f5308 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:16:34.614033 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458abc6e-3705-4492-a613-0f726d7f5308 None admin] PATH_INFO: `/v3/users` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:16:34.614845 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458abc6e-3705-4492-a613-0f726d7f5308 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:16:34.616262 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458abc6e-3705-4492-a613-0f726d7f5308 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:16:34.640870 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 597/1205] 10.222.0.44 () {60 vars in 1132 bytes} [Thu Jun 16 12:16:34 2022] POST /identity/v3/users => generated 251 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 12:16:36.912719 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9771c406-31ba-4fc7-b025-d2d076c7c998 None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:16:36.913354 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9771c406-31ba-4fc7-b025-d2d076c7c998 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:16:36.913354 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9771c406-31ba-4fc7-b025-d2d076c7c998 None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:16:36.915208 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 609/1206] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 12:16:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 12:16:36.921849 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c5a1ea-e7b1-4d4d-8d09-503964c812d1 None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:16:36.922320 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c5a1ea-e7b1-4d4d-8d09-503964c812d1 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:16:36.922893 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c5a1ea-e7b1-4d4d-8d09-503964c812d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:16:36.949727 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-76c5a1ea-e7b1-4d4d-8d09-503964c812d1 None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:16:36.951043 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-76c5a1ea-e7b1-4d4d-8d09-503964c812d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:16:37.026369 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 598/1207] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 12:16:36 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 12:16:37.060239 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9771c406-31ba-4fc7-b025-d2d076c7c998 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:16:37.185303 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9771c406-31ba-4fc7-b025-d2d076c7c998 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:16:37.224202 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc111bd-d925-43ec-bad2-e10d3b489a56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:16:37.224967 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc111bd-d925-43ec-bad2-e10d3b489a56 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:16:37.225242 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc111bd-d925-43ec-bad2-e10d3b489a56 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:16:37.225509 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc111bd-d925-43ec-bad2-e10d3b489a56 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:16:37.238344 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc111bd-d925-43ec-bad2-e10d3b489a56 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 12:16:37.246333 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-ccc111bd-d925-43ec-bad2-e10d3b489a56 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 16 12:16:37.246333 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 12:16:37.246333 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 12:16:37.246333 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 12:16:37.246333 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 12:16:37.246333 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 12:16:37.246333 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 12:16:37.246333 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 12:16:37.246333 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 12:16:37.246333 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 12:16:37.246333 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 12:16:37.246333 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 12:16:37.246333 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 12:16:37.246333 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 12:16:37.246333 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 12:16:37.246333 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 12:16:37.247796 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 12:16:37.247796 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 12:16:37.247796 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 12:16:37.247796 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 12:16:37.247796 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 12:16:37.247796 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 12:16:37.247796 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 12:16:37.247796 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 12:16:37.247796 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 12:16:37.247796 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 12:16:37.247796 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 12:16:37.247796 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jun 16 12:16:37.247796 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 12:16:37.247796 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jun 16 12:16:37.247796 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 12:16:37.247796 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 12:16:37.248986 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 12:16:37.248986 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jun 16 12:16:37.248986 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 12:16:37.248986 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jun 16 12:16:37.248986 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 12:16:37.248986 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 12:16:37.248986 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 12:16:37.248986 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 12:16:37.248986 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 12:16:37.248986 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 12:16:37.248986 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 16 12:16:37.248986 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jun 16 12:16:37.252780 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 610/1208] 10.222.0.44 () {56 vars in 1102 bytes} [Thu Jun 16 12:16:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 12:16:37.253604 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c5a1ea-e7b1-4d4d-8d09-503964c812d1 None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:16:37.298155 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:16:37.375346 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c5a1ea-e7b1-4d4d-8d09-503964c812d1 None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:16:37.415959 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74595474-8b85-4f57-b2dc-a0c7dabd3772 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:16:37.416893 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74595474-8b85-4f57-b2dc-a0c7dabd3772 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:16:37.417351 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74595474-8b85-4f57-b2dc-a0c7dabd3772 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:16:37.417622 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74595474-8b85-4f57-b2dc-a0c7dabd3772 None admin] PATH_INFO: `/v3/roles` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:16:37.418376 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74595474-8b85-4f57-b2dc-a0c7dabd3772 None admin] RBAC: Adding query filter params (name=service) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:16:37.418664 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74595474-8b85-4f57-b2dc-a0c7dabd3772 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:16:37.420032 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74595474-8b85-4f57-b2dc-a0c7dabd3772 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:16:37.428449 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 599/1209] 10.222.0.44 () {56 vars in 1103 bytes} [Thu Jun 16 12:16:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 12:16:37.435077 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc111bd-d925-43ec-bad2-e10d3b489a56 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:16:37.487718 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:16:37.543711 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc111bd-d925-43ec-bad2-e10d3b489a56 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:16:37.579454 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2dab70-53a3-4450-9874-a53d697dd443 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:16:37.580364 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2dab70-53a3-4450-9874-a53d697dd443 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:16:37.580711 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2dab70-53a3-4450-9874-a53d697dd443 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:16:37.581167 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2dab70-53a3-4450-9874-a53d697dd443 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:16:37.592261 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2dab70-53a3-4450-9874-a53d697dd443 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:16:37.593890 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2dab70-53a3-4450-9874-a53d697dd443 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:16:37.612562 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-8a2dab70-53a3-4450-9874-a53d697dd443 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 12:16:37.612562 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 12:16:37.612562 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 12:16:37.612562 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 12:16:37.612562 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 12:16:37.612562 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 12:16:37.612562 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 12:16:37.612562 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 12:16:37.612562 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 12:16:37.612562 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 12:16:37.612562 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 12:16:37.612562 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 12:16:37.612562 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 12:16:37.612562 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 12:16:37.612562 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 12:16:37.613784 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 12:16:37.613784 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 12:16:37.613784 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 12:16:37.613784 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 12:16:37.613784 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 12:16:37.613784 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 12:16:37.613784 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 12:16:37.613784 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 12:16:37.613784 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jun 16 12:16:37.613784 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 12:16:37.613784 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jun 16 12:16:37.613784 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 12:16:37.613784 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 12:16:37.613784 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 12:16:37.613784 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jun 16 12:16:37.613784 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 12:16:37.613784 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jun 16 12:16:37.614842 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 12:16:37.614842 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 12:16:37.614842 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 12:16:37.614842 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jun 16 12:16:37.614842 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 611/1210] 10.222.0.44 () {56 vars in 1108 bytes} [Thu Jun 16 12:16:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 12:16:37.619734 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74595474-8b85-4f57-b2dc-a0c7dabd3772 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:16:37.742337 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:16:37.745361 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74595474-8b85-4f57-b2dc-a0c7dabd3772 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:16:37.781941 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2091b58-df81-4fe3-a4dd-3e36df6db1ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:16:37.782633 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2091b58-df81-4fe3-a4dd-3e36df6db1ef None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:16:37.782906 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2091b58-df81-4fe3-a4dd-3e36df6db1ef None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:16:37.783183 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2091b58-df81-4fe3-a4dd-3e36df6db1ef None admin] PATH_INFO: `/v3/domains` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:16:37.783892 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2091b58-df81-4fe3-a4dd-3e36df6db1ef None admin] RBAC: Adding query filter params (name=Default) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:16:37.784203 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2091b58-df81-4fe3-a4dd-3e36df6db1ef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:16:37.785604 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2091b58-df81-4fe3-a4dd-3e36df6db1ef None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:16:37.800900 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 600/1211] 10.222.0.44 () {56 vars in 1109 bytes} [Thu Jun 16 12:16:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 12:16:37.803122 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2dab70-53a3-4450-9874-a53d697dd443 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:16:37.918325 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2dab70-53a3-4450-9874-a53d697dd443 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:16:37.919974 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:16:37.956363 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743a3180-ee9b-4532-b4fc-e94fd98c6411 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:16:37.957194 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743a3180-ee9b-4532-b4fc-e94fd98c6411 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:16:37.957472 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743a3180-ee9b-4532-b4fc-e94fd98c6411 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:16:37.957742 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743a3180-ee9b-4532-b4fc-e94fd98c6411 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:16:37.966643 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743a3180-ee9b-4532-b4fc-e94fd98c6411 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:16:37.968113 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743a3180-ee9b-4532-b4fc-e94fd98c6411 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:16:37.983184 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-743a3180-ee9b-4532-b4fc-e94fd98c6411 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 16 12:16:37.983184 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 12:16:37.983184 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 12:16:37.983184 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 12:16:37.983184 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 12:16:37.983184 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 12:16:37.983184 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 12:16:37.983184 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 12:16:37.983184 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 12:16:37.983184 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 12:16:37.983184 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 12:16:37.983184 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 12:16:37.983184 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 12:16:37.983184 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 12:16:37.983184 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 12:16:37.983184 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 12:16:37.984202 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 12:16:37.984202 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 12:16:37.984202 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 12:16:37.984202 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 12:16:37.984202 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 12:16:37.984202 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 12:16:37.984202 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 12:16:37.984202 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 12:16:37.984202 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 12:16:37.984202 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 12:16:37.984202 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 12:16:37.984202 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jun 16 12:16:37.984202 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 12:16:37.984202 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jun 16 12:16:37.984202 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 12:16:37.984202 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 12:16:37.984202 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 12:16:37.984202 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jun 16 12:16:37.989687 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 12:16:37.989687 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jun 16 12:16:37.989687 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 12:16:37.989687 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 12:16:37.989687 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 12:16:37.989687 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 12:16:37.989687 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 12:16:37.989687 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 12:16:37.989687 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 16 12:16:37.989687 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jun 16 12:16:37.989687 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 612/1212] 10.222.0.44 () {56 vars in 1108 bytes} [Thu Jun 16 12:16:37 2022] GET /identity/v3/users/placement => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 12:16:37.990307 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2091b58-df81-4fe3-a4dd-3e36df6db1ef None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:16:38.106186 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2091b58-df81-4fe3-a4dd-3e36df6db1ef None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:16:38.149130 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17485875-ffad-430e-8e3e-c9b1b062507a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:16:38.149771 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17485875-ffad-430e-8e3e-c9b1b062507a None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:16:38.150043 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17485875-ffad-430e-8e3e-c9b1b062507a None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:16:38.150341 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17485875-ffad-430e-8e3e-c9b1b062507a None admin] PATH_INFO: `/v3/users` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:16:38.151147 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17485875-ffad-430e-8e3e-c9b1b062507a None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:16:38.151444 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17485875-ffad-430e-8e3e-c9b1b062507a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:16:38.152874 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17485875-ffad-430e-8e3e-c9b1b062507a None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:16:38.172947 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 601/1213] 10.222.0.44 () {56 vars in 1143 bytes} [Thu Jun 16 12:16:37 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:16:38.177616 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743a3180-ee9b-4532-b4fc-e94fd98c6411 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:16:38.295728 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743a3180-ee9b-4532-b4fc-e94fd98c6411 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:16:38.334469 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9900052-f2b2-49d5-87bf-7bf615860acc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:16:38.335268 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9900052-f2b2-49d5-87bf-7bf615860acc None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:16:38.336152 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9900052-f2b2-49d5-87bf-7bf615860acc None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:16:38.336478 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9900052-f2b2-49d5-87bf-7bf615860acc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:16:38.377412 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:16:38.422687 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9900052-f2b2-49d5-87bf-7bf615860acc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:16:38.424382 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9900052-f2b2-49d5-87bf-7bf615860acc None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:16:38.540052 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 613/1214] 10.222.0.44 () {58 vars in 1282 bytes} [Thu Jun 16 12:16:38 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 16 12:16:38.546393 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17485875-ffad-430e-8e3e-c9b1b062507a None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:16:38.567243 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:16:38.653485 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17485875-ffad-430e-8e3e-c9b1b062507a None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:16:38.691632 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04963148-e5a2-4579-b7b5-0225eb83c22f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:16:38.692549 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04963148-e5a2-4579-b7b5-0225eb83c22f None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:16:38.692941 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04963148-e5a2-4579-b7b5-0225eb83c22f None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:16:38.693270 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04963148-e5a2-4579-b7b5-0225eb83c22f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:16:38.704994 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04963148-e5a2-4579-b7b5-0225eb83c22f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:16:38.706567 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04963148-e5a2-4579-b7b5-0225eb83c22f None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:16:38.726845 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application [None req-04963148-e5a2-4579-b7b5-0225eb83c22f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 12:16:38.726845 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 12:16:38.726845 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 12:16:38.726845 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 12:16:38.726845 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 12:16:38.726845 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 12:16:38.726845 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 12:16:38.726845 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 12:16:38.726845 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 12:16:38.726845 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 12:16:38.726845 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 12:16:38.726845 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 12:16:38.726845 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 12:16:38.726845 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 12:16:38.726845 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 12:16:38.728014 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 12:16:38.728014 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 12:16:38.728014 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 12:16:38.728014 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 12:16:38.728014 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 12:16:38.728014 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 12:16:38.728014 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 12:16:38.728014 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 12:16:38.728014 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application with Lock( Jun 16 12:16:38.728014 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 12:16:38.728014 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._enter() Jun 16 12:16:38.728014 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 12:16:38.728014 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 12:16:38.728014 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 12:16:38.728014 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.creator() Jun 16 12:16:38.728014 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 12:16:38.728014 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application created_value = creator( Jun 16 12:16:38.734160 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 12:16:38.734160 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 12:16:38.734160 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 12:16:38.734160 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application Jun 16 12:16:38.734160 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 602/1215] 10.222.0.44 () {56 vars in 1108 bytes} [Thu Jun 16 12:16:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 12:16:38.736282 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9900052-f2b2-49d5-87bf-7bf615860acc None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:16:38.811822 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:16:38.866250 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9900052-f2b2-49d5-87bf-7bf615860acc None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:16:38.904662 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7785323a-cc45-4b35-8fca-b7b301b25af3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:16:38.905030 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7785323a-cc45-4b35-8fca-b7b301b25af3 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:16:38.905421 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7785323a-cc45-4b35-8fca-b7b301b25af3 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:16:38.905648 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7785323a-cc45-4b35-8fca-b7b301b25af3 None admin] PATH_INFO: `/v3/domains` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:16:38.906461 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7785323a-cc45-4b35-8fca-b7b301b25af3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:16:38.906860 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7785323a-cc45-4b35-8fca-b7b301b25af3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:16:38.908419 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7785323a-cc45-4b35-8fca-b7b301b25af3 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:16:38.922243 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 614/1216] 10.222.0.44 () {56 vars in 1109 bytes} [Thu Jun 16 12:16:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:16:38.927961 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04963148-e5a2-4579-b7b5-0225eb83c22f None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:16:39.014442 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:16:39.053526 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04963148-e5a2-4579-b7b5-0225eb83c22f None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:16:39.096531 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0353fb0f-b38b-4926-b49b-f6c4ce0e9c86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:16:39.097483 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0353fb0f-b38b-4926-b49b-f6c4ce0e9c86 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:16:39.097863 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0353fb0f-b38b-4926-b49b-f6c4ce0e9c86 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:16:39.098234 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0353fb0f-b38b-4926-b49b-f6c4ce0e9c86 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:16:39.105621 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0353fb0f-b38b-4926-b49b-f6c4ce0e9c86 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:16:39.107154 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0353fb0f-b38b-4926-b49b-f6c4ce0e9c86 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:16:39.123271 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application [None req-0353fb0f-b38b-4926-b49b-f6c4ce0e9c86 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 12:16:39.123271 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 12:16:39.123271 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 12:16:39.123271 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 12:16:39.123271 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 12:16:39.123271 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 12:16:39.123271 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 12:16:39.123271 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 12:16:39.123271 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 12:16:39.123271 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 12:16:39.123271 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 12:16:39.123271 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 12:16:39.123271 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 12:16:39.123271 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 12:16:39.123271 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 12:16:39.124550 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 12:16:39.124550 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 12:16:39.124550 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 12:16:39.124550 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 12:16:39.124550 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 12:16:39.124550 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 12:16:39.124550 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 12:16:39.124550 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 12:16:39.124550 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application with Lock( Jun 16 12:16:39.124550 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 12:16:39.124550 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._enter() Jun 16 12:16:39.124550 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 12:16:39.124550 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 12:16:39.124550 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 12:16:39.124550 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.creator() Jun 16 12:16:39.124550 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 12:16:39.124550 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application created_value = creator( Jun 16 12:16:39.130279 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 12:16:39.130279 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 12:16:39.130279 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 12:16:39.130279 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 12:16:39.130279 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 12:16:39.130279 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 12:16:39.130279 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 12:16:39.130279 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application Jun 16 12:16:39.130279 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 603/1217] 10.222.0.44 () {56 vars in 1111 bytes} [Thu Jun 16 12:16:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 12:16:39.131910 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7785323a-cc45-4b35-8fca-b7b301b25af3 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:16:39.257704 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7785323a-cc45-4b35-8fca-b7b301b25af3 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:16:39.283392 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:16:39.299354 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a6cb9f-56e5-4dbb-bd7d-60ff26b648cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:16:39.300097 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a6cb9f-56e5-4dbb-bd7d-60ff26b648cd None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:16:39.300447 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a6cb9f-56e5-4dbb-bd7d-60ff26b648cd None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:16:39.300824 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a6cb9f-56e5-4dbb-bd7d-60ff26b648cd None admin] PATH_INFO: `/v3/projects` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:16:39.301682 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a6cb9f-56e5-4dbb-bd7d-60ff26b648cd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:16:39.302063 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a6cb9f-56e5-4dbb-bd7d-60ff26b648cd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:16:39.303568 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a6cb9f-56e5-4dbb-bd7d-60ff26b648cd None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:16:39.324366 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 615/1218] 10.222.0.44 () {56 vars in 1148 bytes} [Thu Jun 16 12:16:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:16:39.325894 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0353fb0f-b38b-4926-b49b-f6c4ce0e9c86 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:16:39.456220 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0353fb0f-b38b-4926-b49b-f6c4ce0e9c86 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:16:39.498248 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:16:39.506938 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00827d2-8342-45a2-992b-8758a234c941 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:16:39.508294 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00827d2-8342-45a2-992b-8758a234c941 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:16:39.508506 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00827d2-8342-45a2-992b-8758a234c941 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:16:39.508795 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00827d2-8342-45a2-992b-8758a234c941 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:16:39.509628 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00827d2-8342-45a2-992b-8758a234c941 None admin] RBAC: Adding query filter params (role.id=a5c06bc21d39451285def24673456ff6, scope.project.id=601361df39e34fcca71175aa94e425c4, user.id=8bff8ccf460a403d993c39327bbcbd29) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:16:39.509943 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00827d2-8342-45a2-992b-8758a234c941 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:16:39.511360 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00827d2-8342-45a2-992b-8758a234c941 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:16:39.527522 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 604/1219] 10.222.0.44 () {56 vars in 1374 bytes} [Thu Jun 16 12:16:39 2022] GET /identity/v3/role_assignments?user.id=8bff8ccf460a403d993c39327bbcbd29&scope.project.id=601361df39e34fcca71175aa94e425c4&role.id=a5c06bc21d39451285def24673456ff6 => generated 259 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:16:41.726999 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0a9783-bcc6-462e-b463-b49c6b4c6578 None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:16:41.727530 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0a9783-bcc6-462e-b463-b49c6b4c6578 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:16:41.727530 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0a9783-bcc6-462e-b463-b49c6b4c6578 None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:16:41.728942 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 616/1220] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 12:16:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 12:16:41.734502 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d192c4-877f-4dd7-b0c0-b0250f55c38d None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:16:41.734943 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d192c4-877f-4dd7-b0c0-b0250f55c38d None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:16:41.735069 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d192c4-877f-4dd7-b0c0-b0250f55c38d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:16:41.756091 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-b8d192c4-877f-4dd7-b0c0-b0250f55c38d None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:16:41.757787 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-b8d192c4-877f-4dd7-b0c0-b0250f55c38d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:16:41.829023 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 605/1221] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 12:16:41 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 12:16:41.853682 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0a9783-bcc6-462e-b463-b49c6b4c6578 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:16:41.963862 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0a9783-bcc6-462e-b463-b49c6b4c6578 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:16:41.998724 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf71ef8-f9fa-4ce8-9f17-21502cf9b2cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:16:41.999582 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf71ef8-f9fa-4ce8-9f17-21502cf9b2cb None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:16:41.999879 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf71ef8-f9fa-4ce8-9f17-21502cf9b2cb None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:16:42.000147 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf71ef8-f9fa-4ce8-9f17-21502cf9b2cb None admin] PATH_INFO: `/v3/roles/service` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:16:42.010677 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf71ef8-f9fa-4ce8-9f17-21502cf9b2cb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 12:16:42.018392 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-edf71ef8-f9fa-4ce8-9f17-21502cf9b2cb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 16 12:16:42.018392 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 12:16:42.018392 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 12:16:42.018392 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 12:16:42.018392 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 12:16:42.018392 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 12:16:42.018392 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 12:16:42.018392 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 12:16:42.018392 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 12:16:42.018392 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 12:16:42.018392 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 12:16:42.018392 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 12:16:42.018392 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 12:16:42.018392 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 12:16:42.018392 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 12:16:42.018392 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 12:16:42.019520 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 12:16:42.019520 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 12:16:42.019520 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 12:16:42.019520 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 12:16:42.019520 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 12:16:42.019520 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 12:16:42.019520 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 12:16:42.019520 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 12:16:42.019520 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 12:16:42.019520 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 12:16:42.019520 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 12:16:42.019520 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jun 16 12:16:42.019520 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 12:16:42.019520 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jun 16 12:16:42.019520 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 12:16:42.019520 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 12:16:42.020414 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 12:16:42.020414 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jun 16 12:16:42.020414 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 12:16:42.020414 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jun 16 12:16:42.020414 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 12:16:42.020414 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 12:16:42.020414 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 12:16:42.020414 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 12:16:42.020414 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 12:16:42.020414 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 12:16:42.020414 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 16 12:16:42.020414 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jun 16 12:16:42.020414 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 617/1222] 10.222.0.44 () {56 vars in 1102 bytes} [Thu Jun 16 12:16:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 12:16:42.026522 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d192c4-877f-4dd7-b0c0-b0250f55c38d None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:16:42.129637 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d192c4-877f-4dd7-b0c0-b0250f55c38d None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:16:42.155439 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:16:42.166554 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf6a3c3-1731-49b4-9426-f6d4e4c15f54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:16:42.167219 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf6a3c3-1731-49b4-9426-f6d4e4c15f54 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:16:42.167500 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf6a3c3-1731-49b4-9426-f6d4e4c15f54 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:16:42.167773 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf6a3c3-1731-49b4-9426-f6d4e4c15f54 None admin] PATH_INFO: `/v3/roles` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:16:42.168510 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf6a3c3-1731-49b4-9426-f6d4e4c15f54 None admin] RBAC: Adding query filter params (name=service) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:16:42.168915 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf6a3c3-1731-49b4-9426-f6d4e4c15f54 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:16:42.170291 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf6a3c3-1731-49b4-9426-f6d4e4c15f54 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:16:42.178453 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 606/1223] 10.222.0.44 () {56 vars in 1103 bytes} [Thu Jun 16 12:16:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:16:42.184040 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf71ef8-f9fa-4ce8-9f17-21502cf9b2cb None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:16:42.228911 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:16:42.288403 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf71ef8-f9fa-4ce8-9f17-21502cf9b2cb None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:16:42.323743 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f97c5a8-4317-428a-8a53-293e55da4186 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:16:42.324528 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f97c5a8-4317-428a-8a53-293e55da4186 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:16:42.324839 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f97c5a8-4317-428a-8a53-293e55da4186 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:16:42.325105 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f97c5a8-4317-428a-8a53-293e55da4186 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:16:42.337042 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f97c5a8-4317-428a-8a53-293e55da4186 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:16:42.338485 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f97c5a8-4317-428a-8a53-293e55da4186 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:16:42.357725 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-3f97c5a8-4317-428a-8a53-293e55da4186 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 12:16:42.357725 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 12:16:42.357725 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 12:16:42.357725 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 12:16:42.357725 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 12:16:42.357725 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 12:16:42.357725 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 12:16:42.357725 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 12:16:42.357725 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 12:16:42.357725 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 12:16:42.357725 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 12:16:42.357725 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 12:16:42.357725 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 12:16:42.357725 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 12:16:42.357725 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 12:16:42.358859 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 12:16:42.358859 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 12:16:42.358859 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 12:16:42.358859 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 12:16:42.358859 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 12:16:42.358859 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 12:16:42.358859 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 12:16:42.358859 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 12:16:42.358859 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jun 16 12:16:42.358859 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 12:16:42.358859 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jun 16 12:16:42.358859 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 12:16:42.358859 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 12:16:42.358859 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 12:16:42.358859 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jun 16 12:16:42.358859 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 12:16:42.358859 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jun 16 12:16:42.359795 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 12:16:42.359795 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 12:16:42.359795 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 12:16:42.359795 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jun 16 12:16:42.359795 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 618/1224] 10.222.0.44 () {56 vars in 1108 bytes} [Thu Jun 16 12:16:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 12:16:42.365117 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf6a3c3-1731-49b4-9426-f6d4e4c15f54 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:16:42.472038 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf6a3c3-1731-49b4-9426-f6d4e4c15f54 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:16:42.507681 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a3db8b-5fe8-45a8-94dc-cfa14f9bd2aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:16:42.508343 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a3db8b-5fe8-45a8-94dc-cfa14f9bd2aa None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:16:42.508656 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a3db8b-5fe8-45a8-94dc-cfa14f9bd2aa None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:16:42.508914 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a3db8b-5fe8-45a8-94dc-cfa14f9bd2aa None admin] PATH_INFO: `/v3/domains` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:16:42.509631 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a3db8b-5fe8-45a8-94dc-cfa14f9bd2aa None admin] RBAC: Adding query filter params (name=Default) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:16:42.509945 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a3db8b-5fe8-45a8-94dc-cfa14f9bd2aa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:16:42.511299 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a3db8b-5fe8-45a8-94dc-cfa14f9bd2aa None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:16:42.523124 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 607/1225] 10.222.0.44 () {56 vars in 1109 bytes} [Thu Jun 16 12:16:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:16:42.528901 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f97c5a8-4317-428a-8a53-293e55da4186 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:16:42.630164 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:16:42.637392 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f97c5a8-4317-428a-8a53-293e55da4186 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:16:42.673646 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e9e297-b6cd-4153-983a-6852fe6316ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:16:42.674444 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e9e297-b6cd-4153-983a-6852fe6316ed None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:16:42.674726 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e9e297-b6cd-4153-983a-6852fe6316ed None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:16:42.675009 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e9e297-b6cd-4153-983a-6852fe6316ed None admin] PATH_INFO: `/v3/users/placement` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:16:42.684584 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e9e297-b6cd-4153-983a-6852fe6316ed None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:16:42.686062 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e9e297-b6cd-4153-983a-6852fe6316ed None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:16:42.701499 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-f4e9e297-b6cd-4153-983a-6852fe6316ed None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 16 12:16:42.701499 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 12:16:42.701499 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 12:16:42.701499 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 12:16:42.701499 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 12:16:42.701499 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 12:16:42.701499 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 12:16:42.701499 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 12:16:42.701499 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 12:16:42.701499 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 12:16:42.701499 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 12:16:42.701499 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 12:16:42.701499 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 12:16:42.701499 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 12:16:42.701499 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 12:16:42.701499 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 12:16:42.702662 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 12:16:42.702662 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 12:16:42.702662 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 12:16:42.702662 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 12:16:42.702662 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 12:16:42.702662 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 12:16:42.702662 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 12:16:42.702662 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 12:16:42.702662 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 12:16:42.702662 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 12:16:42.702662 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 12:16:42.702662 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jun 16 12:16:42.702662 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 12:16:42.702662 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jun 16 12:16:42.702662 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 12:16:42.702662 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 12:16:42.702662 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 12:16:42.702662 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jun 16 12:16:42.703821 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 12:16:42.703821 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jun 16 12:16:42.703821 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 12:16:42.703821 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 12:16:42.703821 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 12:16:42.703821 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 12:16:42.703821 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 12:16:42.703821 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 12:16:42.703821 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 16 12:16:42.703821 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jun 16 12:16:42.703821 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 619/1226] 10.222.0.44 () {56 vars in 1108 bytes} [Thu Jun 16 12:16:42 2022] GET /identity/v3/users/placement => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 12:16:42.711294 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a3db8b-5fe8-45a8-94dc-cfa14f9bd2aa None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:16:42.765118 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:16:42.827562 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a3db8b-5fe8-45a8-94dc-cfa14f9bd2aa None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:16:42.863194 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ed7fd6-4527-46bb-ac94-9fa22a88dbeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:16:42.863867 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ed7fd6-4527-46bb-ac94-9fa22a88dbeb None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:16:42.864132 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ed7fd6-4527-46bb-ac94-9fa22a88dbeb None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:16:42.864406 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ed7fd6-4527-46bb-ac94-9fa22a88dbeb None admin] PATH_INFO: `/v3/users` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:16:42.865275 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ed7fd6-4527-46bb-ac94-9fa22a88dbeb None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:16:42.865582 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ed7fd6-4527-46bb-ac94-9fa22a88dbeb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:16:42.867025 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ed7fd6-4527-46bb-ac94-9fa22a88dbeb None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:16:42.885252 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 608/1227] 10.222.0.44 () {56 vars in 1143 bytes} [Thu Jun 16 12:16:42 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 12:16:42.890978 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e9e297-b6cd-4153-983a-6852fe6316ed None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:16:42.997335 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e9e297-b6cd-4153-983a-6852fe6316ed None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:16:43.035279 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee46c9cf-cc2e-4986-bc53-95763b96d406 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:16:43.036094 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee46c9cf-cc2e-4986-bc53-95763b96d406 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:16:43.036594 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee46c9cf-cc2e-4986-bc53-95763b96d406 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:16:43.036904 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee46c9cf-cc2e-4986-bc53-95763b96d406 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:16:43.047535 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee46c9cf-cc2e-4986-bc53-95763b96d406 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:16:43.049112 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee46c9cf-cc2e-4986-bc53-95763b96d406 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:16:43.066299 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-ee46c9cf-cc2e-4986-bc53-95763b96d406 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 12:16:43.066299 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 12:16:43.066299 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 12:16:43.066299 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 12:16:43.066299 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 12:16:43.066299 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 12:16:43.066299 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 12:16:43.066299 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 12:16:43.066299 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 12:16:43.066299 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 12:16:43.066299 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 12:16:43.066299 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 12:16:43.066299 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 12:16:43.066299 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 12:16:43.066299 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 12:16:43.067457 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 12:16:43.067457 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 12:16:43.067457 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 12:16:43.067457 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 12:16:43.067457 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 12:16:43.067457 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 12:16:43.067457 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 12:16:43.067457 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 12:16:43.067457 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jun 16 12:16:43.067457 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 12:16:43.067457 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jun 16 12:16:43.067457 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 12:16:43.067457 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 12:16:43.067457 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 12:16:43.067457 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jun 16 12:16:43.067457 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 12:16:43.067457 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jun 16 12:16:43.068537 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 12:16:43.068537 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 12:16:43.068537 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 12:16:43.068537 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jun 16 12:16:43.068537 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 620/1228] 10.222.0.44 () {56 vars in 1108 bytes} [Thu Jun 16 12:16:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 12:16:43.073876 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ed7fd6-4527-46bb-ac94-9fa22a88dbeb None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:16:43.182262 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ed7fd6-4527-46bb-ac94-9fa22a88dbeb None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:16:43.184790 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:16:43.224720 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2face86-986e-41f1-b2e9-d4537bfa8d84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:16:43.225479 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2face86-986e-41f1-b2e9-d4537bfa8d84 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:16:43.225839 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2face86-986e-41f1-b2e9-d4537bfa8d84 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:16:43.226100 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2face86-986e-41f1-b2e9-d4537bfa8d84 None admin] PATH_INFO: `/v3/domains` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:16:43.226909 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2face86-986e-41f1-b2e9-d4537bfa8d84 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:16:43.227220 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2face86-986e-41f1-b2e9-d4537bfa8d84 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:16:43.228766 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2face86-986e-41f1-b2e9-d4537bfa8d84 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:16:43.243386 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 609/1229] 10.222.0.44 () {56 vars in 1109 bytes} [Thu Jun 16 12:16:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 12:16:43.249635 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee46c9cf-cc2e-4986-bc53-95763b96d406 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:16:43.260886 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:16:43.367989 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee46c9cf-cc2e-4986-bc53-95763b96d406 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:16:43.407517 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51c94e7-3c1a-4e47-87c2-ef76aeafa969 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:16:43.408307 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51c94e7-3c1a-4e47-87c2-ef76aeafa969 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:16:43.408582 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51c94e7-3c1a-4e47-87c2-ef76aeafa969 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:16:43.408883 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51c94e7-3c1a-4e47-87c2-ef76aeafa969 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:16:43.416689 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51c94e7-3c1a-4e47-87c2-ef76aeafa969 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:16:43.418346 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51c94e7-3c1a-4e47-87c2-ef76aeafa969 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:16:43.434571 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-f51c94e7-3c1a-4e47-87c2-ef76aeafa969 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 12:16:43.434571 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 12:16:43.434571 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 12:16:43.434571 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 12:16:43.434571 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 12:16:43.434571 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 12:16:43.434571 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 12:16:43.434571 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 12:16:43.434571 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 12:16:43.434571 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 12:16:43.434571 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 12:16:43.434571 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 12:16:43.434571 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 12:16:43.434571 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 12:16:43.434571 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 12:16:43.435515 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 12:16:43.435515 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 12:16:43.435515 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 12:16:43.435515 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 12:16:43.435515 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 12:16:43.435515 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 12:16:43.435515 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 12:16:43.435515 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 12:16:43.435515 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jun 16 12:16:43.435515 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 12:16:43.435515 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jun 16 12:16:43.435515 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 12:16:43.435515 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 12:16:43.435515 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 12:16:43.435515 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jun 16 12:16:43.435515 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 12:16:43.435515 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jun 16 12:16:43.436499 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 12:16:43.436499 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 12:16:43.436499 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 12:16:43.436499 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 12:16:43.436499 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 12:16:43.436499 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 12:16:43.436499 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 12:16:43.436499 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jun 16 12:16:43.436499 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 621/1230] 10.222.0.44 () {56 vars in 1111 bytes} [Thu Jun 16 12:16:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 12:16:43.441836 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2face86-986e-41f1-b2e9-d4537bfa8d84 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:16:43.548001 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2face86-986e-41f1-b2e9-d4537bfa8d84 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:16:43.588431 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c4e558-8b40-417c-bb3e-207ad2399b76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:16:43.589127 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c4e558-8b40-417c-bb3e-207ad2399b76 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:16:43.589406 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c4e558-8b40-417c-bb3e-207ad2399b76 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:16:43.589683 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c4e558-8b40-417c-bb3e-207ad2399b76 None admin] PATH_INFO: `/v3/projects` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:16:43.590566 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c4e558-8b40-417c-bb3e-207ad2399b76 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:16:43.590911 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c4e558-8b40-417c-bb3e-207ad2399b76 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:16:43.592685 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c4e558-8b40-417c-bb3e-207ad2399b76 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:16:43.606199 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 610/1231] 10.222.0.44 () {56 vars in 1148 bytes} [Thu Jun 16 12:16:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:16:43.612295 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51c94e7-3c1a-4e47-87c2-ef76aeafa969 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:16:43.684970 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:16:43.727254 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51c94e7-3c1a-4e47-87c2-ef76aeafa969 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:16:43.774206 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17d7459-1c83-4eee-a6da-2944c3dbc513 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:16:43.775320 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17d7459-1c83-4eee-a6da-2944c3dbc513 None admin] REQUEST_METHOD: `PUT` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:16:43.775617 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17d7459-1c83-4eee-a6da-2944c3dbc513 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:16:43.776004 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17d7459-1c83-4eee-a6da-2944c3dbc513 None admin] PATH_INFO: `/v3/projects/601361df39e34fcca71175aa94e425c4/users/8bff8ccf460a403d993c39327bbcbd29/roles/a5c06bc21d39451285def24673456ff6` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:16:43.792104 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17d7459-1c83-4eee-a6da-2944c3dbc513 None admin] RBAC: Authorizing `identity:create_grant(project_id=601361df39e34fcca71175aa94e425c4, user_id=8bff8ccf460a403d993c39327bbcbd29, role_id=a5c06bc21d39451285def24673456ff6)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:16:43.793749 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17d7459-1c83-4eee-a6da-2944c3dbc513 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:16:43.807154 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 622/1232] 10.222.0.44 () {58 vars in 1439 bytes} [Thu Jun 16 12:16:43 2022] PUT /identity/v3/projects/601361df39e34fcca71175aa94e425c4/users/8bff8ccf460a403d993c39327bbcbd29/roles/a5c06bc21d39451285def24673456ff6 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:16:45.917650 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9fff6c-8a48-4bca-8583-209ff923b0e8 None None] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:16:45.918200 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9fff6c-8a48-4bca-8583-209ff923b0e8 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:16:45.918200 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9fff6c-8a48-4bca-8583-209ff923b0e8 None None] PATH_INFO: `/` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:16:45.919805 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 611/1233] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 12:16:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 12:16:45.925432 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb30e724-661b-4d5f-b7ae-6e3518e77d29 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:16:45.925864 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb30e724-661b-4d5f-b7ae-6e3518e77d29 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:16:45.926054 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb30e724-661b-4d5f-b7ae-6e3518e77d29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:16:45.945391 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-eb30e724-661b-4d5f-b7ae-6e3518e77d29 None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:16:45.946576 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-eb30e724-661b-4d5f-b7ae-6e3518e77d29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:16:46.014528 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 623/1234] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 12:16:45 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 12:16:46.038542 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9fff6c-8a48-4bca-8583-209ff923b0e8 None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:16:46.066385 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:16:46.150464 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9fff6c-8a48-4bca-8583-209ff923b0e8 None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:16:46.189754 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7505cf1e-90aa-4ac9-b8c2-3acc0b931b6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:16:46.190460 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7505cf1e-90aa-4ac9-b8c2-3acc0b931b6a None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:16:46.190739 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7505cf1e-90aa-4ac9-b8c2-3acc0b931b6a None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:16:46.191008 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7505cf1e-90aa-4ac9-b8c2-3acc0b931b6a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:16:46.201472 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7505cf1e-90aa-4ac9-b8c2-3acc0b931b6a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 12:16:46.209119 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application [None req-7505cf1e-90aa-4ac9-b8c2-3acc0b931b6a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 16 12:16:46.209119 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 12:16:46.209119 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 12:16:46.209119 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 12:16:46.209119 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 12:16:46.209119 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 12:16:46.209119 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 12:16:46.209119 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 12:16:46.209119 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 12:16:46.209119 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 12:16:46.209119 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 12:16:46.209119 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 12:16:46.209119 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 12:16:46.209119 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 12:16:46.209119 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 12:16:46.209119 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 12:16:46.210634 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 12:16:46.210634 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 12:16:46.210634 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 12:16:46.210634 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 12:16:46.210634 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 12:16:46.210634 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 12:16:46.210634 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 12:16:46.210634 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 12:16:46.210634 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 12:16:46.210634 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 12:16:46.210634 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 12:16:46.210634 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application with Lock( Jun 16 12:16:46.210634 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 12:16:46.210634 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._enter() Jun 16 12:16:46.210634 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 12:16:46.210634 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 12:16:46.211463 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 12:16:46.211463 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.creator() Jun 16 12:16:46.211463 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 12:16:46.211463 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application created_value = creator( Jun 16 12:16:46.211463 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 12:16:46.211463 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 12:16:46.211463 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 12:16:46.211463 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 12:16:46.211463 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 12:16:46.211463 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 12:16:46.211463 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 16 12:16:46.211463 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application Jun 16 12:16:46.211463 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 612/1235] 10.222.0.44 () {56 vars in 1102 bytes} [Thu Jun 16 12:16:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 12:16:46.216879 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb30e724-661b-4d5f-b7ae-6e3518e77d29 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:16:46.266082 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:16:46.330293 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb30e724-661b-4d5f-b7ae-6e3518e77d29 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:16:46.368454 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df5194b-d7f0-4959-a80f-7adcbb4fa99d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:16:46.369216 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df5194b-d7f0-4959-a80f-7adcbb4fa99d None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:16:46.369445 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df5194b-d7f0-4959-a80f-7adcbb4fa99d None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:16:46.369718 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df5194b-d7f0-4959-a80f-7adcbb4fa99d None admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:16:46.370486 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df5194b-d7f0-4959-a80f-7adcbb4fa99d None admin] RBAC: Adding query filter params (name=service) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:16:46.370772 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df5194b-d7f0-4959-a80f-7adcbb4fa99d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:16:46.372150 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df5194b-d7f0-4959-a80f-7adcbb4fa99d None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:16:46.380941 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 624/1236] 10.222.0.44 () {56 vars in 1103 bytes} [Thu Jun 16 12:16:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 12:16:46.386641 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7505cf1e-90aa-4ac9-b8c2-3acc0b931b6a None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:16:46.475036 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:16:46.493406 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7505cf1e-90aa-4ac9-b8c2-3acc0b931b6a None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:16:46.532567 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db7caeb-ba79-4b42-b5c4-59a30ac56991 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:16:46.533387 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db7caeb-ba79-4b42-b5c4-59a30ac56991 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:16:46.533669 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db7caeb-ba79-4b42-b5c4-59a30ac56991 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:16:46.533947 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db7caeb-ba79-4b42-b5c4-59a30ac56991 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:16:46.545705 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db7caeb-ba79-4b42-b5c4-59a30ac56991 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:16:46.547126 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db7caeb-ba79-4b42-b5c4-59a30ac56991 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:16:46.567188 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application [None req-9db7caeb-ba79-4b42-b5c4-59a30ac56991 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 12:16:46.567188 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 12:16:46.567188 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 12:16:46.567188 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 12:16:46.567188 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 12:16:46.567188 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 12:16:46.567188 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 12:16:46.567188 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 12:16:46.567188 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 12:16:46.567188 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 12:16:46.567188 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 12:16:46.567188 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 12:16:46.567188 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 12:16:46.567188 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 12:16:46.567188 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 12:16:46.568478 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 12:16:46.568478 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 12:16:46.568478 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 12:16:46.568478 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 12:16:46.568478 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 12:16:46.568478 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 12:16:46.568478 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 12:16:46.568478 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 12:16:46.568478 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application with Lock( Jun 16 12:16:46.568478 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 12:16:46.568478 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._enter() Jun 16 12:16:46.568478 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 12:16:46.568478 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 12:16:46.568478 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 12:16:46.568478 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.creator() Jun 16 12:16:46.568478 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 12:16:46.568478 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application created_value = creator( Jun 16 12:16:46.569961 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 12:16:46.569961 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 12:16:46.569961 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 12:16:46.569961 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application Jun 16 12:16:46.569961 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 613/1237] 10.222.0.44 () {56 vars in 1108 bytes} [Thu Jun 16 12:16:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 12:16:46.574191 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df5194b-d7f0-4959-a80f-7adcbb4fa99d None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:16:46.681635 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df5194b-d7f0-4959-a80f-7adcbb4fa99d None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:16:46.692609 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:16:46.725197 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86996236-4e0b-4e93-a201-8727b6788b59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:16:46.725782 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86996236-4e0b-4e93-a201-8727b6788b59 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:16:46.726152 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86996236-4e0b-4e93-a201-8727b6788b59 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:16:46.726497 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86996236-4e0b-4e93-a201-8727b6788b59 None admin] PATH_INFO: `/v3/domains` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:16:46.727612 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86996236-4e0b-4e93-a201-8727b6788b59 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:16:46.728118 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86996236-4e0b-4e93-a201-8727b6788b59 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:16:46.729883 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86996236-4e0b-4e93-a201-8727b6788b59 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:16:46.746652 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 625/1238] 10.222.0.44 () {56 vars in 1109 bytes} [Thu Jun 16 12:16:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:16:46.752370 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db7caeb-ba79-4b42-b5c4-59a30ac56991 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:16:46.864324 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db7caeb-ba79-4b42-b5c4-59a30ac56991 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:16:46.899695 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460d03fe-b051-48e6-9a99-de697f66dda5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:16:46.900619 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460d03fe-b051-48e6-9a99-de697f66dda5 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:16:46.901029 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460d03fe-b051-48e6-9a99-de697f66dda5 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:16:46.901366 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460d03fe-b051-48e6-9a99-de697f66dda5 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:16:46.904739 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:16:46.911613 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460d03fe-b051-48e6-9a99-de697f66dda5 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:16:46.913356 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460d03fe-b051-48e6-9a99-de697f66dda5 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:16:46.928109 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application [None req-460d03fe-b051-48e6-9a99-de697f66dda5 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 16 12:16:46.928109 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 12:16:46.928109 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 12:16:46.928109 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 12:16:46.928109 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 12:16:46.928109 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 12:16:46.928109 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 12:16:46.928109 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 12:16:46.928109 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 12:16:46.928109 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 12:16:46.928109 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 12:16:46.928109 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 12:16:46.928109 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 12:16:46.928109 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 12:16:46.928109 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 12:16:46.928109 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 12:16:46.929586 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 12:16:46.929586 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 12:16:46.929586 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 12:16:46.929586 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 12:16:46.929586 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 12:16:46.929586 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 12:16:46.929586 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 12:16:46.929586 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 12:16:46.929586 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 12:16:46.929586 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 12:16:46.929586 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 12:16:46.929586 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application with Lock( Jun 16 12:16:46.929586 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 12:16:46.929586 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._enter() Jun 16 12:16:46.929586 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 12:16:46.929586 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 12:16:46.929586 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 12:16:46.929586 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.creator() Jun 16 12:16:46.930504 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 12:16:46.930504 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application created_value = creator( Jun 16 12:16:46.930504 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 12:16:46.930504 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 12:16:46.930504 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 12:16:46.930504 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 12:16:46.930504 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 12:16:46.930504 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 12:16:46.930504 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 16 12:16:46.930504 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application Jun 16 12:16:46.930504 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 614/1239] 10.222.0.44 () {56 vars in 1108 bytes} [Thu Jun 16 12:16:46 2022] GET /identity/v3/users/placement => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 12:16:46.935614 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86996236-4e0b-4e93-a201-8727b6788b59 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:16:47.045308 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86996236-4e0b-4e93-a201-8727b6788b59 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:16:47.086783 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa818658-e286-4cb0-97ac-8ff89ada3f04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:16:47.087450 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa818658-e286-4cb0-97ac-8ff89ada3f04 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:16:47.087725 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa818658-e286-4cb0-97ac-8ff89ada3f04 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:16:47.087993 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa818658-e286-4cb0-97ac-8ff89ada3f04 None admin] PATH_INFO: `/v3/users` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:16:47.088883 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa818658-e286-4cb0-97ac-8ff89ada3f04 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:16:47.089169 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa818658-e286-4cb0-97ac-8ff89ada3f04 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:16:47.090690 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa818658-e286-4cb0-97ac-8ff89ada3f04 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:16:47.109688 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 626/1240] 10.222.0.44 () {56 vars in 1143 bytes} [Thu Jun 16 12:16:46 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:16:47.115786 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460d03fe-b051-48e6-9a99-de697f66dda5 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:16:47.230105 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460d03fe-b051-48e6-9a99-de697f66dda5 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:16:47.272055 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfc157b-790a-4d30-bf1e-b52c6bfc0c74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:16:47.272734 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfc157b-790a-4d30-bf1e-b52c6bfc0c74 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:16:47.273051 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfc157b-790a-4d30-bf1e-b52c6bfc0c74 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:16:47.273319 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfc157b-790a-4d30-bf1e-b52c6bfc0c74 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:16:47.346450 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:16:47.355192 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfc157b-790a-4d30-bf1e-b52c6bfc0c74 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:16:47.356725 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfc157b-790a-4d30-bf1e-b52c6bfc0c74 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:16:47.462459 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 615/1241] 10.222.0.44 () {58 vars in 1282 bytes} [Thu Jun 16 12:16:47 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 16 12:16:47.469168 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa818658-e286-4cb0-97ac-8ff89ada3f04 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:16:47.499985 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:16:47.572772 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa818658-e286-4cb0-97ac-8ff89ada3f04 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:16:47.607631 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a55b810-cbd0-4a18-acb3-4faddea88d74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:16:47.608344 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a55b810-cbd0-4a18-acb3-4faddea88d74 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:16:47.608622 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a55b810-cbd0-4a18-acb3-4faddea88d74 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:16:47.608929 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a55b810-cbd0-4a18-acb3-4faddea88d74 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:16:47.619930 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a55b810-cbd0-4a18-acb3-4faddea88d74 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:16:47.621629 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a55b810-cbd0-4a18-acb3-4faddea88d74 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:16:47.639911 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-9a55b810-cbd0-4a18-acb3-4faddea88d74 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 12:16:47.639911 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 12:16:47.639911 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 12:16:47.639911 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 12:16:47.639911 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 12:16:47.639911 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 12:16:47.639911 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 12:16:47.639911 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 12:16:47.639911 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 12:16:47.639911 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 12:16:47.639911 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 12:16:47.639911 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 12:16:47.639911 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 12:16:47.639911 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 12:16:47.639911 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 12:16:47.640998 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 12:16:47.640998 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 12:16:47.640998 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 12:16:47.640998 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 12:16:47.640998 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 12:16:47.640998 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 12:16:47.640998 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 12:16:47.640998 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 12:16:47.640998 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jun 16 12:16:47.640998 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 12:16:47.640998 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jun 16 12:16:47.640998 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 12:16:47.640998 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 12:16:47.640998 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 12:16:47.640998 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jun 16 12:16:47.640998 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 12:16:47.640998 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jun 16 12:16:47.641892 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 12:16:47.641892 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 12:16:47.641892 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 12:16:47.641892 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jun 16 12:16:47.641892 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 627/1242] 10.222.0.44 () {56 vars in 1108 bytes} [Thu Jun 16 12:16:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 12:16:47.646743 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfc157b-790a-4d30-bf1e-b52c6bfc0c74 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:16:47.755193 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:16:47.763035 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfc157b-790a-4d30-bf1e-b52c6bfc0c74 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:16:47.801509 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de36622b-e7cb-4110-88d5-c6747002ce0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:16:47.802174 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de36622b-e7cb-4110-88d5-c6747002ce0d None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:16:47.802446 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de36622b-e7cb-4110-88d5-c6747002ce0d None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:16:47.805001 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de36622b-e7cb-4110-88d5-c6747002ce0d None admin] PATH_INFO: `/v3/domains` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:16:47.805766 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de36622b-e7cb-4110-88d5-c6747002ce0d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:16:47.806081 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de36622b-e7cb-4110-88d5-c6747002ce0d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:16:47.807465 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de36622b-e7cb-4110-88d5-c6747002ce0d None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:16:47.822262 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 616/1243] 10.222.0.44 () {56 vars in 1109 bytes} [Thu Jun 16 12:16:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:16:47.827832 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a55b810-cbd0-4a18-acb3-4faddea88d74 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:16:47.918772 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:16:47.948421 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a55b810-cbd0-4a18-acb3-4faddea88d74 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:16:47.986239 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78be82d2-0af4-4f50-9a74-718a1a6efadd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:16:47.987118 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78be82d2-0af4-4f50-9a74-718a1a6efadd None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:16:47.987427 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78be82d2-0af4-4f50-9a74-718a1a6efadd None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:16:47.987771 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78be82d2-0af4-4f50-9a74-718a1a6efadd None admin] PATH_INFO: `/v3/projects/service` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:16:47.995279 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78be82d2-0af4-4f50-9a74-718a1a6efadd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:16:47.997018 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78be82d2-0af4-4f50-9a74-718a1a6efadd None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:16:48.014267 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-78be82d2-0af4-4f50-9a74-718a1a6efadd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 12:16:48.014267 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 12:16:48.014267 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 12:16:48.014267 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 12:16:48.014267 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 12:16:48.014267 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 12:16:48.014267 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 12:16:48.014267 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 12:16:48.014267 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 12:16:48.014267 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 12:16:48.014267 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 12:16:48.014267 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 12:16:48.014267 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 12:16:48.014267 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 12:16:48.014267 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 12:16:48.015543 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 12:16:48.015543 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 12:16:48.015543 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 12:16:48.015543 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 12:16:48.015543 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 12:16:48.015543 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 12:16:48.015543 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 12:16:48.015543 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 12:16:48.015543 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jun 16 12:16:48.015543 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 12:16:48.015543 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jun 16 12:16:48.015543 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 12:16:48.015543 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 12:16:48.015543 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 12:16:48.015543 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jun 16 12:16:48.015543 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 12:16:48.015543 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jun 16 12:16:48.016580 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 12:16:48.016580 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 12:16:48.016580 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 12:16:48.016580 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 12:16:48.016580 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 12:16:48.016580 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 12:16:48.016580 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 12:16:48.016580 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jun 16 12:16:48.016580 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 628/1244] 10.222.0.44 () {56 vars in 1111 bytes} [Thu Jun 16 12:16:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 12:16:48.022387 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de36622b-e7cb-4110-88d5-c6747002ce0d None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:16:48.144407 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de36622b-e7cb-4110-88d5-c6747002ce0d None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:16:48.183093 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb86ceb-4e1e-4d6a-89a1-a4becd2bf28a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:16:48.183664 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb86ceb-4e1e-4d6a-89a1-a4becd2bf28a None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:16:48.183939 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb86ceb-4e1e-4d6a-89a1-a4becd2bf28a None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:16:48.184210 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb86ceb-4e1e-4d6a-89a1-a4becd2bf28a None admin] PATH_INFO: `/v3/projects` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:16:48.185018 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb86ceb-4e1e-4d6a-89a1-a4becd2bf28a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:16:48.185323 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb86ceb-4e1e-4d6a-89a1-a4becd2bf28a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:16:48.186791 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb86ceb-4e1e-4d6a-89a1-a4becd2bf28a None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:16:48.199973 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 617/1245] 10.222.0.44 () {56 vars in 1148 bytes} [Thu Jun 16 12:16:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:16:48.205965 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78be82d2-0af4-4f50-9a74-718a1a6efadd None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:16:48.314344 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78be82d2-0af4-4f50-9a74-718a1a6efadd None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:16:48.349688 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3186b08-adc1-4d48-bf34-17aa390b0d0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:16:48.350346 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3186b08-adc1-4d48-bf34-17aa390b0d0d None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:16:48.350625 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3186b08-adc1-4d48-bf34-17aa390b0d0d None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:16:48.350896 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3186b08-adc1-4d48-bf34-17aa390b0d0d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:16:48.351725 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3186b08-adc1-4d48-bf34-17aa390b0d0d None admin] RBAC: Adding query filter params (role.id=a5c06bc21d39451285def24673456ff6, scope.project.id=601361df39e34fcca71175aa94e425c4, user.id=8bff8ccf460a403d993c39327bbcbd29) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:16:48.352035 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3186b08-adc1-4d48-bf34-17aa390b0d0d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:16:48.353496 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3186b08-adc1-4d48-bf34-17aa390b0d0d None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:16:48.359940 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 629/1246] 10.222.0.44 () {56 vars in 1374 bytes} [Thu Jun 16 12:16:48 2022] GET /identity/v3/role_assignments?user.id=8bff8ccf460a403d993c39327bbcbd29&scope.project.id=601361df39e34fcca71175aa94e425c4&role.id=a5c06bc21d39451285def24673456ff6 => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 12:16:50.888723 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1cbf12-274e-4037-b474-1871b123195e None None] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:16:50.889294 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1cbf12-274e-4037-b474-1871b123195e None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:16:50.889294 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1cbf12-274e-4037-b474-1871b123195e None None] PATH_INFO: `/` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:16:50.890814 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 618/1247] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 12:16:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 12:16:50.898789 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f565a6-638e-40f9-9445-a2c5200eee90 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:16:50.898789 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f565a6-638e-40f9-9445-a2c5200eee90 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:16:50.898789 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f565a6-638e-40f9-9445-a2c5200eee90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:16:50.902595 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:16:50.915566 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-15f565a6-638e-40f9-9445-a2c5200eee90 None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:16:50.916740 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-15f565a6-638e-40f9-9445-a2c5200eee90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:16:50.992107 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 630/1248] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 12:16:50 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 12:16:51.023768 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1cbf12-274e-4037-b474-1871b123195e None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:16:51.043536 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:16:51.129589 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1cbf12-274e-4037-b474-1871b123195e None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:16:51.166732 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf90a881-43f2-48e0-a2e3-06289eb9658b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:16:51.167425 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf90a881-43f2-48e0-a2e3-06289eb9658b None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:16:51.167709 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf90a881-43f2-48e0-a2e3-06289eb9658b None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:16:51.167983 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf90a881-43f2-48e0-a2e3-06289eb9658b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:16:51.178719 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf90a881-43f2-48e0-a2e3-06289eb9658b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 12:16:51.186952 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application [None req-cf90a881-43f2-48e0-a2e3-06289eb9658b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 12:16:51.186952 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 12:16:51.186952 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 12:16:51.186952 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 12:16:51.186952 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 12:16:51.186952 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 12:16:51.186952 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 12:16:51.186952 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 12:16:51.186952 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 12:16:51.186952 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 12:16:51.186952 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 12:16:51.186952 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 12:16:51.186952 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 12:16:51.186952 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 12:16:51.186952 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 12:16:51.186952 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 12:16:51.188120 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 12:16:51.188120 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 12:16:51.188120 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 12:16:51.188120 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 12:16:51.188120 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 12:16:51.188120 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 12:16:51.188120 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 12:16:51.188120 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 12:16:51.188120 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 12:16:51.188120 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 12:16:51.188120 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 12:16:51.188120 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application with Lock( Jun 16 12:16:51.188120 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 12:16:51.188120 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._enter() Jun 16 12:16:51.188120 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 12:16:51.188120 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 12:16:51.189336 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 12:16:51.189336 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.creator() Jun 16 12:16:51.189336 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 12:16:51.189336 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application created_value = creator( Jun 16 12:16:51.189336 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 12:16:51.189336 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 12:16:51.189336 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 12:16:51.189336 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 12:16:51.189336 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 12:16:51.189336 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 12:16:51.189336 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 12:16:51.189336 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application Jun 16 12:16:51.189336 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 619/1249] 10.222.0.44 () {56 vars in 1096 bytes} [Thu Jun 16 12:16:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 12:16:51.194963 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f565a6-638e-40f9-9445-a2c5200eee90 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:16:51.304845 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f565a6-638e-40f9-9445-a2c5200eee90 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:16:51.337533 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:16:51.343117 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ecb971-457a-401c-a81c-eabadd5a92bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:16:51.343783 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ecb971-457a-401c-a81c-eabadd5a92bb None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:16:51.344064 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ecb971-457a-401c-a81c-eabadd5a92bb None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:16:51.344341 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ecb971-457a-401c-a81c-eabadd5a92bb None admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:16:51.345109 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ecb971-457a-401c-a81c-eabadd5a92bb None admin] RBAC: Adding query filter params (name=admin) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:16:51.345415 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ecb971-457a-401c-a81c-eabadd5a92bb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:16:51.346794 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ecb971-457a-401c-a81c-eabadd5a92bb None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:16:51.356371 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 631/1250] 10.222.0.44 () {56 vars in 1099 bytes} [Thu Jun 16 12:16:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:16:51.362356 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf90a881-43f2-48e0-a2e3-06289eb9658b None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:16:51.446570 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:16:51.473644 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf90a881-43f2-48e0-a2e3-06289eb9658b None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:16:51.511949 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f64e754-db49-4fd4-8925-2a5cf7219ede None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:16:51.512670 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f64e754-db49-4fd4-8925-2a5cf7219ede None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:16:51.512988 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f64e754-db49-4fd4-8925-2a5cf7219ede None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:16:51.513244 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f64e754-db49-4fd4-8925-2a5cf7219ede None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:16:51.523840 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f64e754-db49-4fd4-8925-2a5cf7219ede None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:16:51.525367 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f64e754-db49-4fd4-8925-2a5cf7219ede None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:16:51.542621 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application [None req-8f64e754-db49-4fd4-8925-2a5cf7219ede None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 12:16:51.542621 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 12:16:51.542621 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 12:16:51.542621 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 12:16:51.542621 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 12:16:51.542621 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 12:16:51.542621 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 12:16:51.542621 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 12:16:51.542621 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 12:16:51.542621 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 12:16:51.542621 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 12:16:51.542621 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 12:16:51.542621 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 12:16:51.542621 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 12:16:51.542621 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 12:16:51.543558 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 12:16:51.543558 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 12:16:51.543558 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 12:16:51.543558 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 12:16:51.543558 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 12:16:51.543558 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 12:16:51.543558 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 12:16:51.543558 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 12:16:51.543558 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application with Lock( Jun 16 12:16:51.543558 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 12:16:51.543558 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._enter() Jun 16 12:16:51.543558 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 12:16:51.543558 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 12:16:51.543558 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 12:16:51.543558 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.creator() Jun 16 12:16:51.543558 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 12:16:51.543558 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application created_value = creator( Jun 16 12:16:51.544443 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 12:16:51.544443 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 12:16:51.544443 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 12:16:51.544443 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application Jun 16 12:16:51.544443 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 620/1251] 10.222.0.44 () {56 vars in 1108 bytes} [Thu Jun 16 12:16:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 12:16:51.550242 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ecb971-457a-401c-a81c-eabadd5a92bb None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:16:51.656094 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ecb971-457a-401c-a81c-eabadd5a92bb None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:16:51.697459 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee19bc7-28a0-4950-8268-994fbaff3657 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:16:51.698052 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee19bc7-28a0-4950-8268-994fbaff3657 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:16:51.698347 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee19bc7-28a0-4950-8268-994fbaff3657 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:16:51.698607 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee19bc7-28a0-4950-8268-994fbaff3657 None admin] PATH_INFO: `/v3/domains` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:16:51.699321 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee19bc7-28a0-4950-8268-994fbaff3657 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:16:51.699624 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee19bc7-28a0-4950-8268-994fbaff3657 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:16:51.701020 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee19bc7-28a0-4950-8268-994fbaff3657 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:16:51.713645 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 632/1252] 10.222.0.44 () {56 vars in 1109 bytes} [Thu Jun 16 12:16:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:16:51.719773 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f64e754-db49-4fd4-8925-2a5cf7219ede None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:16:51.837567 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f64e754-db49-4fd4-8925-2a5cf7219ede None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:16:51.865252 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:16:51.875007 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7886ea-6324-41b1-8c46-f88f073de123 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:16:51.875819 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7886ea-6324-41b1-8c46-f88f073de123 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:16:51.876098 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7886ea-6324-41b1-8c46-f88f073de123 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:16:51.876380 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7886ea-6324-41b1-8c46-f88f073de123 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:16:51.884440 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7886ea-6324-41b1-8c46-f88f073de123 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:16:51.885920 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7886ea-6324-41b1-8c46-f88f073de123 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:16:51.900694 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application [None req-0e7886ea-6324-41b1-8c46-f88f073de123 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 16 12:16:51.900694 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 12:16:51.900694 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 12:16:51.900694 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 12:16:51.900694 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 12:16:51.900694 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 12:16:51.900694 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 12:16:51.900694 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 12:16:51.900694 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 12:16:51.900694 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 12:16:51.900694 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 12:16:51.900694 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 12:16:51.900694 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 12:16:51.900694 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 12:16:51.900694 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 12:16:51.900694 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 12:16:51.902297 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 12:16:51.902297 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 12:16:51.902297 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 12:16:51.902297 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 12:16:51.902297 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 12:16:51.902297 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 12:16:51.902297 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 12:16:51.902297 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 12:16:51.902297 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 12:16:51.902297 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 12:16:51.902297 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 12:16:51.902297 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application with Lock( Jun 16 12:16:51.902297 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 12:16:51.902297 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._enter() Jun 16 12:16:51.902297 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 12:16:51.902297 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 12:16:51.902297 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 12:16:51.902297 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.creator() Jun 16 12:16:51.903390 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 12:16:51.903390 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application created_value = creator( Jun 16 12:16:51.903390 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 12:16:51.903390 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 12:16:51.903390 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 12:16:51.903390 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 12:16:51.903390 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 12:16:51.903390 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 12:16:51.903390 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 16 12:16:51.903390 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application Jun 16 12:16:51.903390 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 621/1253] 10.222.0.44 () {56 vars in 1108 bytes} [Thu Jun 16 12:16:51 2022] GET /identity/v3/users/placement => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 12:16:51.907860 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee19bc7-28a0-4950-8268-994fbaff3657 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:16:51.969488 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:16:52.022422 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee19bc7-28a0-4950-8268-994fbaff3657 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:16:52.061200 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65019c40-c8aa-4650-86c8-60eccc10e0ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:16:52.061870 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65019c40-c8aa-4650-86c8-60eccc10e0ef None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:16:52.062149 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65019c40-c8aa-4650-86c8-60eccc10e0ef None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:16:52.062445 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65019c40-c8aa-4650-86c8-60eccc10e0ef None admin] PATH_INFO: `/v3/users` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:16:52.063281 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65019c40-c8aa-4650-86c8-60eccc10e0ef None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:16:52.063586 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65019c40-c8aa-4650-86c8-60eccc10e0ef None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:16:52.065036 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65019c40-c8aa-4650-86c8-60eccc10e0ef None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:16:52.085908 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 633/1254] 10.222.0.44 () {56 vars in 1143 bytes} [Thu Jun 16 12:16:51 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:16:52.092025 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7886ea-6324-41b1-8c46-f88f073de123 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:16:52.205269 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7886ea-6324-41b1-8c46-f88f073de123 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:16:52.243665 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d3e1b2-2fcc-495c-9ecf-0bd3a9dbd8b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:16:52.244235 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d3e1b2-2fcc-495c-9ecf-0bd3a9dbd8b7 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:16:52.244611 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d3e1b2-2fcc-495c-9ecf-0bd3a9dbd8b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:16:52.244950 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d3e1b2-2fcc-495c-9ecf-0bd3a9dbd8b7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:16:52.303264 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:16:52.315839 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d3e1b2-2fcc-495c-9ecf-0bd3a9dbd8b7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:16:52.317342 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d3e1b2-2fcc-495c-9ecf-0bd3a9dbd8b7 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:16:52.426821 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 622/1255] 10.222.0.44 () {58 vars in 1282 bytes} [Thu Jun 16 12:16:52 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 16 12:16:52.428091 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65019c40-c8aa-4650-86c8-60eccc10e0ef None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:16:52.532310 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65019c40-c8aa-4650-86c8-60eccc10e0ef None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:16:52.547906 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:16:52.571402 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108cf311-8193-40bf-b5c7-55050da810b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:16:52.572446 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108cf311-8193-40bf-b5c7-55050da810b7 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:16:52.572818 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108cf311-8193-40bf-b5c7-55050da810b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:16:52.573118 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108cf311-8193-40bf-b5c7-55050da810b7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:16:52.584891 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108cf311-8193-40bf-b5c7-55050da810b7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:16:52.586343 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108cf311-8193-40bf-b5c7-55050da810b7 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:16:52.606777 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-108cf311-8193-40bf-b5c7-55050da810b7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 12:16:52.606777 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 12:16:52.606777 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 12:16:52.606777 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 12:16:52.606777 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 12:16:52.606777 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 12:16:52.606777 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 12:16:52.606777 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 12:16:52.606777 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 12:16:52.606777 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 12:16:52.606777 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 12:16:52.606777 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 12:16:52.606777 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 12:16:52.606777 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 12:16:52.606777 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 12:16:52.607953 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 12:16:52.607953 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 12:16:52.607953 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 12:16:52.607953 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 12:16:52.607953 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 12:16:52.607953 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 12:16:52.607953 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 12:16:52.607953 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 12:16:52.607953 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jun 16 12:16:52.607953 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 12:16:52.607953 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jun 16 12:16:52.607953 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 12:16:52.607953 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 12:16:52.607953 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 12:16:52.607953 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jun 16 12:16:52.607953 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 12:16:52.607953 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jun 16 12:16:52.608986 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 12:16:52.608986 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 12:16:52.608986 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 12:16:52.608986 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jun 16 12:16:52.608986 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 634/1256] 10.222.0.44 () {56 vars in 1108 bytes} [Thu Jun 16 12:16:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 12:16:52.614091 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d3e1b2-2fcc-495c-9ecf-0bd3a9dbd8b7 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:16:52.705345 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:16:52.721464 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d3e1b2-2fcc-495c-9ecf-0bd3a9dbd8b7 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:16:52.762749 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bf156c-4d5f-4a93-bd37-06dba115bb90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:16:52.763432 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bf156c-4d5f-4a93-bd37-06dba115bb90 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:16:52.763713 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bf156c-4d5f-4a93-bd37-06dba115bb90 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:16:52.763988 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bf156c-4d5f-4a93-bd37-06dba115bb90 None admin] PATH_INFO: `/v3/domains` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:16:52.764729 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bf156c-4d5f-4a93-bd37-06dba115bb90 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:16:52.765069 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bf156c-4d5f-4a93-bd37-06dba115bb90 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:16:52.766471 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bf156c-4d5f-4a93-bd37-06dba115bb90 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:16:52.779894 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 623/1257] 10.222.0.44 () {56 vars in 1109 bytes} [Thu Jun 16 12:16:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:16:52.785497 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108cf311-8193-40bf-b5c7-55050da810b7 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:16:52.886674 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108cf311-8193-40bf-b5c7-55050da810b7 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:16:52.923969 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd5d764-73b2-4f32-b80c-4a4dde89b99e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:16:52.924810 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd5d764-73b2-4f32-b80c-4a4dde89b99e None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:16:52.925090 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd5d764-73b2-4f32-b80c-4a4dde89b99e None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:16:52.925358 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd5d764-73b2-4f32-b80c-4a4dde89b99e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:16:52.933132 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd5d764-73b2-4f32-b80c-4a4dde89b99e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:16:52.934624 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd5d764-73b2-4f32-b80c-4a4dde89b99e None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:16:52.949895 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-0dd5d764-73b2-4f32-b80c-4a4dde89b99e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 12:16:52.949895 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 12:16:52.949895 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 12:16:52.949895 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 12:16:52.949895 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 12:16:52.949895 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 12:16:52.949895 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 12:16:52.949895 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 12:16:52.949895 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 12:16:52.949895 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 12:16:52.949895 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 12:16:52.949895 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 12:16:52.949895 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 12:16:52.949895 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 12:16:52.949895 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 12:16:52.951089 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 12:16:52.951089 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 12:16:52.951089 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 12:16:52.951089 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 12:16:52.951089 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 12:16:52.951089 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 12:16:52.951089 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 12:16:52.951089 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 12:16:52.951089 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jun 16 12:16:52.951089 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 12:16:52.951089 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jun 16 12:16:52.951089 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 12:16:52.951089 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 12:16:52.951089 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 12:16:52.951089 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jun 16 12:16:52.951089 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 12:16:52.951089 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jun 16 12:16:52.952027 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 12:16:52.952027 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 12:16:52.952027 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 12:16:52.952027 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 12:16:52.952027 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 12:16:52.952027 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 12:16:52.952027 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 12:16:52.952027 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jun 16 12:16:52.952027 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 635/1258] 10.222.0.44 () {56 vars in 1111 bytes} [Thu Jun 16 12:16:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 12:16:52.957603 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bf156c-4d5f-4a93-bd37-06dba115bb90 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:16:53.060724 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bf156c-4d5f-4a93-bd37-06dba115bb90 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:16:53.095018 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e3b9ff-fb4a-4627-9fc9-074583e2ede9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:16:53.095676 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e3b9ff-fb4a-4627-9fc9-074583e2ede9 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:16:53.095967 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e3b9ff-fb4a-4627-9fc9-074583e2ede9 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:16:53.096243 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e3b9ff-fb4a-4627-9fc9-074583e2ede9 None admin] PATH_INFO: `/v3/projects` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:16:53.097059 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e3b9ff-fb4a-4627-9fc9-074583e2ede9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:16:53.097369 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e3b9ff-fb4a-4627-9fc9-074583e2ede9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:16:53.098793 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e3b9ff-fb4a-4627-9fc9-074583e2ede9 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:16:53.111386 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 624/1259] 10.222.0.44 () {56 vars in 1148 bytes} [Thu Jun 16 12:16:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:16:53.118129 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd5d764-73b2-4f32-b80c-4a4dde89b99e None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:16:53.145448 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:16:53.225290 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd5d764-73b2-4f32-b80c-4a4dde89b99e None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:16:53.258800 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d07c18d-a000-43e5-845b-26454573ac09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:16:53.259444 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d07c18d-a000-43e5-845b-26454573ac09 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:16:53.259724 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d07c18d-a000-43e5-845b-26454573ac09 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:16:53.259994 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d07c18d-a000-43e5-845b-26454573ac09 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:16:53.260876 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d07c18d-a000-43e5-845b-26454573ac09 None admin] RBAC: Adding query filter params (role.id=0688968254744e3f9913653cafea3091, scope.project.id=601361df39e34fcca71175aa94e425c4, user.id=8bff8ccf460a403d993c39327bbcbd29) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:16:53.261181 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d07c18d-a000-43e5-845b-26454573ac09 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:16:53.262594 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d07c18d-a000-43e5-845b-26454573ac09 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:16:53.267851 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 636/1260] 10.222.0.44 () {56 vars in 1374 bytes} [Thu Jun 16 12:16:53 2022] GET /identity/v3/role_assignments?user.id=8bff8ccf460a403d993c39327bbcbd29&scope.project.id=601361df39e34fcca71175aa94e425c4&role.id=0688968254744e3f9913653cafea3091 => generated 259 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:16:55.337538 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d724016-53b8-455f-930f-ffde336d1045 None None] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:16:55.338170 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d724016-53b8-455f-930f-ffde336d1045 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:16:55.338170 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d724016-53b8-455f-930f-ffde336d1045 None None] PATH_INFO: `/` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:16:55.339437 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 625/1261] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 12:16:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 12:16:55.344441 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcd1f8a-9c42-4177-b3f1-5b5ec23c5b2c None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:16:55.344912 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcd1f8a-9c42-4177-b3f1-5b5ec23c5b2c None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:16:55.345011 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcd1f8a-9c42-4177-b3f1-5b5ec23c5b2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:16:55.361360 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-7bcd1f8a-9c42-4177-b3f1-5b5ec23c5b2c None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:16:55.362556 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-7bcd1f8a-9c42-4177-b3f1-5b5ec23c5b2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:16:55.426945 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 637/1262] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 12:16:55 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 12:16:55.450215 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d724016-53b8-455f-930f-ffde336d1045 None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:16:55.460829 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:16:55.548041 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d724016-53b8-455f-930f-ffde336d1045 None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:16:55.580934 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1638c16d-8b80-4954-a613-8a81ec561516 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:16:55.581702 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1638c16d-8b80-4954-a613-8a81ec561516 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:16:55.581981 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1638c16d-8b80-4954-a613-8a81ec561516 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:16:55.582254 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1638c16d-8b80-4954-a613-8a81ec561516 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:16:55.592030 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1638c16d-8b80-4954-a613-8a81ec561516 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 12:16:55.600135 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application [None req-1638c16d-8b80-4954-a613-8a81ec561516 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 12:16:55.600135 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 12:16:55.600135 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 12:16:55.600135 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 12:16:55.600135 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 12:16:55.600135 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 12:16:55.600135 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 12:16:55.600135 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 12:16:55.600135 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 12:16:55.600135 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 12:16:55.600135 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 12:16:55.600135 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 12:16:55.600135 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 12:16:55.600135 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 12:16:55.600135 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 12:16:55.600135 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 12:16:55.601324 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 12:16:55.601324 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 12:16:55.601324 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 12:16:55.601324 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 12:16:55.601324 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 12:16:55.601324 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 12:16:55.601324 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 12:16:55.601324 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 12:16:55.601324 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 12:16:55.601324 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 12:16:55.601324 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 12:16:55.601324 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application with Lock( Jun 16 12:16:55.601324 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 12:16:55.601324 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._enter() Jun 16 12:16:55.601324 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 12:16:55.601324 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 12:16:55.602605 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 12:16:55.602605 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.creator() Jun 16 12:16:55.602605 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 12:16:55.602605 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application created_value = creator( Jun 16 12:16:55.602605 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 12:16:55.602605 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 12:16:55.602605 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 12:16:55.602605 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 12:16:55.602605 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 12:16:55.602605 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 12:16:55.602605 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 12:16:55.602605 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application Jun 16 12:16:55.602605 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 626/1263] 10.222.0.44 () {56 vars in 1096 bytes} [Thu Jun 16 12:16:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 12:16:55.607252 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcd1f8a-9c42-4177-b3f1-5b5ec23c5b2c None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:16:55.624817 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:16:55.702405 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcd1f8a-9c42-4177-b3f1-5b5ec23c5b2c None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:16:55.738756 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5556212b-8718-4215-b302-b901a25c7d9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:16:55.739410 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5556212b-8718-4215-b302-b901a25c7d9f None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:16:55.739687 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5556212b-8718-4215-b302-b901a25c7d9f None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:16:55.740003 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5556212b-8718-4215-b302-b901a25c7d9f None admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:16:55.740716 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5556212b-8718-4215-b302-b901a25c7d9f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:16:55.741040 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5556212b-8718-4215-b302-b901a25c7d9f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:16:55.742476 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5556212b-8718-4215-b302-b901a25c7d9f None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:16:55.753092 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 638/1264] 10.222.0.44 () {56 vars in 1099 bytes} [Thu Jun 16 12:16:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:16:55.760360 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1638c16d-8b80-4954-a613-8a81ec561516 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:16:55.833413 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:16:55.867461 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1638c16d-8b80-4954-a613-8a81ec561516 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:16:55.900293 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e903cfa2-1db2-4800-ba9a-209ec6ccc11e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:16:55.901098 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e903cfa2-1db2-4800-ba9a-209ec6ccc11e None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:16:55.901385 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e903cfa2-1db2-4800-ba9a-209ec6ccc11e None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:16:55.901662 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e903cfa2-1db2-4800-ba9a-209ec6ccc11e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:16:55.912336 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e903cfa2-1db2-4800-ba9a-209ec6ccc11e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:16:55.913809 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e903cfa2-1db2-4800-ba9a-209ec6ccc11e None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:16:55.930652 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application [None req-e903cfa2-1db2-4800-ba9a-209ec6ccc11e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 12:16:55.930652 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 12:16:55.930652 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 12:16:55.930652 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 12:16:55.930652 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 12:16:55.930652 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 12:16:55.930652 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 12:16:55.930652 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 12:16:55.930652 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 12:16:55.930652 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 12:16:55.930652 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 12:16:55.930652 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 12:16:55.930652 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 12:16:55.930652 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 12:16:55.930652 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 12:16:55.931732 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 12:16:55.931732 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 12:16:55.931732 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 12:16:55.931732 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 12:16:55.931732 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 12:16:55.931732 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 12:16:55.931732 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 12:16:55.931732 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 12:16:55.931732 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application with Lock( Jun 16 12:16:55.931732 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 12:16:55.931732 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._enter() Jun 16 12:16:55.931732 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 12:16:55.931732 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 12:16:55.931732 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 12:16:55.931732 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.creator() Jun 16 12:16:55.931732 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 12:16:55.931732 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application created_value = creator( Jun 16 12:16:55.933131 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 12:16:55.933131 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 12:16:55.933131 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 12:16:55.933131 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application Jun 16 12:16:55.933131 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 627/1265] 10.222.0.44 () {56 vars in 1108 bytes} [Thu Jun 16 12:16:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 12:16:55.937594 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5556212b-8718-4215-b302-b901a25c7d9f None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:16:56.016982 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:16:56.035387 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5556212b-8718-4215-b302-b901a25c7d9f None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:16:56.067802 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3c7e61-7789-4594-8645-9f5871123386 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:16:56.069068 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3c7e61-7789-4594-8645-9f5871123386 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:16:56.069347 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3c7e61-7789-4594-8645-9f5871123386 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:16:56.069616 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3c7e61-7789-4594-8645-9f5871123386 None admin] PATH_INFO: `/v3/domains` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:16:56.070330 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3c7e61-7789-4594-8645-9f5871123386 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:16:56.070633 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3c7e61-7789-4594-8645-9f5871123386 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:16:56.072034 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3c7e61-7789-4594-8645-9f5871123386 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:16:56.083399 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 639/1266] 10.222.0.44 () {56 vars in 1109 bytes} [Thu Jun 16 12:16:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:16:56.089002 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e903cfa2-1db2-4800-ba9a-209ec6ccc11e None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:16:56.185108 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e903cfa2-1db2-4800-ba9a-209ec6ccc11e None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:16:56.204079 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:16:56.217755 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc34ee6-0662-4a5d-ac8a-d289ab67def3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:16:56.218533 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc34ee6-0662-4a5d-ac8a-d289ab67def3 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:16:56.218813 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc34ee6-0662-4a5d-ac8a-d289ab67def3 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:16:56.219088 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc34ee6-0662-4a5d-ac8a-d289ab67def3 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:16:56.226292 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc34ee6-0662-4a5d-ac8a-d289ab67def3 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:16:56.227716 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc34ee6-0662-4a5d-ac8a-d289ab67def3 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:16:56.242178 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application [None req-4dc34ee6-0662-4a5d-ac8a-d289ab67def3 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 16 12:16:56.242178 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 12:16:56.242178 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 12:16:56.242178 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 12:16:56.242178 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 12:16:56.242178 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 12:16:56.242178 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 12:16:56.242178 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 12:16:56.242178 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 12:16:56.242178 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 12:16:56.242178 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 12:16:56.242178 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 12:16:56.242178 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 12:16:56.242178 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 12:16:56.242178 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 12:16:56.242178 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 12:16:56.243091 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 12:16:56.243091 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 12:16:56.243091 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 12:16:56.243091 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 12:16:56.243091 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 12:16:56.243091 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 12:16:56.243091 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 12:16:56.243091 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 12:16:56.243091 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 12:16:56.243091 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 12:16:56.243091 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 12:16:56.243091 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application with Lock( Jun 16 12:16:56.243091 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 12:16:56.243091 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._enter() Jun 16 12:16:56.243091 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 12:16:56.243091 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 12:16:56.243091 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 12:16:56.243091 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.creator() Jun 16 12:16:56.244119 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 12:16:56.244119 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application created_value = creator( Jun 16 12:16:56.244119 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 12:16:56.244119 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 12:16:56.244119 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 12:16:56.244119 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 12:16:56.244119 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 12:16:56.244119 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 12:16:56.244119 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 16 12:16:56.244119 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application Jun 16 12:16:56.244119 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 628/1267] 10.222.0.44 () {56 vars in 1108 bytes} [Thu Jun 16 12:16:56 2022] GET /identity/v3/users/placement => generated 87 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 12:16:56.248898 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3c7e61-7789-4594-8645-9f5871123386 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:16:56.345152 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3c7e61-7789-4594-8645-9f5871123386 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:16:56.378402 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e5be58-3258-4c19-ba8c-698937de0cae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:16:56.379052 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e5be58-3258-4c19-ba8c-698937de0cae None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:16:56.379332 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e5be58-3258-4c19-ba8c-698937de0cae None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:16:56.379609 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e5be58-3258-4c19-ba8c-698937de0cae None admin] PATH_INFO: `/v3/users` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:16:56.380431 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e5be58-3258-4c19-ba8c-698937de0cae None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:16:56.380738 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e5be58-3258-4c19-ba8c-698937de0cae None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:16:56.382181 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e5be58-3258-4c19-ba8c-698937de0cae None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:16:56.390456 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:16:56.398733 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 640/1268] 10.222.0.44 () {56 vars in 1143 bytes} [Thu Jun 16 12:16:56 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:16:56.404158 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc34ee6-0662-4a5d-ac8a-d289ab67def3 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:16:56.502061 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc34ee6-0662-4a5d-ac8a-d289ab67def3 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:16:56.533873 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cd80f9-e8b6-421c-a9df-a8f53b6407a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:16:56.534642 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cd80f9-e8b6-421c-a9df-a8f53b6407a1 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:16:56.534923 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cd80f9-e8b6-421c-a9df-a8f53b6407a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:16:56.535199 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cd80f9-e8b6-421c-a9df-a8f53b6407a1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:16:56.546238 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88cd80f9-e8b6-421c-a9df-a8f53b6407a1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:16:56.547667 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88cd80f9-e8b6-421c-a9df-a8f53b6407a1 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:16:56.564932 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application [None req-88cd80f9-e8b6-421c-a9df-a8f53b6407a1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 12:16:56.564932 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 12:16:56.564932 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 12:16:56.564932 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 12:16:56.564932 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 12:16:56.564932 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 12:16:56.564932 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 12:16:56.564932 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 12:16:56.564932 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 12:16:56.564932 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 12:16:56.564932 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 12:16:56.564932 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 12:16:56.564932 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 12:16:56.564932 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 12:16:56.564932 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 12:16:56.565984 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 12:16:56.565984 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 12:16:56.565984 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 12:16:56.565984 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 12:16:56.565984 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 12:16:56.565984 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 12:16:56.565984 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 12:16:56.565984 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 12:16:56.565984 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application with Lock( Jun 16 12:16:56.565984 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 12:16:56.565984 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._enter() Jun 16 12:16:56.565984 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 12:16:56.565984 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 12:16:56.565984 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 12:16:56.565984 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.creator() Jun 16 12:16:56.565984 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 12:16:56.565984 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application created_value = creator( Jun 16 12:16:56.567061 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 12:16:56.567061 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 12:16:56.567061 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 12:16:56.567061 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application Jun 16 12:16:56.567061 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 629/1269] 10.222.0.44 () {56 vars in 1108 bytes} [Thu Jun 16 12:16:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 12:16:56.571574 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e5be58-3258-4c19-ba8c-698937de0cae None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:16:56.667516 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e5be58-3258-4c19-ba8c-698937de0cae None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:16:56.700227 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e9de99-0a9b-4fdb-ad01-d348109a2003 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:16:56.700899 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e9de99-0a9b-4fdb-ad01-d348109a2003 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:16:56.701181 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e9de99-0a9b-4fdb-ad01-d348109a2003 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:16:56.701455 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e9de99-0a9b-4fdb-ad01-d348109a2003 None admin] PATH_INFO: `/v3/domains` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:16:56.702165 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e9de99-0a9b-4fdb-ad01-d348109a2003 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:16:56.702469 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e9de99-0a9b-4fdb-ad01-d348109a2003 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:16:56.703840 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e9de99-0a9b-4fdb-ad01-d348109a2003 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:16:56.715467 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 641/1270] 10.222.0.44 () {56 vars in 1109 bytes} [Thu Jun 16 12:16:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:16:56.722019 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cd80f9-e8b6-421c-a9df-a8f53b6407a1 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:16:56.760767 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:16:56.834970 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cd80f9-e8b6-421c-a9df-a8f53b6407a1 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:16:56.867289 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6594674d-2650-458d-a610-8d5356fbfafc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:16:56.868057 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6594674d-2650-458d-a610-8d5356fbfafc None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:16:56.868332 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6594674d-2650-458d-a610-8d5356fbfafc None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:16:56.868597 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6594674d-2650-458d-a610-8d5356fbfafc None admin] PATH_INFO: `/v3/projects/service` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:16:56.875006 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6594674d-2650-458d-a610-8d5356fbfafc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:16:56.876438 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6594674d-2650-458d-a610-8d5356fbfafc None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:16:56.890205 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application [None req-6594674d-2650-458d-a610-8d5356fbfafc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 12:16:56.890205 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 12:16:56.890205 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 12:16:56.890205 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 12:16:56.890205 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 12:16:56.890205 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 12:16:56.890205 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 12:16:56.890205 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 12:16:56.890205 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 12:16:56.890205 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 12:16:56.890205 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 12:16:56.890205 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 12:16:56.890205 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 12:16:56.890205 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 12:16:56.890205 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 12:16:56.891231 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 12:16:56.891231 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 12:16:56.891231 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 12:16:56.891231 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 12:16:56.891231 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 12:16:56.891231 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 12:16:56.891231 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 12:16:56.891231 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 12:16:56.891231 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application with Lock( Jun 16 12:16:56.891231 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 12:16:56.891231 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._enter() Jun 16 12:16:56.891231 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 12:16:56.891231 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 12:16:56.891231 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 12:16:56.891231 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.creator() Jun 16 12:16:56.891231 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 12:16:56.891231 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application created_value = creator( Jun 16 12:16:56.892154 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 12:16:56.892154 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 12:16:56.892154 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 12:16:56.892154 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 12:16:56.892154 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 12:16:56.892154 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 12:16:56.892154 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 12:16:56.892154 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application Jun 16 12:16:56.892154 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 630/1271] 10.222.0.44 () {56 vars in 1111 bytes} [Thu Jun 16 12:16:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 12:16:56.897725 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e9de99-0a9b-4fdb-ad01-d348109a2003 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:16:56.955964 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:16:56.996046 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e9de99-0a9b-4fdb-ad01-d348109a2003 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:16:57.027981 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87616d22-a4fa-417d-9fef-c69153c1f686 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:16:57.028560 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87616d22-a4fa-417d-9fef-c69153c1f686 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:16:57.028862 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87616d22-a4fa-417d-9fef-c69153c1f686 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:16:57.029132 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87616d22-a4fa-417d-9fef-c69153c1f686 None admin] PATH_INFO: `/v3/projects` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:16:57.029900 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87616d22-a4fa-417d-9fef-c69153c1f686 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:16:57.030198 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87616d22-a4fa-417d-9fef-c69153c1f686 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:16:57.031605 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87616d22-a4fa-417d-9fef-c69153c1f686 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:16:57.043915 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 642/1272] 10.222.0.44 () {56 vars in 1148 bytes} [Thu Jun 16 12:16:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:16:57.049826 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6594674d-2650-458d-a610-8d5356fbfafc None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:16:57.141321 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:16:57.150781 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6594674d-2650-458d-a610-8d5356fbfafc None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:16:57.188217 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae2830f-e6fe-4ed0-a62e-ba2539d977f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:16:57.189129 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae2830f-e6fe-4ed0-a62e-ba2539d977f9 None admin] REQUEST_METHOD: `PUT` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:16:57.189410 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae2830f-e6fe-4ed0-a62e-ba2539d977f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:16:57.189679 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae2830f-e6fe-4ed0-a62e-ba2539d977f9 None admin] PATH_INFO: `/v3/projects/601361df39e34fcca71175aa94e425c4/users/8bff8ccf460a403d993c39327bbcbd29/roles/0688968254744e3f9913653cafea3091` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:16:57.191626 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae2830f-e6fe-4ed0-a62e-ba2539d977f9 None admin] RBAC: Authorizing `identity:create_grant(project_id=601361df39e34fcca71175aa94e425c4, user_id=8bff8ccf460a403d993c39327bbcbd29, role_id=0688968254744e3f9913653cafea3091)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:16:57.193581 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae2830f-e6fe-4ed0-a62e-ba2539d977f9 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:16:57.206504 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 631/1273] 10.222.0.44 () {58 vars in 1439 bytes} [Thu Jun 16 12:16:57 2022] PUT /identity/v3/projects/601361df39e34fcca71175aa94e425c4/users/8bff8ccf460a403d993c39327bbcbd29/roles/0688968254744e3f9913653cafea3091 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:16:59.263907 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ed1cc8-3675-4740-a864-65d9678d276c None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:16:59.264468 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ed1cc8-3675-4740-a864-65d9678d276c None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:16:59.264468 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ed1cc8-3675-4740-a864-65d9678d276c None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:16:59.265889 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 643/1274] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 12:16:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 12:16:59.270815 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d81dab-ddce-43c1-80f6-ce911f40f131 None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:16:59.271755 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d81dab-ddce-43c1-80f6-ce911f40f131 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:16:59.271859 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d81dab-ddce-43c1-80f6-ce911f40f131 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:16:59.288886 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-47d81dab-ddce-43c1-80f6-ce911f40f131 None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:16:59.290078 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-47d81dab-ddce-43c1-80f6-ce911f40f131 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:16:59.354513 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 632/1275] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 12:16:59 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 12:16:59.377301 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ed1cc8-3675-4740-a864-65d9678d276c None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:16:59.475865 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ed1cc8-3675-4740-a864-65d9678d276c None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:16:59.492238 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:16:59.509410 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698bf220-8031-466e-9032-4ea3aaf3964a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:16:59.510185 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698bf220-8031-466e-9032-4ea3aaf3964a None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:16:59.510469 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698bf220-8031-466e-9032-4ea3aaf3964a None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:16:59.510745 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698bf220-8031-466e-9032-4ea3aaf3964a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:16:59.520598 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698bf220-8031-466e-9032-4ea3aaf3964a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 12:16:59.528712 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-698bf220-8031-466e-9032-4ea3aaf3964a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 12:16:59.528712 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 12:16:59.528712 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 12:16:59.528712 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 12:16:59.528712 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 12:16:59.528712 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 12:16:59.528712 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 12:16:59.528712 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 12:16:59.528712 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 12:16:59.528712 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 12:16:59.528712 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 12:16:59.528712 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 12:16:59.528712 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 12:16:59.528712 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 12:16:59.528712 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 12:16:59.528712 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 12:16:59.529823 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 12:16:59.529823 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 12:16:59.529823 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 12:16:59.529823 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 12:16:59.529823 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 12:16:59.529823 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 12:16:59.529823 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 12:16:59.529823 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 12:16:59.529823 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 12:16:59.529823 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 12:16:59.529823 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 12:16:59.529823 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jun 16 12:16:59.529823 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 12:16:59.529823 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jun 16 12:16:59.529823 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 12:16:59.529823 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 12:16:59.530991 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 12:16:59.530991 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jun 16 12:16:59.530991 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 12:16:59.530991 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jun 16 12:16:59.530991 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 12:16:59.530991 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 12:16:59.530991 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 12:16:59.530991 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 12:16:59.530991 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 12:16:59.530991 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 12:16:59.530991 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 12:16:59.530991 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jun 16 12:16:59.530991 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 644/1276] 10.222.0.44 () {56 vars in 1096 bytes} [Thu Jun 16 12:16:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 12:16:59.535918 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d81dab-ddce-43c1-80f6-ce911f40f131 None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:16:59.612340 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:16:59.631026 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d81dab-ddce-43c1-80f6-ce911f40f131 None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:16:59.663954 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30d9699-8e36-4019-af40-35f44a7e76fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:16:59.664596 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30d9699-8e36-4019-af40-35f44a7e76fd None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:16:59.664903 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30d9699-8e36-4019-af40-35f44a7e76fd None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:16:59.665175 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30d9699-8e36-4019-af40-35f44a7e76fd None admin] PATH_INFO: `/v3/roles` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:16:59.665903 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30d9699-8e36-4019-af40-35f44a7e76fd None admin] RBAC: Adding query filter params (name=admin) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:16:59.666202 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30d9699-8e36-4019-af40-35f44a7e76fd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:16:59.667544 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30d9699-8e36-4019-af40-35f44a7e76fd None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:16:59.675301 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 633/1277] 10.222.0.44 () {56 vars in 1099 bytes} [Thu Jun 16 12:16:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:16:59.681422 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698bf220-8031-466e-9032-4ea3aaf3964a None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:16:59.786281 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698bf220-8031-466e-9032-4ea3aaf3964a None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:16:59.818101 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57480a62-f817-4777-b44a-ffe1aff11b9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:16:59.818872 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57480a62-f817-4777-b44a-ffe1aff11b9a None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:16:59.819146 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57480a62-f817-4777-b44a-ffe1aff11b9a None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:16:59.819415 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57480a62-f817-4777-b44a-ffe1aff11b9a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:16:59.829399 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57480a62-f817-4777-b44a-ffe1aff11b9a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:16:59.830832 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57480a62-f817-4777-b44a-ffe1aff11b9a None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:16:59.847557 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-57480a62-f817-4777-b44a-ffe1aff11b9a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 12:16:59.847557 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 12:16:59.847557 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 12:16:59.847557 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 12:16:59.847557 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 12:16:59.847557 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 12:16:59.847557 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 12:16:59.847557 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 12:16:59.847557 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 12:16:59.847557 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 12:16:59.847557 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 12:16:59.847557 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 12:16:59.847557 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 12:16:59.847557 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 12:16:59.847557 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 12:16:59.848571 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 12:16:59.848571 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 12:16:59.848571 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 12:16:59.848571 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 12:16:59.848571 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 12:16:59.848571 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 12:16:59.848571 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 12:16:59.848571 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 12:16:59.848571 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jun 16 12:16:59.848571 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 12:16:59.848571 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jun 16 12:16:59.848571 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 12:16:59.848571 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 12:16:59.848571 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 12:16:59.848571 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jun 16 12:16:59.848571 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 12:16:59.848571 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jun 16 12:16:59.850130 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 12:16:59.850130 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 12:16:59.850130 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 12:16:59.850130 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jun 16 12:16:59.850130 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 645/1278] 10.222.0.44 () {56 vars in 1108 bytes} [Thu Jun 16 12:16:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 12:16:59.855009 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30d9699-8e36-4019-af40-35f44a7e76fd None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:16:59.951959 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30d9699-8e36-4019-af40-35f44a7e76fd None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:16:59.984349 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df115d71-d726-47a5-ace9-320f64369dce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:16:59.985020 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df115d71-d726-47a5-ace9-320f64369dce None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:16:59.985296 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df115d71-d726-47a5-ace9-320f64369dce None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:16:59.985564 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df115d71-d726-47a5-ace9-320f64369dce None admin] PATH_INFO: `/v3/domains` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:16:59.986271 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df115d71-d726-47a5-ace9-320f64369dce None admin] RBAC: Adding query filter params (name=Default) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:16:59.986588 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df115d71-d726-47a5-ace9-320f64369dce None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:16:59.987930 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df115d71-d726-47a5-ace9-320f64369dce None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:16:59.999149 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 634/1279] 10.222.0.44 () {56 vars in 1109 bytes} [Thu Jun 16 12:16:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:17:00.004787 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57480a62-f817-4777-b44a-ffe1aff11b9a None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:17:00.034820 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:17:00.101590 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57480a62-f817-4777-b44a-ffe1aff11b9a None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:17:00.133521 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf555b03-6cff-40f2-aecb-bbd5a1632ecc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:17:00.134298 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf555b03-6cff-40f2-aecb-bbd5a1632ecc None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:17:00.134576 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf555b03-6cff-40f2-aecb-bbd5a1632ecc None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:17:00.134845 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf555b03-6cff-40f2-aecb-bbd5a1632ecc None admin] PATH_INFO: `/v3/users/placement` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:17:00.141972 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf555b03-6cff-40f2-aecb-bbd5a1632ecc None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:17:00.143403 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf555b03-6cff-40f2-aecb-bbd5a1632ecc None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:17:00.157831 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-cf555b03-6cff-40f2-aecb-bbd5a1632ecc None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 16 12:17:00.157831 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 12:17:00.157831 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 12:17:00.157831 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 12:17:00.157831 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 12:17:00.157831 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 12:17:00.157831 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 12:17:00.157831 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 12:17:00.157831 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 12:17:00.157831 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 12:17:00.157831 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 12:17:00.157831 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 12:17:00.157831 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 12:17:00.157831 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 12:17:00.157831 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 12:17:00.157831 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 12:17:00.158961 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 12:17:00.158961 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 12:17:00.158961 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 12:17:00.158961 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 12:17:00.158961 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 12:17:00.158961 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 12:17:00.158961 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 12:17:00.158961 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 12:17:00.158961 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 12:17:00.158961 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 12:17:00.158961 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 12:17:00.158961 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jun 16 12:17:00.158961 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 12:17:00.158961 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jun 16 12:17:00.158961 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 12:17:00.158961 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 12:17:00.158961 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 12:17:00.158961 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jun 16 12:17:00.160293 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 12:17:00.160293 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jun 16 12:17:00.160293 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 12:17:00.160293 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 12:17:00.160293 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 12:17:00.160293 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 12:17:00.160293 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 12:17:00.160293 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 12:17:00.160293 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 16 12:17:00.160293 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jun 16 12:17:00.160293 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 646/1280] 10.222.0.44 () {56 vars in 1108 bytes} [Thu Jun 16 12:17:00 2022] GET /identity/v3/users/placement => generated 87 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 12:17:00.164821 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df115d71-d726-47a5-ace9-320f64369dce None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:17:00.168530 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:17:00.260280 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df115d71-d726-47a5-ace9-320f64369dce None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:17:00.293508 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97e706b-da9e-44fa-9b39-5e465640fb01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:17:00.294152 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97e706b-da9e-44fa-9b39-5e465640fb01 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:17:00.294473 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97e706b-da9e-44fa-9b39-5e465640fb01 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:17:00.294693 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97e706b-da9e-44fa-9b39-5e465640fb01 None admin] PATH_INFO: `/v3/users` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:17:00.295510 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97e706b-da9e-44fa-9b39-5e465640fb01 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:17:00.295810 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97e706b-da9e-44fa-9b39-5e465640fb01 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:17:00.297248 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97e706b-da9e-44fa-9b39-5e465640fb01 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:17:00.313365 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 635/1281] 10.222.0.44 () {56 vars in 1143 bytes} [Thu Jun 16 12:17:00 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:17:00.319469 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf555b03-6cff-40f2-aecb-bbd5a1632ecc None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:17:00.406854 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:17:00.416881 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf555b03-6cff-40f2-aecb-bbd5a1632ecc None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:17:00.449029 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9148e3e7-62db-40f0-86a5-1b9b74c40b4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:17:00.449665 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9148e3e7-62db-40f0-86a5-1b9b74c40b4a None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:17:00.449942 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9148e3e7-62db-40f0-86a5-1b9b74c40b4a None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:17:00.450215 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9148e3e7-62db-40f0-86a5-1b9b74c40b4a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:17:00.514654 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9148e3e7-62db-40f0-86a5-1b9b74c40b4a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:17:00.516085 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9148e3e7-62db-40f0-86a5-1b9b74c40b4a None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:17:00.599490 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:17:00.609825 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 647/1282] 10.222.0.44 () {58 vars in 1282 bytes} [Thu Jun 16 12:17:00 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 16 12:17:00.615981 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97e706b-da9e-44fa-9b39-5e465640fb01 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:17:00.674630 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:17:00.712527 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97e706b-da9e-44fa-9b39-5e465640fb01 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:17:00.750850 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc5d727-66fa-487c-929b-59f07475d58f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:17:00.751630 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc5d727-66fa-487c-929b-59f07475d58f None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:17:00.751915 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc5d727-66fa-487c-929b-59f07475d58f None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:17:00.752190 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc5d727-66fa-487c-929b-59f07475d58f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:17:00.762571 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc5d727-66fa-487c-929b-59f07475d58f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:17:00.764001 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc5d727-66fa-487c-929b-59f07475d58f None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:17:00.780963 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application [None req-ecc5d727-66fa-487c-929b-59f07475d58f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 12:17:00.780963 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 12:17:00.780963 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 12:17:00.780963 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 12:17:00.780963 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 12:17:00.780963 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 12:17:00.780963 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 12:17:00.780963 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 12:17:00.780963 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 12:17:00.780963 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 12:17:00.780963 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 12:17:00.780963 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 12:17:00.780963 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 12:17:00.780963 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 12:17:00.780963 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 12:17:00.782083 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 12:17:00.782083 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 12:17:00.782083 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 12:17:00.782083 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 12:17:00.782083 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 12:17:00.782083 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 12:17:00.782083 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 12:17:00.782083 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 12:17:00.782083 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application with Lock( Jun 16 12:17:00.782083 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 12:17:00.782083 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._enter() Jun 16 12:17:00.782083 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 12:17:00.782083 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 12:17:00.782083 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 12:17:00.782083 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.creator() Jun 16 12:17:00.782083 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 12:17:00.782083 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application created_value = creator( Jun 16 12:17:00.783119 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 12:17:00.783119 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 12:17:00.783119 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 12:17:00.783119 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application Jun 16 12:17:00.783119 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 636/1283] 10.222.0.44 () {56 vars in 1108 bytes} [Thu Jun 16 12:17:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 12:17:00.788037 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9148e3e7-62db-40f0-86a5-1b9b74c40b4a None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:17:00.882945 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9148e3e7-62db-40f0-86a5-1b9b74c40b4a None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:17:00.916610 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9652fa02-eb38-4791-88a8-c35ee039a3b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:17:00.917305 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9652fa02-eb38-4791-88a8-c35ee039a3b6 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:17:00.917583 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9652fa02-eb38-4791-88a8-c35ee039a3b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:17:00.917856 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9652fa02-eb38-4791-88a8-c35ee039a3b6 None admin] PATH_INFO: `/v3/domains` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:17:00.918576 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9652fa02-eb38-4791-88a8-c35ee039a3b6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:17:00.918880 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9652fa02-eb38-4791-88a8-c35ee039a3b6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:17:00.920269 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9652fa02-eb38-4791-88a8-c35ee039a3b6 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:17:00.932228 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 648/1284] 10.222.0.44 () {56 vars in 1109 bytes} [Thu Jun 16 12:17:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:17:00.937726 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc5d727-66fa-487c-929b-59f07475d58f None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:17:01.032308 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc5d727-66fa-487c-929b-59f07475d58f None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:17:01.046386 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:17:01.066219 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca9f28b-7a09-4e23-9a57-9d0b059d1ddd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:17:01.066983 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca9f28b-7a09-4e23-9a57-9d0b059d1ddd None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:17:01.067258 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca9f28b-7a09-4e23-9a57-9d0b059d1ddd None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:17:01.067526 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca9f28b-7a09-4e23-9a57-9d0b059d1ddd None admin] PATH_INFO: `/v3/projects/service` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:17:01.073975 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca9f28b-7a09-4e23-9a57-9d0b059d1ddd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:17:01.075392 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca9f28b-7a09-4e23-9a57-9d0b059d1ddd None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:17:01.090787 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application [None req-bca9f28b-7a09-4e23-9a57-9d0b059d1ddd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 12:17:01.090787 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 12:17:01.090787 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 12:17:01.090787 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 12:17:01.090787 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 12:17:01.090787 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 12:17:01.090787 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 12:17:01.090787 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 12:17:01.090787 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 12:17:01.090787 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 12:17:01.090787 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 12:17:01.090787 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 12:17:01.090787 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 12:17:01.090787 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 12:17:01.090787 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 12:17:01.091917 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 12:17:01.091917 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 12:17:01.091917 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 12:17:01.091917 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 12:17:01.091917 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 12:17:01.091917 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 12:17:01.091917 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 12:17:01.091917 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 12:17:01.091917 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application with Lock( Jun 16 12:17:01.091917 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 12:17:01.091917 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._enter() Jun 16 12:17:01.091917 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 12:17:01.091917 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 12:17:01.091917 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 12:17:01.091917 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.creator() Jun 16 12:17:01.091917 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 12:17:01.091917 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application created_value = creator( Jun 16 12:17:01.093249 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 12:17:01.093249 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 12:17:01.093249 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 12:17:01.093249 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 12:17:01.093249 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 12:17:01.093249 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 12:17:01.093249 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 12:17:01.093249 dv-cinder-846149-2-smb devstack@keystone.service[80075]: ERROR keystone.server.flask.application Jun 16 12:17:01.093249 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 637/1285] 10.222.0.44 () {56 vars in 1111 bytes} [Thu Jun 16 12:17:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 12:17:01.097828 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9652fa02-eb38-4791-88a8-c35ee039a3b6 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:17:01.146574 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:17:01.199784 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9652fa02-eb38-4791-88a8-c35ee039a3b6 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:17:01.232386 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273cfb11-d644-41eb-b7dc-f36cce1e1862 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:17:01.233052 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273cfb11-d644-41eb-b7dc-f36cce1e1862 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:17:01.233326 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273cfb11-d644-41eb-b7dc-f36cce1e1862 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:17:01.233592 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273cfb11-d644-41eb-b7dc-f36cce1e1862 None admin] PATH_INFO: `/v3/projects` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:17:01.234364 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273cfb11-d644-41eb-b7dc-f36cce1e1862 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:17:01.234663 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273cfb11-d644-41eb-b7dc-f36cce1e1862 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:17:01.236074 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273cfb11-d644-41eb-b7dc-f36cce1e1862 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:17:01.247687 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 649/1286] 10.222.0.44 () {56 vars in 1148 bytes} [Thu Jun 16 12:17:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:17:01.253638 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca9f28b-7a09-4e23-9a57-9d0b059d1ddd None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:17:01.350411 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca9f28b-7a09-4e23-9a57-9d0b059d1ddd None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:17:01.383014 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ab2ceb-0c29-4d91-a34e-481f56d0ffcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:17:01.383645 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ab2ceb-0c29-4d91-a34e-481f56d0ffcf None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:17:01.383930 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ab2ceb-0c29-4d91-a34e-481f56d0ffcf None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:17:01.384203 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ab2ceb-0c29-4d91-a34e-481f56d0ffcf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:17:01.385058 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ab2ceb-0c29-4d91-a34e-481f56d0ffcf None admin] RBAC: Adding query filter params (role.id=0688968254744e3f9913653cafea3091, scope.project.id=601361df39e34fcca71175aa94e425c4, user.id=8bff8ccf460a403d993c39327bbcbd29) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:17:01.385371 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ab2ceb-0c29-4d91-a34e-481f56d0ffcf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:17:01.386791 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ab2ceb-0c29-4d91-a34e-481f56d0ffcf None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:17:01.392455 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 638/1287] 10.222.0.44 () {56 vars in 1374 bytes} [Thu Jun 16 12:17:01 2022] GET /identity/v3/role_assignments?user.id=8bff8ccf460a403d993c39327bbcbd29&scope.project.id=601361df39e34fcca71175aa94e425c4&role.id=0688968254744e3f9913653cafea3091 => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:17:03.511490 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4d94ce-d0e5-4649-982a-a2db1ae472b7 None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:17:03.512038 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4d94ce-d0e5-4649-982a-a2db1ae472b7 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:17:03.512038 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4d94ce-d0e5-4649-982a-a2db1ae472b7 None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:17:03.513448 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 650/1288] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 12:17:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 12:17:03.518468 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88c11c4-98e3-42d2-908c-d2cdd37da659 None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:17:03.518868 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88c11c4-98e3-42d2-908c-d2cdd37da659 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:17:03.519021 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88c11c4-98e3-42d2-908c-d2cdd37da659 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:17:03.535626 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-e88c11c4-98e3-42d2-908c-d2cdd37da659 None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:17:03.536876 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-e88c11c4-98e3-42d2-908c-d2cdd37da659 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:17:03.565700 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:17:03.602163 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 639/1289] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 12:17:03 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 12:17:03.624525 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4d94ce-d0e5-4649-982a-a2db1ae472b7 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:17:03.722925 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4d94ce-d0e5-4649-982a-a2db1ae472b7 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:17:03.734980 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:17:03.759372 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413b39b9-072a-40fa-b2fe-fa2b38e19f4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:17:03.760257 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413b39b9-072a-40fa-b2fe-fa2b38e19f4a None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:17:03.760441 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413b39b9-072a-40fa-b2fe-fa2b38e19f4a None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:17:03.760709 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413b39b9-072a-40fa-b2fe-fa2b38e19f4a None admin] PATH_INFO: `/v3/services/placement` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:17:03.761380 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413b39b9-072a-40fa-b2fe-fa2b38e19f4a None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:17:03.762794 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413b39b9-072a-40fa-b2fe-fa2b38e19f4a None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:17:03.775407 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-413b39b9-072a-40fa-b2fe-fa2b38e19f4a None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 16 12:17:03.775407 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 12:17:03.775407 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 12:17:03.775407 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 12:17:03.775407 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 12:17:03.775407 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 12:17:03.775407 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 12:17:03.775407 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 12:17:03.775407 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 16 12:17:03.775407 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jun 16 12:17:03.775407 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 12:17:03.775407 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jun 16 12:17:03.775407 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 12:17:03.775407 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 12:17:03.775407 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 12:17:03.775407 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 12:17:03.775407 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 12:17:03.777212 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 12:17:03.777212 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 12:17:03.777212 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 12:17:03.777212 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 12:17:03.777212 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 12:17:03.777212 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 12:17:03.777212 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 12:17:03.777212 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 12:17:03.777212 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 12:17:03.777212 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 12:17:03.777212 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 12:17:03.777212 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 12:17:03.777212 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 12:17:03.777212 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 12:17:03.777212 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 12:17:03.777212 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 12:17:03.778405 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 12:17:03.778405 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jun 16 12:17:03.778405 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 12:17:03.778405 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jun 16 12:17:03.778405 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 12:17:03.778405 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 12:17:03.778405 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 12:17:03.778405 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jun 16 12:17:03.778405 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 12:17:03.778405 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jun 16 12:17:03.778405 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 12:17:03.778405 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 12:17:03.778405 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 16 12:17:03.778405 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jun 16 12:17:03.778405 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 651/1290] 10.222.0.44 () {56 vars in 1117 bytes} [Thu Jun 16 12:17:03 2022] GET /identity/v3/services/placement => generated 90 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 12:17:03.782979 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88c11c4-98e3-42d2-908c-d2cdd37da659 None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:17:03.878853 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88c11c4-98e3-42d2-908c-d2cdd37da659 None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:17:03.912738 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0524616-d575-44a3-b8ab-0ec279d6db3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:17:03.913409 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0524616-d575-44a3-b8ab-0ec279d6db3d None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:17:03.913690 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0524616-d575-44a3-b8ab-0ec279d6db3d None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:17:03.913965 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0524616-d575-44a3-b8ab-0ec279d6db3d None admin] PATH_INFO: `/v3/services` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:17:03.914665 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0524616-d575-44a3-b8ab-0ec279d6db3d None admin] RBAC: Adding query filter params (name=placement) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:17:03.914975 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0524616-d575-44a3-b8ab-0ec279d6db3d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:17:03.916344 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0524616-d575-44a3-b8ab-0ec279d6db3d None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:17:03.921323 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 640/1291] 10.222.0.44 () {56 vars in 1116 bytes} [Thu Jun 16 12:17:03 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:17:03.926934 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413b39b9-072a-40fa-b2fe-fa2b38e19f4a None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:17:04.025415 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413b39b9-072a-40fa-b2fe-fa2b38e19f4a None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:17:04.057030 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6648c81f-f5df-496d-877b-3b8e9b14070d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:17:04.057676 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6648c81f-f5df-496d-877b-3b8e9b14070d None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:17:04.057955 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6648c81f-f5df-496d-877b-3b8e9b14070d None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:17:04.058229 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6648c81f-f5df-496d-877b-3b8e9b14070d None admin] PATH_INFO: `/v3/services` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:17:04.058923 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6648c81f-f5df-496d-877b-3b8e9b14070d None admin] RBAC: Adding query filter params (type=placement) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:17:04.059228 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6648c81f-f5df-496d-877b-3b8e9b14070d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:17:04.060593 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6648c81f-f5df-496d-877b-3b8e9b14070d None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:17:04.064914 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 652/1292] 10.222.0.44 () {56 vars in 1116 bytes} [Thu Jun 16 12:17:03 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:17:06.127392 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a9056e-5b38-44e6-9f0e-e2c79830d977 None None] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:17:06.127940 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a9056e-5b38-44e6-9f0e-e2c79830d977 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:17:06.127940 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a9056e-5b38-44e6-9f0e-e2c79830d977 None None] PATH_INFO: `/` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:17:06.129309 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 641/1293] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 12:17:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 12:17:06.134320 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9935225b-ca4f-4f4b-891a-f69388fa57af None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:17:06.134686 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9935225b-ca4f-4f4b-891a-f69388fa57af None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:17:06.134873 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9935225b-ca4f-4f4b-891a-f69388fa57af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:17:06.151027 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-9935225b-ca4f-4f4b-891a-f69388fa57af None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:17:06.152213 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-9935225b-ca4f-4f4b-891a-f69388fa57af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:17:06.181600 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:17:06.217715 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 653/1294] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 12:17:06 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 12:17:06.240848 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a9056e-5b38-44e6-9f0e-e2c79830d977 None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:17:06.270178 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:17:06.337021 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a9056e-5b38-44e6-9f0e-e2c79830d977 None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:17:06.369511 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fdf9ca-aecd-4a8e-b71d-2485787436cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:17:06.370148 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fdf9ca-aecd-4a8e-b71d-2485787436cb None admin] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:17:06.370423 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fdf9ca-aecd-4a8e-b71d-2485787436cb None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:17:06.370690 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fdf9ca-aecd-4a8e-b71d-2485787436cb None admin] PATH_INFO: `/v3/services` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:17:06.371405 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fdf9ca-aecd-4a8e-b71d-2485787436cb None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:17:06.372739 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fdf9ca-aecd-4a8e-b71d-2485787436cb None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:17:06.384729 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 642/1295] 10.222.0.44 () {60 vars in 1141 bytes} [Thu Jun 16 12:17:06 2022] POST /identity/v3/services => generated 246 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 12:17:08.494660 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5654dac-f636-4d38-9016-53f30a8e2b63 None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:17:08.495185 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5654dac-f636-4d38-9016-53f30a8e2b63 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:17:08.495185 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5654dac-f636-4d38-9016-53f30a8e2b63 None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:17:08.496559 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 654/1296] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 12:17:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 12:17:08.501771 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91236f1e-fc8e-4192-8a51-b50e698d6474 None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:17:08.502174 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91236f1e-fc8e-4192-8a51-b50e698d6474 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:17:08.502313 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91236f1e-fc8e-4192-8a51-b50e698d6474 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:17:08.518994 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-91236f1e-fc8e-4192-8a51-b50e698d6474 None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:17:08.520255 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-91236f1e-fc8e-4192-8a51-b50e698d6474 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:17:08.591445 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 643/1297] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 12:17:08 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 12:17:08.613405 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5654dac-f636-4d38-9016-53f30a8e2b63 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:17:08.710951 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5654dac-f636-4d38-9016-53f30a8e2b63 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:17:08.745709 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65bbc6f-41c2-4e6e-999d-2cb2264d30c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:17:08.746417 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65bbc6f-41c2-4e6e-999d-2cb2264d30c0 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:17:08.746697 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65bbc6f-41c2-4e6e-999d-2cb2264d30c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:17:08.746970 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65bbc6f-41c2-4e6e-999d-2cb2264d30c0 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:17:08.747772 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65bbc6f-41c2-4e6e-999d-2cb2264d30c0 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:17:08.749166 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65bbc6f-41c2-4e6e-999d-2cb2264d30c0 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:17:08.762827 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-c65bbc6f-41c2-4e6e-999d-2cb2264d30c0 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 16 12:17:08.762827 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 12:17:08.762827 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 12:17:08.762827 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 12:17:08.762827 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 12:17:08.762827 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 12:17:08.762827 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 12:17:08.762827 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 12:17:08.762827 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 16 12:17:08.762827 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jun 16 12:17:08.762827 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 12:17:08.762827 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jun 16 12:17:08.762827 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 12:17:08.762827 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 12:17:08.762827 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 12:17:08.762827 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 12:17:08.762827 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 12:17:08.764066 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 12:17:08.764066 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 12:17:08.764066 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 12:17:08.764066 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 12:17:08.764066 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 12:17:08.764066 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 12:17:08.764066 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 12:17:08.764066 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 12:17:08.764066 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 12:17:08.764066 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 12:17:08.764066 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 12:17:08.764066 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 12:17:08.764066 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 12:17:08.764066 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 12:17:08.764066 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 12:17:08.764066 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 12:17:08.765435 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 12:17:08.765435 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jun 16 12:17:08.765435 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 12:17:08.765435 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jun 16 12:17:08.765435 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 12:17:08.765435 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 12:17:08.765435 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 12:17:08.765435 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jun 16 12:17:08.765435 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 12:17:08.765435 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jun 16 12:17:08.765435 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 12:17:08.765435 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 12:17:08.765435 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 16 12:17:08.765435 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jun 16 12:17:08.765435 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 655/1298] 10.222.0.44 () {56 vars in 1117 bytes} [Thu Jun 16 12:17:08 2022] GET /identity/v3/services/placement => generated 90 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 12:17:08.770441 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91236f1e-fc8e-4192-8a51-b50e698d6474 None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:17:08.789275 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:17:08.867272 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91236f1e-fc8e-4192-8a51-b50e698d6474 None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:17:08.899500 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca7eddc-fa1c-4a95-86c4-4f210f1e7c58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:17:08.900143 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca7eddc-fa1c-4a95-86c4-4f210f1e7c58 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:17:08.900417 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca7eddc-fa1c-4a95-86c4-4f210f1e7c58 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:17:08.900683 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca7eddc-fa1c-4a95-86c4-4f210f1e7c58 None admin] PATH_INFO: `/v3/services` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:17:08.901401 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca7eddc-fa1c-4a95-86c4-4f210f1e7c58 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:17:08.901703 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca7eddc-fa1c-4a95-86c4-4f210f1e7c58 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:17:08.903052 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca7eddc-fa1c-4a95-86c4-4f210f1e7c58 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:17:08.907965 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 644/1299] 10.222.0.44 () {56 vars in 1116 bytes} [Thu Jun 16 12:17:08 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:17:08.914021 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65bbc6f-41c2-4e6e-999d-2cb2264d30c0 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:17:08.946441 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:17:09.012365 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65bbc6f-41c2-4e6e-999d-2cb2264d30c0 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:17:09.044518 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94457bea-b856-45d6-b9ee-f68addb90b27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:17:09.045188 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94457bea-b856-45d6-b9ee-f68addb90b27 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:17:09.045468 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94457bea-b856-45d6-b9ee-f68addb90b27 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:17:09.045739 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94457bea-b856-45d6-b9ee-f68addb90b27 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:17:09.046514 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94457bea-b856-45d6-b9ee-f68addb90b27 None admin] RBAC: Adding query filter params (interface=public, service_id=15f7036639764eb880511e0f8346a0a4, region_id=RegionOne) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:17:09.046820 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94457bea-b856-45d6-b9ee-f68addb90b27 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:17:09.048179 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94457bea-b856-45d6-b9ee-f68addb90b27 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:17:09.053651 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 656/1300] 10.222.0.44 () {56 vars in 1251 bytes} [Thu Jun 16 12:17:08 2022] GET /identity/v3/endpoints?service_id=15f7036639764eb880511e0f8346a0a4&interface=public®ion_id=RegionOne => generated 194 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:17:09.059783 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca7eddc-fa1c-4a95-86c4-4f210f1e7c58 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:17:09.137489 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:17:09.154871 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca7eddc-fa1c-4a95-86c4-4f210f1e7c58 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:17:09.187655 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cfcb02-f201-4ed8-a0d6-205e679ad0be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:17:09.188292 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cfcb02-f201-4ed8-a0d6-205e679ad0be None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:17:09.188569 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cfcb02-f201-4ed8-a0d6-205e679ad0be None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:17:09.188868 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cfcb02-f201-4ed8-a0d6-205e679ad0be None admin] PATH_INFO: `/v3/services` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:17:09.189532 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cfcb02-f201-4ed8-a0d6-205e679ad0be None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:17:09.190865 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cfcb02-f201-4ed8-a0d6-205e679ad0be None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:17:09.197419 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 645/1301] 10.222.0.44 () {56 vars in 1087 bytes} [Thu Jun 16 12:17:09 2022] GET /identity/v3/services => generated 2191 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 12:17:11.270200 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586c12c0-5428-4b92-9823-7c687e022bf2 None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:17:11.271247 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586c12c0-5428-4b92-9823-7c687e022bf2 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:17:11.271247 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586c12c0-5428-4b92-9823-7c687e022bf2 None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:17:11.272593 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 657/1302] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 12:17:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 12:17:11.277608 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b825a5ef-3be3-4a11-b276-3c266520ef41 None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:17:11.277994 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b825a5ef-3be3-4a11-b276-3c266520ef41 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:17:11.278164 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b825a5ef-3be3-4a11-b276-3c266520ef41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:17:11.295220 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-b825a5ef-3be3-4a11-b276-3c266520ef41 None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:17:11.296403 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-b825a5ef-3be3-4a11-b276-3c266520ef41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:17:11.359956 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 646/1303] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 12:17:11 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 12:17:11.382669 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586c12c0-5428-4b92-9823-7c687e022bf2 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:17:11.473614 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:17:11.480675 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586c12c0-5428-4b92-9823-7c687e022bf2 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:17:11.512616 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95436fb0-9bfd-4cc0-99d7-1bca8a49e750 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:17:11.513417 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95436fb0-9bfd-4cc0-99d7-1bca8a49e750 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:17:11.513691 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95436fb0-9bfd-4cc0-99d7-1bca8a49e750 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:17:11.513957 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95436fb0-9bfd-4cc0-99d7-1bca8a49e750 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:17:11.514587 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95436fb0-9bfd-4cc0-99d7-1bca8a49e750 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:17:11.515935 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95436fb0-9bfd-4cc0-99d7-1bca8a49e750 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:17:11.528058 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-95436fb0-9bfd-4cc0-99d7-1bca8a49e750 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 16 12:17:11.528058 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 12:17:11.528058 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 12:17:11.528058 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 12:17:11.528058 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 12:17:11.528058 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 12:17:11.528058 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 12:17:11.528058 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 12:17:11.528058 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 16 12:17:11.528058 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jun 16 12:17:11.528058 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 12:17:11.528058 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jun 16 12:17:11.528058 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 12:17:11.528058 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 12:17:11.528058 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 12:17:11.528058 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 12:17:11.528058 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 12:17:11.529238 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 12:17:11.529238 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 12:17:11.529238 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 12:17:11.529238 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 12:17:11.529238 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 12:17:11.529238 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 12:17:11.529238 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 12:17:11.529238 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 12:17:11.529238 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 12:17:11.529238 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 12:17:11.529238 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 12:17:11.529238 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 12:17:11.529238 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 12:17:11.529238 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 12:17:11.529238 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 12:17:11.529238 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 12:17:11.530267 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 12:17:11.530267 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jun 16 12:17:11.530267 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 12:17:11.530267 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jun 16 12:17:11.530267 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 12:17:11.530267 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 12:17:11.530267 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 12:17:11.530267 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jun 16 12:17:11.530267 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 12:17:11.530267 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jun 16 12:17:11.530267 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 12:17:11.530267 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 12:17:11.530267 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 16 12:17:11.530267 dv-cinder-846149-2-smb devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jun 16 12:17:11.530267 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 658/1304] 10.222.0.44 () {56 vars in 1117 bytes} [Thu Jun 16 12:17:11 2022] GET /identity/v3/services/placement => generated 90 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 12:17:11.535293 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b825a5ef-3be3-4a11-b276-3c266520ef41 None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:17:11.607528 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:17:11.629651 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b825a5ef-3be3-4a11-b276-3c266520ef41 None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:17:11.663390 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01d9266-0f7d-4951-98af-ba469cf1578f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:17:11.664030 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01d9266-0f7d-4951-98af-ba469cf1578f None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:17:11.664305 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01d9266-0f7d-4951-98af-ba469cf1578f None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:17:11.664572 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01d9266-0f7d-4951-98af-ba469cf1578f None admin] PATH_INFO: `/v3/services` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:17:11.665295 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01d9266-0f7d-4951-98af-ba469cf1578f None admin] RBAC: Adding query filter params (name=placement) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:17:11.665597 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01d9266-0f7d-4951-98af-ba469cf1578f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:17:11.666943 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01d9266-0f7d-4951-98af-ba469cf1578f None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:17:11.671912 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 647/1305] 10.222.0.44 () {56 vars in 1116 bytes} [Thu Jun 16 12:17:11 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:17:11.677386 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95436fb0-9bfd-4cc0-99d7-1bca8a49e750 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:17:11.772492 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95436fb0-9bfd-4cc0-99d7-1bca8a49e750 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:17:11.804896 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bfb6a9-ba71-4a24-a090-ba34a370df8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:17:11.805478 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bfb6a9-ba71-4a24-a090-ba34a370df8a None admin] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:17:11.805764 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bfb6a9-ba71-4a24-a090-ba34a370df8a None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:17:11.806039 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bfb6a9-ba71-4a24-a090-ba34a370df8a None admin] PATH_INFO: `/v3/endpoints` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:17:11.806776 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bfb6a9-ba71-4a24-a090-ba34a370df8a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:17:11.808130 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bfb6a9-ba71-4a24-a090-ba34a370df8a None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:17:11.826039 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 659/1306] 10.222.0.44 () {60 vars in 1144 bytes} [Thu Jun 16 12:17:11 2022] POST /identity/v3/endpoints => generated 331 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 12:17:21.668980 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=30 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:17:21.821805 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:18:13.957219 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044659f8-d5b2-43b3-8888-6e2ae2b1e5ce None None] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:18:13.957809 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044659f8-d5b2-43b3-8888-6e2ae2b1e5ce None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:18:13.957809 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044659f8-d5b2-43b3-8888-6e2ae2b1e5ce None None] PATH_INFO: `/` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:18:13.961319 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 648/1307] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 12:18:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 12:18:13.964198 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90adfaf4-5240-4b03-bcfa-84b09733804a None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:18:13.964646 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90adfaf4-5240-4b03-bcfa-84b09733804a None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:18:13.964743 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90adfaf4-5240-4b03-bcfa-84b09733804a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:18:14.049263 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-90adfaf4-5240-4b03-bcfa-84b09733804a None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:18:14.050672 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-90adfaf4-5240-4b03-bcfa-84b09733804a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:18:14.257382 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 660/1308] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 12:18:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 294 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:18:14.304618 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2dd17b-1df6-4fdf-9934-deb1e7d11904 None None] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:18:14.305690 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2dd17b-1df6-4fdf-9934-deb1e7d11904 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:18:14.306729 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2dd17b-1df6-4fdf-9934-deb1e7d11904 None None] PATH_INFO: `/` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:18:14.308591 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 649/1309] 10.222.0.44 () {54 vars in 964 bytes} [Thu Jun 16 12:18:14 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 12:18:14.315570 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4f2634-4717-4451-bbd9-3441fee215c0 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:18:14.315861 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4f2634-4717-4451-bbd9-3441fee215c0 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:18:14.316331 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4f2634-4717-4451-bbd9-3441fee215c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:18:14.397959 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-2c4f2634-4717-4451-bbd9-3441fee215c0 None None] MFA Rules not processed for user `e1094729b25a4be7b0b394998c9ca681`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:18:14.399226 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-2c4f2634-4717-4451-bbd9-3441fee215c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:18:14.421154 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:18:14.479911 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 661/1310] 10.222.0.44 () {58 vars in 1061 bytes} [Thu Jun 16 12:18:14 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:18:14.488946 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2dd17b-1df6-4fdf-9934-deb1e7d11904 None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:18:14.490680 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-df2dd17b-1df6-4fdf-9934-deb1e7d11904 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:18:14.608523 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2dd17b-1df6-4fdf-9934-deb1e7d11904 None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:18:14.685403 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bd5206-4abc-4dfc-a40f-cc7bef1ae02b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1094729b25a4be7b0b394998c9ca681', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '601361df39e34fcca71175aa94e425c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:18:14.686047 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bd5206-4abc-4dfc-a40f-cc7bef1ae02b service neutron] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:18:14.686325 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bd5206-4abc-4dfc-a40f-cc7bef1ae02b service neutron] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:18:14.687138 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bd5206-4abc-4dfc-a40f-cc7bef1ae02b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:18:14.688792 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-04bd5206-4abc-4dfc-a40f-cc7bef1ae02b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:18:14.746387 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:18:14.805897 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bd5206-4abc-4dfc-a40f-cc7bef1ae02b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:18:14.807447 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bd5206-4abc-4dfc-a40f-cc7bef1ae02b service neutron] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:18:14.827924 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 650/1311] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 12:18:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 12:18:17.245952 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821b6eaa-4535-4c5c-9525-d132c63a8eb5 None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:18:17.246524 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821b6eaa-4535-4c5c-9525-d132c63a8eb5 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:18:17.246730 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821b6eaa-4535-4c5c-9525-d132c63a8eb5 None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:18:17.248224 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 662/1312] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 12:18:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 12:18:17.254875 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbdc9fa-3997-4a33-930a-b68e0c541d24 None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:18:17.255405 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbdc9fa-3997-4a33-930a-b68e0c541d24 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:18:17.255405 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbdc9fa-3997-4a33-930a-b68e0c541d24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:18:17.344372 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-0cbdc9fa-3997-4a33-930a-b68e0c541d24 None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:18:17.345655 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-0cbdc9fa-3997-4a33-930a-b68e0c541d24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:18:17.446233 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 651/1313] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 12:18:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:18:17.485850 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821b6eaa-4535-4c5c-9525-d132c63a8eb5 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:18:17.487457 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-821b6eaa-4535-4c5c-9525-d132c63a8eb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:18:17.588978 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821b6eaa-4535-4c5c-9525-d132c63a8eb5 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:18:17.658343 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:18:17.660925 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451fa007-849f-4723-ae80-7a9164836c67 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1094729b25a4be7b0b394998c9ca681', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '601361df39e34fcca71175aa94e425c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:18:17.661847 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451fa007-849f-4723-ae80-7a9164836c67 service neutron] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:18:17.662411 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451fa007-849f-4723-ae80-7a9164836c67 service neutron] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:18:17.662845 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451fa007-849f-4723-ae80-7a9164836c67 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:18:17.665005 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-451fa007-849f-4723-ae80-7a9164836c67 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:18:17.775376 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451fa007-849f-4723-ae80-7a9164836c67 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:18:17.776841 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451fa007-849f-4723-ae80-7a9164836c67 service neutron] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:18:17.796554 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 663/1314] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 12:18:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 12:18:20.198277 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac339c4-3a18-465d-bbbf-6d0bfd8c1845 None None] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:18:20.198778 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac339c4-3a18-465d-bbbf-6d0bfd8c1845 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:18:20.198886 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac339c4-3a18-465d-bbbf-6d0bfd8c1845 None None] PATH_INFO: `/` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:18:20.200189 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 652/1315] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 12:18:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 12:18:20.205626 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765209d0-f341-4176-9c80-e7799e62e3aa None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:18:20.206071 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765209d0-f341-4176-9c80-e7799e62e3aa None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:18:20.206181 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765209d0-f341-4176-9c80-e7799e62e3aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:18:20.274823 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-765209d0-f341-4176-9c80-e7799e62e3aa None None] MFA Rules not processed for user `057c3bd7c27f458f8c008fb91e974956`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:18:20.276080 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-765209d0-f341-4176-9c80-e7799e62e3aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:18:20.331044 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:18:20.377964 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 664/1316] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 12:18:20 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:18:20.417525 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac339c4-3a18-465d-bbbf-6d0bfd8c1845 None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:18:20.419063 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-3ac339c4-3a18-465d-bbbf-6d0bfd8c1845 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:18:20.430059 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:18:20.537418 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac339c4-3a18-465d-bbbf-6d0bfd8c1845 None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:18:20.621695 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddc9290-5fcc-4111-b7a2-b02f3b03fa65 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1094729b25a4be7b0b394998c9ca681', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '601361df39e34fcca71175aa94e425c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:18:20.622331 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddc9290-5fcc-4111-b7a2-b02f3b03fa65 service neutron] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:18:20.622605 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddc9290-5fcc-4111-b7a2-b02f3b03fa65 service neutron] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:18:20.622871 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddc9290-5fcc-4111-b7a2-b02f3b03fa65 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:18:20.624598 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-bddc9290-5fcc-4111-b7a2-b02f3b03fa65 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:18:20.693289 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:18:20.742880 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddc9290-5fcc-4111-b7a2-b02f3b03fa65 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:18:20.744249 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddc9290-5fcc-4111-b7a2-b02f3b03fa65 service neutron] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:18:20.765411 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 653/1317] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 12:18:20 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 12:18:23.378491 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa8b856-d25e-40ff-9167-51b3eec6bd76 None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:18:23.379023 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa8b856-d25e-40ff-9167-51b3eec6bd76 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:18:23.379023 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa8b856-d25e-40ff-9167-51b3eec6bd76 None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:18:23.380419 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 665/1318] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 12:18:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 12:18:23.385564 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3f9333-6a1c-40b6-a6da-1d2f3aeefc34 None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:18:23.385987 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3f9333-6a1c-40b6-a6da-1d2f3aeefc34 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:18:23.386111 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3f9333-6a1c-40b6-a6da-1d2f3aeefc34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:18:23.449113 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-9c3f9333-6a1c-40b6-a6da-1d2f3aeefc34 None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:18:23.450311 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-9c3f9333-6a1c-40b6-a6da-1d2f3aeefc34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:18:23.549517 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 654/1319] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 12:18:23 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:18:23.587676 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa8b856-d25e-40ff-9167-51b3eec6bd76 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:18:23.589248 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-eaa8b856-d25e-40ff-9167-51b3eec6bd76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:18:23.690480 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa8b856-d25e-40ff-9167-51b3eec6bd76 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:18:23.763860 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ccecc0-b502-4bf6-bceb-db6f2b95b36f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1094729b25a4be7b0b394998c9ca681', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '601361df39e34fcca71175aa94e425c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:18:23.764500 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ccecc0-b502-4bf6-bceb-db6f2b95b36f service neutron] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:18:23.764802 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ccecc0-b502-4bf6-bceb-db6f2b95b36f service neutron] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:18:23.765078 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ccecc0-b502-4bf6-bceb-db6f2b95b36f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:18:23.766722 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-e3ccecc0-b502-4bf6-bceb-db6f2b95b36f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:18:23.774018 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:18:23.872594 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ccecc0-b502-4bf6-bceb-db6f2b95b36f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:18:23.874669 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ccecc0-b502-4bf6-bceb-db6f2b95b36f service neutron] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:18:23.892104 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 666/1320] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 12:18:23 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 12:18:26.654901 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8c6e71-def5-47d3-9943-74bd3c195604 None None] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:18:26.655713 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8c6e71-def5-47d3-9943-74bd3c195604 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:18:26.655713 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8c6e71-def5-47d3-9943-74bd3c195604 None None] PATH_INFO: `/` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:18:26.657494 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 655/1321] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 12:18:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 12:18:26.663004 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105e7239-4095-452e-bcd6-366d0c1a6762 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:18:26.663601 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105e7239-4095-452e-bcd6-366d0c1a6762 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:18:26.663601 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105e7239-4095-452e-bcd6-366d0c1a6762 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:18:26.735193 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-105e7239-4095-452e-bcd6-366d0c1a6762 None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:18:26.736417 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-105e7239-4095-452e-bcd6-366d0c1a6762 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:18:26.799938 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:18:26.840165 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 667/1322] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 12:18:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:18:26.875827 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8c6e71-def5-47d3-9943-74bd3c195604 None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:18:26.877494 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-0a8c6e71-def5-47d3-9943-74bd3c195604 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:18:26.896967 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:18:26.985724 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8c6e71-def5-47d3-9943-74bd3c195604 None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:18:27.058483 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d195d609-c758-49f3-9e89-ba58268bfb89 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1094729b25a4be7b0b394998c9ca681', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '601361df39e34fcca71175aa94e425c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:18:27.059051 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d195d609-c758-49f3-9e89-ba58268bfb89 service neutron] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:18:27.059331 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d195d609-c758-49f3-9e89-ba58268bfb89 service neutron] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:18:27.059602 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d195d609-c758-49f3-9e89-ba58268bfb89 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:18:27.061852 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-d195d609-c758-49f3-9e89-ba58268bfb89 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:18:27.132118 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:18:27.170091 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d195d609-c758-49f3-9e89-ba58268bfb89 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:18:27.171516 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d195d609-c758-49f3-9e89-ba58268bfb89 service neutron] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:18:27.190241 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 656/1323] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 12:18:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 12:18:29.353630 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910c0794-1801-4b58-9d10-43f2e9195dc0 None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:18:29.354247 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910c0794-1801-4b58-9d10-43f2e9195dc0 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:18:29.354247 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910c0794-1801-4b58-9d10-43f2e9195dc0 None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:18:29.355552 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 668/1324] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 12:18:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 12:18:29.360851 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbfc876-e811-40c6-a35a-6cfe87607d82 None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:18:29.361297 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbfc876-e811-40c6-a35a-6cfe87607d82 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:18:29.361399 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbfc876-e811-40c6-a35a-6cfe87607d82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:18:29.425239 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-cbbfc876-e811-40c6-a35a-6cfe87607d82 None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:18:29.426449 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-cbbfc876-e811-40c6-a35a-6cfe87607d82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:18:29.522974 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 657/1325] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 12:18:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:18:29.573925 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5081c560-0064-4283-867f-a447fedf80dd None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:18:29.574206 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5081c560-0064-4283-867f-a447fedf80dd None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:18:29.574477 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5081c560-0064-4283-867f-a447fedf80dd None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:18:29.576487 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 669/1326] 10.222.0.44 () {54 vars in 964 bytes} [Thu Jun 16 12:18:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 12:18:29.582861 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfe57be-96df-4f4d-8a88-f318a6580403 None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:18:29.583288 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfe57be-96df-4f4d-8a88-f318a6580403 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:18:29.583575 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfe57be-96df-4f4d-8a88-f318a6580403 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:18:29.617410 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:18:29.663809 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-4dfe57be-96df-4f4d-8a88-f318a6580403 None None] MFA Rules not processed for user `e1094729b25a4be7b0b394998c9ca681`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:18:29.665067 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-4dfe57be-96df-4f4d-8a88-f318a6580403 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:18:29.743745 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 658/1327] 10.222.0.44 () {58 vars in 1061 bytes} [Thu Jun 16 12:18:29 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:18:29.752510 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5081c560-0064-4283-867f-a447fedf80dd None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:18:29.754146 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-5081c560-0064-4283-867f-a447fedf80dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:18:29.865489 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5081c560-0064-4283-867f-a447fedf80dd None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:18:29.941555 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4de5e4b-ef8c-41fd-9271-83869499a1cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1094729b25a4be7b0b394998c9ca681', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '601361df39e34fcca71175aa94e425c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:18:29.942213 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4de5e4b-ef8c-41fd-9271-83869499a1cc service neutron] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:18:29.942497 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4de5e4b-ef8c-41fd-9271-83869499a1cc service neutron] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:18:29.942773 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4de5e4b-ef8c-41fd-9271-83869499a1cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:18:29.944429 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-b4de5e4b-ef8c-41fd-9271-83869499a1cc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:18:29.961613 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:18:30.055176 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4de5e4b-ef8c-41fd-9271-83869499a1cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:18:30.056655 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4de5e4b-ef8c-41fd-9271-83869499a1cc service neutron] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:18:30.076716 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 670/1328] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 12:18:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 12:18:32.453943 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08418de3-78f1-47d8-9464-cc262390e6b4 None None] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:18:32.454447 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08418de3-78f1-47d8-9464-cc262390e6b4 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:18:32.454549 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08418de3-78f1-47d8-9464-cc262390e6b4 None None] PATH_INFO: `/` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:18:32.455865 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 659/1329] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 12:18:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 12:18:32.460977 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538627d3-d8a2-4000-9082-a2875f73af68 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:18:32.461403 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538627d3-d8a2-4000-9082-a2875f73af68 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:18:32.461526 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538627d3-d8a2-4000-9082-a2875f73af68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:18:32.525888 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-538627d3-d8a2-4000-9082-a2875f73af68 None None] MFA Rules not processed for user `057c3bd7c27f458f8c008fb91e974956`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:18:32.527088 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-538627d3-d8a2-4000-9082-a2875f73af68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:18:32.591604 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:18:32.623484 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 671/1330] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 12:18:32 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:18:32.660588 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08418de3-78f1-47d8-9464-cc262390e6b4 None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:18:32.662170 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-08418de3-78f1-47d8-9464-cc262390e6b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:18:32.767960 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08418de3-78f1-47d8-9464-cc262390e6b4 None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:18:32.788158 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:18:32.840944 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29888458-9bbe-4e56-ac71-20af5e7eb7bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1094729b25a4be7b0b394998c9ca681', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '601361df39e34fcca71175aa94e425c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:18:32.842102 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29888458-9bbe-4e56-ac71-20af5e7eb7bb service neutron] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:18:32.842382 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29888458-9bbe-4e56-ac71-20af5e7eb7bb service neutron] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:18:32.842660 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29888458-9bbe-4e56-ac71-20af5e7eb7bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:18:32.844296 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-29888458-9bbe-4e56-ac71-20af5e7eb7bb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:18:32.952953 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29888458-9bbe-4e56-ac71-20af5e7eb7bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:18:32.954423 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29888458-9bbe-4e56-ac71-20af5e7eb7bb service neutron] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:18:32.974274 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 660/1331] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 12:18:32 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 12:18:35.502867 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9eb982-16bd-4f12-85ce-4ecec10cc0a3 None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:18:35.503434 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9eb982-16bd-4f12-85ce-4ecec10cc0a3 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:18:35.503434 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9eb982-16bd-4f12-85ce-4ecec10cc0a3 None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:18:35.504829 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 672/1332] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 12:18:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 12:18:35.509861 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccb2f7e-496e-4224-a02c-01428ed96d51 None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:18:35.510301 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccb2f7e-496e-4224-a02c-01428ed96d51 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:18:35.510489 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccb2f7e-496e-4224-a02c-01428ed96d51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:18:35.575906 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:18:35.579316 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-3ccb2f7e-496e-4224-a02c-01428ed96d51 None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:18:35.580713 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-3ccb2f7e-496e-4224-a02c-01428ed96d51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:18:35.674589 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 661/1333] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 12:18:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:18:35.710883 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9eb982-16bd-4f12-85ce-4ecec10cc0a3 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:18:35.712432 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-7d9eb982-16bd-4f12-85ce-4ecec10cc0a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:18:35.818581 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9eb982-16bd-4f12-85ce-4ecec10cc0a3 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:18:35.892247 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc270c4a-c304-4db6-85d1-97b83ed74437 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1094729b25a4be7b0b394998c9ca681', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '601361df39e34fcca71175aa94e425c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:18:35.892921 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc270c4a-c304-4db6-85d1-97b83ed74437 service neutron] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:18:35.893199 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc270c4a-c304-4db6-85d1-97b83ed74437 service neutron] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:18:35.893468 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc270c4a-c304-4db6-85d1-97b83ed74437 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:18:35.895148 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-dc270c4a-c304-4db6-85d1-97b83ed74437 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:18:35.922092 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:18:36.002886 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc270c4a-c304-4db6-85d1-97b83ed74437 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:18:36.004377 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc270c4a-c304-4db6-85d1-97b83ed74437 service neutron] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:18:36.022039 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 673/1334] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 12:18:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 12:18:38.199504 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365e2e99-f164-4eda-8337-bc3f9bc71d1d None None] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:18:38.200102 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365e2e99-f164-4eda-8337-bc3f9bc71d1d None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:18:38.200102 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365e2e99-f164-4eda-8337-bc3f9bc71d1d None None] PATH_INFO: `/` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:18:38.201510 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 662/1335] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 12:18:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 12:18:38.206721 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32d24bc-6838-40b1-aba3-5b09bb811f08 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:18:38.207110 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32d24bc-6838-40b1-aba3-5b09bb811f08 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:18:38.207297 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32d24bc-6838-40b1-aba3-5b09bb811f08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:18:38.269872 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-b32d24bc-6838-40b1-aba3-5b09bb811f08 None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:18:38.271056 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-b32d24bc-6838-40b1-aba3-5b09bb811f08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:18:38.343545 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:18:38.366248 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 674/1336] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 12:18:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:18:38.410429 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365e2e99-f164-4eda-8337-bc3f9bc71d1d None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:18:38.412611 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-365e2e99-f164-4eda-8337-bc3f9bc71d1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:18:38.518638 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365e2e99-f164-4eda-8337-bc3f9bc71d1d None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:18:38.546997 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:18:38.590992 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bca0fa9-b654-45b3-8442-ab40f46a4e91 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1094729b25a4be7b0b394998c9ca681', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '601361df39e34fcca71175aa94e425c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:18:38.591625 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bca0fa9-b654-45b3-8442-ab40f46a4e91 service neutron] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:18:38.591902 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bca0fa9-b654-45b3-8442-ab40f46a4e91 service neutron] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:18:38.592171 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bca0fa9-b654-45b3-8442-ab40f46a4e91 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:18:38.593818 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-2bca0fa9-b654-45b3-8442-ab40f46a4e91 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:18:38.698586 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bca0fa9-b654-45b3-8442-ab40f46a4e91 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:18:38.700542 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bca0fa9-b654-45b3-8442-ab40f46a4e91 service neutron] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:18:38.719057 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 663/1337] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 12:18:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 12:18:41.285858 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce91b6c-12e2-487e-a824-fbccae59bc90 None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:18:41.286415 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce91b6c-12e2-487e-a824-fbccae59bc90 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:18:41.286415 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce91b6c-12e2-487e-a824-fbccae59bc90 None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:18:41.287780 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 675/1338] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 12:18:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 12:18:41.293038 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296b683b-b006-4226-aae5-0578b570ecad None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:18:41.294096 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296b683b-b006-4226-aae5-0578b570ecad None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:18:41.294096 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296b683b-b006-4226-aae5-0578b570ecad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:18:41.358547 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-296b683b-b006-4226-aae5-0578b570ecad None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:18:41.359749 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-296b683b-b006-4226-aae5-0578b570ecad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:18:41.367818 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:18:41.456328 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 664/1339] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 12:18:41 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:18:41.491331 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce91b6c-12e2-487e-a824-fbccae59bc90 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:18:41.492888 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-0ce91b6c-12e2-487e-a824-fbccae59bc90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:18:41.599163 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce91b6c-12e2-487e-a824-fbccae59bc90 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:18:41.669364 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d5c390-73cd-4778-9ede-6ebe036b42dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1094729b25a4be7b0b394998c9ca681', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '601361df39e34fcca71175aa94e425c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:18:41.669998 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d5c390-73cd-4778-9ede-6ebe036b42dd service neutron] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:18:41.670272 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d5c390-73cd-4778-9ede-6ebe036b42dd service neutron] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:18:41.670538 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d5c390-73cd-4778-9ede-6ebe036b42dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:18:41.672154 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-e1d5c390-73cd-4778-9ede-6ebe036b42dd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:18:41.708063 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:18:41.788204 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d5c390-73cd-4778-9ede-6ebe036b42dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:18:41.789691 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d5c390-73cd-4778-9ede-6ebe036b42dd service neutron] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:18:41.807745 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 676/1340] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 12:18:41 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 12:18:45.905657 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a42bdf1-355c-41fc-bf7d-bfe36f0c39a7 None None] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:18:45.906225 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a42bdf1-355c-41fc-bf7d-bfe36f0c39a7 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:18:45.906225 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a42bdf1-355c-41fc-bf7d-bfe36f0c39a7 None None] PATH_INFO: `/` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:18:45.907581 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 665/1341] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 12:18:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 12:18:45.913068 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbe5111-eabe-42f6-ad5c-c52bf059d605 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:18:45.913490 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbe5111-eabe-42f6-ad5c-c52bf059d605 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:18:45.913608 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbe5111-eabe-42f6-ad5c-c52bf059d605 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:18:45.984888 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-ebbe5111-eabe-42f6-ad5c-c52bf059d605 None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:18:45.986108 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-ebbe5111-eabe-42f6-ad5c-c52bf059d605 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:18:46.082258 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:18:46.095707 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 677/1342] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 12:18:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:18:46.134533 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a42bdf1-355c-41fc-bf7d-bfe36f0c39a7 None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:18:46.137280 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-5a42bdf1-355c-41fc-bf7d-bfe36f0c39a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:18:46.233729 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a42bdf1-355c-41fc-bf7d-bfe36f0c39a7 None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:18:46.237329 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa65879-b63f-498f-8a5a-a07e7cb12803 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1094729b25a4be7b0b394998c9ca681', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '601361df39e34fcca71175aa94e425c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:18:46.237921 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa65879-b63f-498f-8a5a-a07e7cb12803 service neutron] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:18:46.238204 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa65879-b63f-498f-8a5a-a07e7cb12803 service neutron] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:18:46.238481 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa65879-b63f-498f-8a5a-a07e7cb12803 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:18:46.248239 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa65879-b63f-498f-8a5a-a07e7cb12803 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:18:46.249705 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa65879-b63f-498f-8a5a-a07e7cb12803 service neutron] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:18:46.259400 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 666/1343] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 12:18:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 12:18:49.006622 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77e41cf-3dfd-4467-8c66-3647c5db096d None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:18:49.007179 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77e41cf-3dfd-4467-8c66-3647c5db096d None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:18:49.007179 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77e41cf-3dfd-4467-8c66-3647c5db096d None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:18:49.008545 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 678/1344] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 12:18:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 12:18:49.014211 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f19079-25fd-4b54-b80a-d00faf0dd451 None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:18:49.014714 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f19079-25fd-4b54-b80a-d00faf0dd451 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:18:49.014807 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f19079-25fd-4b54-b80a-d00faf0dd451 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:18:49.045525 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-f2f19079-25fd-4b54-b80a-d00faf0dd451 None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:18:49.046507 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-f2f19079-25fd-4b54-b80a-d00faf0dd451 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:18:49.077086 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:18:49.130564 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 667/1345] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 12:18:49 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:18:49.168184 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77e41cf-3dfd-4467-8c66-3647c5db096d None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:18:49.178858 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77e41cf-3dfd-4467-8c66-3647c5db096d None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:18:49.182297 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70df3f0-b433-4feb-b69d-62ab3458027a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1094729b25a4be7b0b394998c9ca681', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '601361df39e34fcca71175aa94e425c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:18:49.183011 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70df3f0-b433-4feb-b69d-62ab3458027a service neutron] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:18:49.183378 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70df3f0-b433-4feb-b69d-62ab3458027a service neutron] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:18:49.183714 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70df3f0-b433-4feb-b69d-62ab3458027a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:18:49.192507 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70df3f0-b433-4feb-b69d-62ab3458027a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:18:49.194326 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70df3f0-b433-4feb-b69d-62ab3458027a service neutron] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:18:49.204522 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 679/1346] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 12:18:49 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 12:18:53.520411 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd01236-d041-4099-b67e-5d4980c803db None None] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:18:53.520975 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd01236-d041-4099-b67e-5d4980c803db None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:18:53.521131 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd01236-d041-4099-b67e-5d4980c803db None None] PATH_INFO: `/` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:18:53.522631 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 668/1347] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 12:18:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 12:18:53.528342 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0038cac1-0cf4-4319-858d-64099026b123 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:18:53.529040 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0038cac1-0cf4-4319-858d-64099026b123 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:18:53.529371 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0038cac1-0cf4-4319-858d-64099026b123 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:18:53.547690 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-0038cac1-0cf4-4319-858d-64099026b123 None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:18:53.548944 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-0038cac1-0cf4-4319-858d-64099026b123 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:18:53.557205 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 680/1348] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 12:18:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:18:53.596124 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd01236-d041-4099-b67e-5d4980c803db None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:18:53.607337 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd01236-d041-4099-b67e-5d4980c803db None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:18:53.610921 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d9f91f-4004-46a7-91a4-8b612deb281f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1094729b25a4be7b0b394998c9ca681', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '601361df39e34fcca71175aa94e425c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:18:53.611574 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d9f91f-4004-46a7-91a4-8b612deb281f service neutron] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:18:53.611968 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d9f91f-4004-46a7-91a4-8b612deb281f service neutron] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:18:53.612254 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d9f91f-4004-46a7-91a4-8b612deb281f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:18:53.621313 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d9f91f-4004-46a7-91a4-8b612deb281f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:18:53.622768 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d9f91f-4004-46a7-91a4-8b612deb281f service neutron] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:18:53.638957 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 669/1349] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 12:18:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 12:18:58.639225 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b516fea9-3027-481f-82d7-2d0a7e02c00b None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:18:58.640131 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b516fea9-3027-481f-82d7-2d0a7e02c00b None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:18:58.640998 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b516fea9-3027-481f-82d7-2d0a7e02c00b None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:18:58.642836 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 681/1350] 10.222.0.44 () {54 vars in 921 bytes} [Thu Jun 16 12:18:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 12:18:58.650783 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167cc51c-96dd-4ba6-a542-da2fd0bee36b None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:18:58.651732 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167cc51c-96dd-4ba6-a542-da2fd0bee36b None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:18:58.652219 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167cc51c-96dd-4ba6-a542-da2fd0bee36b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:18:58.772374 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-167cc51c-96dd-4ba6-a542-da2fd0bee36b None None] MFA Rules not processed for user `8bff8ccf460a403d993c39327bbcbd29`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:18:58.774045 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-167cc51c-96dd-4ba6-a542-da2fd0bee36b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:18:58.867326 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 670/1351] 10.222.0.44 () {58 vars in 1018 bytes} [Thu Jun 16 12:18:58 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:19:03.220370 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be6cbc7-05d1-4fba-830d-b7ddb0c54af8 None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:19:03.221311 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be6cbc7-05d1-4fba-830d-b7ddb0c54af8 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:19:03.221713 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be6cbc7-05d1-4fba-830d-b7ddb0c54af8 None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:19:03.223202 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 682/1352] 10.222.0.44 () {54 vars in 921 bytes} [Thu Jun 16 12:19:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 12:19:03.229510 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa3b90c-1ff9-4d53-bd05-2f3a5a97939d None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:19:03.229925 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa3b90c-1ff9-4d53-bd05-2f3a5a97939d None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:19:03.230056 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa3b90c-1ff9-4d53-bd05-2f3a5a97939d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:19:03.248838 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-2fa3b90c-1ff9-4d53-bd05-2f3a5a97939d None None] MFA Rules not processed for user `8bff8ccf460a403d993c39327bbcbd29`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:19:03.250127 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-2fa3b90c-1ff9-4d53-bd05-2f3a5a97939d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:19:03.258613 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 671/1353] 10.222.0.44 () {58 vars in 1018 bytes} [Thu Jun 16 12:19:03 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:19:03.542035 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=13 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:19:04.556249 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe31199b-5341-47de-8e44-3e1dfb3b86dc None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:19:04.556934 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe31199b-5341-47de-8e44-3e1dfb3b86dc None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:19:04.556934 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe31199b-5341-47de-8e44-3e1dfb3b86dc None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:19:04.558772 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 683/1354] 10.222.0.44 () {54 vars in 921 bytes} [Thu Jun 16 12:19:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 12:19:04.563823 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39372bd-a150-4e03-9387-32b49a131936 None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:19:04.564220 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39372bd-a150-4e03-9387-32b49a131936 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:19:04.564381 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39372bd-a150-4e03-9387-32b49a131936 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:19:04.583828 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-a39372bd-a150-4e03-9387-32b49a131936 None None] MFA Rules not processed for user `8bff8ccf460a403d993c39327bbcbd29`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:19:04.585048 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-a39372bd-a150-4e03-9387-32b49a131936 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:19:04.594263 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 672/1355] 10.222.0.44 () {58 vars in 1018 bytes} [Thu Jun 16 12:19:04 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:19:08.379396 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb437f9e-d361-477b-8aa2-99faf2cbc732 None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:19:08.380350 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb437f9e-d361-477b-8aa2-99faf2cbc732 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:19:08.380809 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb437f9e-d361-477b-8aa2-99faf2cbc732 None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:19:08.382346 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 684/1356] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 12:19:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 12:19:08.387597 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1e5ade-2b22-4d2f-8b77-3aefffb1ad5e None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:19:08.388004 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1e5ade-2b22-4d2f-8b77-3aefffb1ad5e None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:19:08.388141 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1e5ade-2b22-4d2f-8b77-3aefffb1ad5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:19:08.407506 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-eb1e5ade-2b22-4d2f-8b77-3aefffb1ad5e None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:19:08.409017 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-eb1e5ade-2b22-4d2f-8b77-3aefffb1ad5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:19:08.417934 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 673/1357] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 12:19:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:19:08.469544 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897aede1-be7f-4b65-b6dc-af46f45aa333 None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:19:08.470023 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897aede1-be7f-4b65-b6dc-af46f45aa333 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:19:08.470431 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897aede1-be7f-4b65-b6dc-af46f45aa333 None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:19:08.472188 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 685/1358] 10.222.0.44 () {54 vars in 961 bytes} [Thu Jun 16 12:19:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 12:19:08.482811 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebede0e-bd16-46b3-a65d-327501d536ce None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:19:08.483388 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebede0e-bd16-46b3-a65d-327501d536ce None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:19:08.483824 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebede0e-bd16-46b3-a65d-327501d536ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:19:08.533111 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:19:08.543170 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-5ebede0e-bd16-46b3-a65d-327501d536ce None None] MFA Rules not processed for user `edfb12d445e74136b90800e93941f468`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:19:08.544606 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-5ebede0e-bd16-46b3-a65d-327501d536ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:19:08.632739 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 674/1359] 10.222.0.44 () {58 vars in 1058 bytes} [Thu Jun 16 12:19:08 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 12:19:08.639344 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897aede1-be7f-4b65-b6dc-af46f45aa333 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:19:08.654541 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897aede1-be7f-4b65-b6dc-af46f45aa333 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:19:08.660033 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9a605e-0c5d-4ce8-a01c-9052fde49282 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edfb12d445e74136b90800e93941f468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '601361df39e34fcca71175aa94e425c4', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:19:08.660720 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9a605e-0c5d-4ce8-a01c-9052fde49282 service nova] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:19:08.661127 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9a605e-0c5d-4ce8-a01c-9052fde49282 service nova] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:19:08.661525 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9a605e-0c5d-4ce8-a01c-9052fde49282 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:19:08.670860 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9a605e-0c5d-4ce8-a01c-9052fde49282 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:19:08.672581 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9a605e-0c5d-4ce8-a01c-9052fde49282 service nova] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:19:08.682606 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 686/1360] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 12:19:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 12:19:11.069133 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111d53e5-c525-41e8-ace3-49a2bd9e9dd6 None None] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:19:11.069678 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111d53e5-c525-41e8-ace3-49a2bd9e9dd6 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:19:11.069678 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111d53e5-c525-41e8-ace3-49a2bd9e9dd6 None None] PATH_INFO: `/` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:19:11.071249 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 675/1361] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 12:19:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 12:19:11.077011 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffd211d-1e1c-44e3-87a4-c26801002061 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:19:11.077543 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffd211d-1e1c-44e3-87a4-c26801002061 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:19:11.077543 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffd211d-1e1c-44e3-87a4-c26801002061 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:19:11.097065 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-bffd211d-1e1c-44e3-87a4-c26801002061 None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:19:11.098303 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-bffd211d-1e1c-44e3-87a4-c26801002061 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:19:11.113398 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 687/1362] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 12:19:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:19:11.152475 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111d53e5-c525-41e8-ace3-49a2bd9e9dd6 None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:19:11.168929 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111d53e5-c525-41e8-ace3-49a2bd9e9dd6 None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:19:11.174342 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb90c631-43d5-4b00-b0f3-2493eee13536 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edfb12d445e74136b90800e93941f468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '601361df39e34fcca71175aa94e425c4', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:19:11.174980 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb90c631-43d5-4b00-b0f3-2493eee13536 service nova] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:19:11.175266 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb90c631-43d5-4b00-b0f3-2493eee13536 service nova] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:19:11.175546 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb90c631-43d5-4b00-b0f3-2493eee13536 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:19:11.184684 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb90c631-43d5-4b00-b0f3-2493eee13536 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:19:11.186307 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb90c631-43d5-4b00-b0f3-2493eee13536 service nova] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:19:11.196148 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 676/1363] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 12:19:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 12:19:13.625453 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd855fe-a70e-493d-8d6c-3b59278b1ea8 None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:19:13.625931 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd855fe-a70e-493d-8d6c-3b59278b1ea8 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:19:13.625931 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd855fe-a70e-493d-8d6c-3b59278b1ea8 None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:19:13.627372 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 688/1364] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 12:19:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 12:19:13.632551 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c48440-285f-4b9d-94ed-611ceafe4c19 None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:19:13.633166 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c48440-285f-4b9d-94ed-611ceafe4c19 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:19:13.633166 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c48440-285f-4b9d-94ed-611ceafe4c19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:19:13.651367 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-f3c48440-285f-4b9d-94ed-611ceafe4c19 None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:19:13.652919 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-f3c48440-285f-4b9d-94ed-611ceafe4c19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:19:13.660741 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 677/1365] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 12:19:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:19:13.708372 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dd8ce3-5d63-4c64-8bd2-dfec72bec721 None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:19:13.708956 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dd8ce3-5d63-4c64-8bd2-dfec72bec721 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:19:13.709764 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dd8ce3-5d63-4c64-8bd2-dfec72bec721 None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:19:13.711383 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 689/1366] 10.222.0.44 () {54 vars in 961 bytes} [Thu Jun 16 12:19:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 12:19:13.718364 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6e0d57-03da-4664-9b33-a8929c41e05a None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:19:13.718836 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6e0d57-03da-4664-9b33-a8929c41e05a None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:19:13.719115 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6e0d57-03da-4664-9b33-a8929c41e05a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:19:13.740194 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-6f6e0d57-03da-4664-9b33-a8929c41e05a None None] MFA Rules not processed for user `edfb12d445e74136b90800e93941f468`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:19:13.741576 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-6f6e0d57-03da-4664-9b33-a8929c41e05a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:19:13.751683 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 678/1367] 10.222.0.44 () {58 vars in 1058 bytes} [Thu Jun 16 12:19:13 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:19:13.760484 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dd8ce3-5d63-4c64-8bd2-dfec72bec721 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:19:13.774795 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dd8ce3-5d63-4c64-8bd2-dfec72bec721 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:19:13.780344 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9dd5e42-3870-44da-b182-9032d721be34 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edfb12d445e74136b90800e93941f468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '601361df39e34fcca71175aa94e425c4', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:19:13.785743 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dd5e42-3870-44da-b182-9032d721be34 service nova] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:19:13.786027 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dd5e42-3870-44da-b182-9032d721be34 service nova] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:19:13.786295 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dd5e42-3870-44da-b182-9032d721be34 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:19:13.801239 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9dd5e42-3870-44da-b182-9032d721be34 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:19:13.803252 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9dd5e42-3870-44da-b182-9032d721be34 service nova] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:19:13.820564 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 690/1368] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 12:19:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 12:19:16.007909 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea23f86-b487-48c4-8c11-9d30d1c76962 None None] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:19:16.008652 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea23f86-b487-48c4-8c11-9d30d1c76962 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:19:16.008652 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea23f86-b487-48c4-8c11-9d30d1c76962 None None] PATH_INFO: `/` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:19:16.009891 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 679/1369] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 12:19:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 12:19:16.015076 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cdd4c4-de0d-4ef2-ab17-8e5901dcec21 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:19:16.015503 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cdd4c4-de0d-4ef2-ab17-8e5901dcec21 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:19:16.015632 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cdd4c4-de0d-4ef2-ab17-8e5901dcec21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:19:16.044486 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-c4cdd4c4-de0d-4ef2-ab17-8e5901dcec21 None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:19:16.046000 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-c4cdd4c4-de0d-4ef2-ab17-8e5901dcec21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:19:16.055729 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 691/1370] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 12:19:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:19:16.102321 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea23f86-b487-48c4-8c11-9d30d1c76962 None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:19:16.117786 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea23f86-b487-48c4-8c11-9d30d1c76962 None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:19:16.123776 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b58e80-8255-4c2e-b73b-b7750c442430 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edfb12d445e74136b90800e93941f468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '601361df39e34fcca71175aa94e425c4', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:19:16.124565 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b58e80-8255-4c2e-b73b-b7750c442430 service nova] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:19:16.124983 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b58e80-8255-4c2e-b73b-b7750c442430 service nova] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:19:16.125362 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b58e80-8255-4c2e-b73b-b7750c442430 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:19:16.135299 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b58e80-8255-4c2e-b73b-b7750c442430 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:19:16.137045 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b58e80-8255-4c2e-b73b-b7750c442430 service nova] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:19:16.147605 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 680/1371] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 12:19:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 12:19:16.423008 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00534b97-e9ce-4fc2-8310-c909488becfb None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:19:16.423297 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00534b97-e9ce-4fc2-8310-c909488becfb None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:19:16.423761 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00534b97-e9ce-4fc2-8310-c909488becfb None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:19:16.425194 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 692/1372] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 12:19:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 12:19:16.431008 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cb6470-6470-48cc-9039-28338c78dd80 None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:19:16.431304 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cb6470-6470-48cc-9039-28338c78dd80 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:19:16.431597 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cb6470-6470-48cc-9039-28338c78dd80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:19:16.449581 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-12cb6470-6470-48cc-9039-28338c78dd80 None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:19:16.450783 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-12cb6470-6470-48cc-9039-28338c78dd80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:19:16.458832 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 681/1373] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 12:19:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:19:16.780206 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537a065e-3f08-4395-98c3-78732237ebc6 None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:19:16.780206 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537a065e-3f08-4395-98c3-78732237ebc6 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:19:16.780206 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537a065e-3f08-4395-98c3-78732237ebc6 None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:19:16.780206 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 693/1374] 10.222.0.44 () {54 vars in 963 bytes} [Thu Jun 16 12:19:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 12:19:16.783664 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832bc5b6-b739-4566-acfb-5770b672da77 None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:19:16.783956 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832bc5b6-b739-4566-acfb-5770b672da77 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:19:16.784236 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832bc5b6-b739-4566-acfb-5770b672da77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:19:16.833995 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-832bc5b6-b739-4566-acfb-5770b672da77 None None] MFA Rules not processed for user `4f96fc14ed89478c8a8c2f11c87511e3`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:19:16.835201 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-832bc5b6-b739-4566-acfb-5770b672da77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:19:16.897928 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 682/1375] 10.222.0.44 () {58 vars in 1060 bytes} [Thu Jun 16 12:19:16 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:19:16.906162 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537a065e-3f08-4395-98c3-78732237ebc6 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:19:16.917456 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537a065e-3f08-4395-98c3-78732237ebc6 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:19:16.924009 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfde656-48c3-4615-ace2-587052fc9763 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f96fc14ed89478c8a8c2f11c87511e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '601361df39e34fcca71175aa94e425c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:19:16.925238 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfde656-48c3-4615-ace2-587052fc9763 service cinder] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:19:16.925982 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfde656-48c3-4615-ace2-587052fc9763 service cinder] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:19:16.926416 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfde656-48c3-4615-ace2-587052fc9763 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:19:16.941103 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfde656-48c3-4615-ace2-587052fc9763 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:19:16.942656 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfde656-48c3-4615-ace2-587052fc9763 service cinder] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:19:16.954916 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 694/1376] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 12:19:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 12:19:18.307081 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037b00ba-24b8-4a9d-9200-219a444ea87e None None] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:19:18.307536 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037b00ba-24b8-4a9d-9200-219a444ea87e None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:19:18.307629 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037b00ba-24b8-4a9d-9200-219a444ea87e None None] PATH_INFO: `/` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:19:18.309024 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 683/1377] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 12:19:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 12:19:18.314457 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9789ed-b2c7-438e-ba74-230bbf79fe91 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:19:18.314898 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9789ed-b2c7-438e-ba74-230bbf79fe91 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:19:18.315040 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9789ed-b2c7-438e-ba74-230bbf79fe91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:19:18.333420 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-fb9789ed-b2c7-438e-ba74-230bbf79fe91 None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:19:18.334622 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-fb9789ed-b2c7-438e-ba74-230bbf79fe91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:19:18.342946 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 695/1378] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 12:19:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:19:18.386249 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037b00ba-24b8-4a9d-9200-219a444ea87e None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:19:18.400208 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037b00ba-24b8-4a9d-9200-219a444ea87e None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:19:18.406103 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ee7885-07fb-42c7-ac9a-345528f2a5ed service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edfb12d445e74136b90800e93941f468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '601361df39e34fcca71175aa94e425c4', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:19:18.406725 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ee7885-07fb-42c7-ac9a-345528f2a5ed service nova] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:19:18.407173 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ee7885-07fb-42c7-ac9a-345528f2a5ed service nova] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:19:18.407446 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ee7885-07fb-42c7-ac9a-345528f2a5ed service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:19:18.415556 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ee7885-07fb-42c7-ac9a-345528f2a5ed service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:19:18.417162 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ee7885-07fb-42c7-ac9a-345528f2a5ed service nova] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:19:18.421408 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:19:18.428950 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 684/1379] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 12:19:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 12:19:20.603888 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bb1f14-15f2-463b-8213-8ff5fbfe1e3b None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:19:20.604738 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bb1f14-15f2-463b-8213-8ff5fbfe1e3b None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:19:20.605209 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bb1f14-15f2-463b-8213-8ff5fbfe1e3b None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:19:20.606780 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 696/1380] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 12:19:20 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 12:19:20.611979 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4285e8c7-f55d-43e1-85b6-4128645d56f2 None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:19:20.612724 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4285e8c7-f55d-43e1-85b6-4128645d56f2 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:19:20.613176 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4285e8c7-f55d-43e1-85b6-4128645d56f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:19:20.631724 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-4285e8c7-f55d-43e1-85b6-4128645d56f2 None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:19:20.633093 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-4285e8c7-f55d-43e1-85b6-4128645d56f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:19:20.642039 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 685/1381] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 12:19:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:19:20.686546 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bb1f14-15f2-463b-8213-8ff5fbfe1e3b None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:19:20.702275 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bb1f14-15f2-463b-8213-8ff5fbfe1e3b None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:19:20.708223 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43714b1-3c81-405d-a237-40770e4ce9fb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edfb12d445e74136b90800e93941f468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '601361df39e34fcca71175aa94e425c4', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:19:20.709009 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43714b1-3c81-405d-a237-40770e4ce9fb service nova] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:19:20.709395 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43714b1-3c81-405d-a237-40770e4ce9fb service nova] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:19:20.712085 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43714b1-3c81-405d-a237-40770e4ce9fb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:19:20.720616 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43714b1-3c81-405d-a237-40770e4ce9fb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:19:20.722262 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43714b1-3c81-405d-a237-40770e4ce9fb service nova] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:19:20.733226 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 697/1382] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 12:19:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 12:19:22.900177 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377b1491-7c88-4105-abc4-25c24dbca3e7 None None] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:19:22.900716 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377b1491-7c88-4105-abc4-25c24dbca3e7 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:19:22.900716 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377b1491-7c88-4105-abc4-25c24dbca3e7 None None] PATH_INFO: `/` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:19:22.902373 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 686/1383] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 12:19:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 12:19:22.908187 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c393edd-4a6c-4628-9038-9761feffd540 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:19:22.908187 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c393edd-4a6c-4628-9038-9761feffd540 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:19:22.908628 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c393edd-4a6c-4628-9038-9761feffd540 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:19:22.931031 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-4c393edd-4a6c-4628-9038-9761feffd540 None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:19:22.935317 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-4c393edd-4a6c-4628-9038-9761feffd540 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:19:22.941507 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 698/1384] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 12:19:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:19:22.984237 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377b1491-7c88-4105-abc4-25c24dbca3e7 None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:19:22.999309 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377b1491-7c88-4105-abc4-25c24dbca3e7 None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:19:23.005250 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df65cf0e-4b9e-458d-acd2-65e4e0c852d4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edfb12d445e74136b90800e93941f468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '601361df39e34fcca71175aa94e425c4', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:19:23.005993 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df65cf0e-4b9e-458d-acd2-65e4e0c852d4 service nova] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:19:23.006381 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df65cf0e-4b9e-458d-acd2-65e4e0c852d4 service nova] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:19:23.006776 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df65cf0e-4b9e-458d-acd2-65e4e0c852d4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:19:23.016280 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df65cf0e-4b9e-458d-acd2-65e4e0c852d4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:19:23.018079 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df65cf0e-4b9e-458d-acd2-65e4e0c852d4 service nova] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:19:23.029495 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 687/1385] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 12:19:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 12:19:25.161911 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da56b381-9c83-4a7a-ac7f-71dac74d3540 None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:19:25.162565 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da56b381-9c83-4a7a-ac7f-71dac74d3540 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:19:25.162565 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da56b381-9c83-4a7a-ac7f-71dac74d3540 None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:19:25.163876 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 699/1386] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 12:19:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 12:19:25.169113 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e198c432-b7d4-4aa6-98be-55e5389471ee None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:19:25.169630 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e198c432-b7d4-4aa6-98be-55e5389471ee None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:19:25.169748 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e198c432-b7d4-4aa6-98be-55e5389471ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:19:25.189442 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-e198c432-b7d4-4aa6-98be-55e5389471ee None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:19:25.190548 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-e198c432-b7d4-4aa6-98be-55e5389471ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:19:25.198888 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 688/1387] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 12:19:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:19:25.244425 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da56b381-9c83-4a7a-ac7f-71dac74d3540 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:19:25.260198 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da56b381-9c83-4a7a-ac7f-71dac74d3540 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:19:25.265670 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a83b2d-93eb-4297-a335-ac713b063ab6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edfb12d445e74136b90800e93941f468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '601361df39e34fcca71175aa94e425c4', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:19:25.266273 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a83b2d-93eb-4297-a335-ac713b063ab6 service nova] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:19:25.266552 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a83b2d-93eb-4297-a335-ac713b063ab6 service nova] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:19:25.266825 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a83b2d-93eb-4297-a335-ac713b063ab6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:19:25.275495 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a83b2d-93eb-4297-a335-ac713b063ab6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:19:25.277383 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a83b2d-93eb-4297-a335-ac713b063ab6 service nova] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:19:25.286837 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 700/1388] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 12:19:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 12:19:27.912578 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ebcc12-93c6-4644-a370-ab42053b29f8 None None] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:19:27.913137 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ebcc12-93c6-4644-a370-ab42053b29f8 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:19:27.913243 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ebcc12-93c6-4644-a370-ab42053b29f8 None None] PATH_INFO: `/` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:19:27.915098 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 689/1389] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 12:19:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 12:19:27.920449 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d16c33-d79f-4cbc-8976-c1100baa4fb5 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:19:27.921096 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d16c33-d79f-4cbc-8976-c1100baa4fb5 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:19:27.921096 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d16c33-d79f-4cbc-8976-c1100baa4fb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:19:27.939578 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-a1d16c33-d79f-4cbc-8976-c1100baa4fb5 None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:19:27.940798 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-a1d16c33-d79f-4cbc-8976-c1100baa4fb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:19:27.949301 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 701/1390] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 12:19:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 12:19:27.993398 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ebcc12-93c6-4644-a370-ab42053b29f8 None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:19:28.012152 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ebcc12-93c6-4644-a370-ab42053b29f8 None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:19:28.018881 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3066ed5-e31b-4145-82c2-03c9e6356844 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edfb12d445e74136b90800e93941f468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '601361df39e34fcca71175aa94e425c4', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:19:28.019704 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3066ed5-e31b-4145-82c2-03c9e6356844 service nova] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:19:28.020312 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3066ed5-e31b-4145-82c2-03c9e6356844 service nova] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:19:28.020930 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3066ed5-e31b-4145-82c2-03c9e6356844 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:19:28.032157 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3066ed5-e31b-4145-82c2-03c9e6356844 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:19:28.034250 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3066ed5-e31b-4145-82c2-03c9e6356844 service nova] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:19:28.046709 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 690/1391] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 12:19:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 12:19:30.612077 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df373cc9-eef4-473e-9c12-340bcd30259e None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:19:30.612680 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df373cc9-eef4-473e-9c12-340bcd30259e None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:19:30.612680 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df373cc9-eef4-473e-9c12-340bcd30259e None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:19:30.614053 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 702/1392] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 12:19:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 12:19:30.619755 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0d236e-2269-4968-826c-2bbe9d0b4875 None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:19:30.620171 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0d236e-2269-4968-826c-2bbe9d0b4875 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:19:30.620313 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0d236e-2269-4968-826c-2bbe9d0b4875 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:19:30.637687 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-db0d236e-2269-4968-826c-2bbe9d0b4875 None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:19:30.638879 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-db0d236e-2269-4968-826c-2bbe9d0b4875 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:19:30.646614 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 691/1393] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 12:19:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:19:30.691660 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df373cc9-eef4-473e-9c12-340bcd30259e None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:19:30.705858 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df373cc9-eef4-473e-9c12-340bcd30259e None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:19:30.711285 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584d6faf-fafa-49e6-8941-bf61851c9010 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edfb12d445e74136b90800e93941f468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '601361df39e34fcca71175aa94e425c4', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:19:30.711917 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584d6faf-fafa-49e6-8941-bf61851c9010 service nova] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:19:30.712204 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584d6faf-fafa-49e6-8941-bf61851c9010 service nova] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:19:30.712487 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584d6faf-fafa-49e6-8941-bf61851c9010 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:19:30.720538 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584d6faf-fafa-49e6-8941-bf61851c9010 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:19:30.722172 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584d6faf-fafa-49e6-8941-bf61851c9010 service nova] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:19:30.732562 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 703/1394] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 12:19:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 12:19:32.230762 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a4c455-8987-43e9-9d20-f5bbc82be0bd None None] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:19:32.231316 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a4c455-8987-43e9-9d20-f5bbc82be0bd None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:19:32.231316 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a4c455-8987-43e9-9d20-f5bbc82be0bd None None] PATH_INFO: `/` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:19:32.232793 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 692/1395] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 12:19:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 12:19:32.238153 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420f8d1c-dd33-4b40-a391-1f19caefd1e9 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:19:32.238571 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420f8d1c-dd33-4b40-a391-1f19caefd1e9 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:19:32.238759 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420f8d1c-dd33-4b40-a391-1f19caefd1e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:19:32.257486 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-420f8d1c-dd33-4b40-a391-1f19caefd1e9 None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:19:32.258682 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-420f8d1c-dd33-4b40-a391-1f19caefd1e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:19:32.266736 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 704/1396] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 12:19:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:19:32.322981 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fef326-5662-401d-a7e5-3899d6b98c41 None None] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:19:32.323268 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fef326-5662-401d-a7e5-3899d6b98c41 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:19:32.323541 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fef326-5662-401d-a7e5-3899d6b98c41 None None] PATH_INFO: `/` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:19:32.324933 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 693/1397] 10.222.0.44 () {54 vars in 962 bytes} [Thu Jun 16 12:19:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 12:19:32.329995 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19f849c-249a-4417-949c-d10009e5f790 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:19:32.330284 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19f849c-249a-4417-949c-d10009e5f790 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:19:32.330558 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19f849c-249a-4417-949c-d10009e5f790 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:19:32.378278 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-c19f849c-249a-4417-949c-d10009e5f790 None None] MFA Rules not processed for user `42dedbccc64747d581c862a69ae20941`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:19:32.379478 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-c19f849c-249a-4417-949c-d10009e5f790 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:19:32.439263 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 705/1398] 10.222.0.44 () {58 vars in 1059 bytes} [Thu Jun 16 12:19:32 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:19:32.447723 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fef326-5662-401d-a7e5-3899d6b98c41 None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:19:32.458070 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fef326-5662-401d-a7e5-3899d6b98c41 None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:19:32.462280 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2adfeec-1e62-4ecf-893b-1d103364b96b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42dedbccc64747d581c862a69ae20941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '601361df39e34fcca71175aa94e425c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:19:32.462920 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2adfeec-1e62-4ecf-893b-1d103364b96b service glance] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:19:32.463203 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2adfeec-1e62-4ecf-893b-1d103364b96b service glance] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:19:32.463479 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2adfeec-1e62-4ecf-893b-1d103364b96b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:19:32.472598 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2adfeec-1e62-4ecf-893b-1d103364b96b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:19:32.474058 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2adfeec-1e62-4ecf-893b-1d103364b96b service glance] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:19:32.484278 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 694/1399] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 12:19:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 12:19:32.877305 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62f5500-2368-49c2-a6fa-01f9392d6b0b None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:19:32.877618 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62f5500-2368-49c2-a6fa-01f9392d6b0b None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:19:32.877896 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62f5500-2368-49c2-a6fa-01f9392d6b0b None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:19:32.879323 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 706/1400] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 12:19:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 12:19:32.885931 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f4188a-9503-4cef-9355-548a9b87ca52 None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:19:32.886220 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f4188a-9503-4cef-9355-548a9b87ca52 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:19:32.886649 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f4188a-9503-4cef-9355-548a9b87ca52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:19:32.906593 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-79f4188a-9503-4cef-9355-548a9b87ca52 None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:19:32.907950 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-79f4188a-9503-4cef-9355-548a9b87ca52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:19:32.916182 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 695/1401] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 12:19:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:19:32.962330 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62f5500-2368-49c2-a6fa-01f9392d6b0b None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:19:32.977125 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62f5500-2368-49c2-a6fa-01f9392d6b0b None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:19:32.983273 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e923ba3-cff7-42b5-a09d-5ae5af6f057c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edfb12d445e74136b90800e93941f468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '601361df39e34fcca71175aa94e425c4', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:19:32.983980 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e923ba3-cff7-42b5-a09d-5ae5af6f057c service nova] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:19:32.984323 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e923ba3-cff7-42b5-a09d-5ae5af6f057c service nova] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:19:32.984658 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e923ba3-cff7-42b5-a09d-5ae5af6f057c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:19:32.992886 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e923ba3-cff7-42b5-a09d-5ae5af6f057c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:19:32.994444 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e923ba3-cff7-42b5-a09d-5ae5af6f057c service nova] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:19:33.003605 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 707/1402] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 12:19:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 12:19:33.204983 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab4804b-7341-47cf-b4e6-2de4b8e2a51a None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:19:33.205267 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab4804b-7341-47cf-b4e6-2de4b8e2a51a None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:19:33.205542 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab4804b-7341-47cf-b4e6-2de4b8e2a51a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:19:33.255401 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-2ab4804b-7341-47cf-b4e6-2de4b8e2a51a None None] MFA Rules not processed for user `222b53cae3d64412b9b0a89d162311f4`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:19:33.256763 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-2ab4804b-7341-47cf-b4e6-2de4b8e2a51a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:19:33.320506 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 696/1403] 10.222.0.44 () {58 vars in 1009 bytes} [Thu Jun 16 12:19:33 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:19:33.359985 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5937afc7-4cb3-4b03-abb7-a56437be670f None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:19:33.360467 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5937afc7-4cb3-4b03-abb7-a56437be670f None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:19:33.360824 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5937afc7-4cb3-4b03-abb7-a56437be670f None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:19:33.362355 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 708/1404] 10.222.0.44 () {54 vars in 942 bytes} [Thu Jun 16 12:19:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 12:19:33.369748 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83dfdca-2d88-41d7-bfa5-c497c233fc2f None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:19:33.370040 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83dfdca-2d88-41d7-bfa5-c497c233fc2f None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:19:33.370319 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83dfdca-2d88-41d7-bfa5-c497c233fc2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:19:33.418309 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-f83dfdca-2d88-41d7-bfa5-c497c233fc2f None None] MFA Rules not processed for user `c159f79c1921496487101aac5d530ae5`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:19:33.419461 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-f83dfdca-2d88-41d7-bfa5-c497c233fc2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:19:33.453171 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:19:33.492032 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 697/1405] 10.222.0.44 () {58 vars in 1039 bytes} [Thu Jun 16 12:19:33 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:19:33.501468 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5937afc7-4cb3-4b03-abb7-a56437be670f None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:19:33.510113 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:19:33.515541 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5937afc7-4cb3-4b03-abb7-a56437be670f None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:19:33.520687 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d40987c-e0e7-4ea0-8fdb-d368e163ab5e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c159f79c1921496487101aac5d530ae5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '601361df39e34fcca71175aa94e425c4', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:19:33.521369 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d40987c-e0e7-4ea0-8fdb-d368e163ab5e service swift] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:19:33.521645 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d40987c-e0e7-4ea0-8fdb-d368e163ab5e service swift] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:19:33.521951 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d40987c-e0e7-4ea0-8fdb-d368e163ab5e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:19:33.530366 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d40987c-e0e7-4ea0-8fdb-d368e163ab5e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:19:33.531937 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d40987c-e0e7-4ea0-8fdb-d368e163ab5e service swift] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:19:33.540725 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 709/1406] 10.222.0.44 () {60 vars in 1384 bytes} [Thu Jun 16 12:19:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 16 12:19:35.167188 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc4d65d-0e1d-4773-8f90-98aa82093a84 None None] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:19:35.169546 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc4d65d-0e1d-4773-8f90-98aa82093a84 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:19:35.169837 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc4d65d-0e1d-4773-8f90-98aa82093a84 None None] PATH_INFO: `/` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:19:35.171295 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 698/1407] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 12:19:35 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 12:19:35.176861 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbd26e2-fc53-49b4-a892-7b54f7d80a23 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:19:35.177327 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbd26e2-fc53-49b4-a892-7b54f7d80a23 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:19:35.177424 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbd26e2-fc53-49b4-a892-7b54f7d80a23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:19:35.196175 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-adbd26e2-fc53-49b4-a892-7b54f7d80a23 None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:19:35.197418 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-adbd26e2-fc53-49b4-a892-7b54f7d80a23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:19:35.206046 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 710/1408] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 12:19:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:19:35.251308 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc4d65d-0e1d-4773-8f90-98aa82093a84 None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:19:35.272213 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc4d65d-0e1d-4773-8f90-98aa82093a84 None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:19:35.279032 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9184355f-63e2-440d-ba15-50c4854ece12 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edfb12d445e74136b90800e93941f468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '601361df39e34fcca71175aa94e425c4', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:19:35.279676 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9184355f-63e2-440d-ba15-50c4854ece12 service nova] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:19:35.279956 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9184355f-63e2-440d-ba15-50c4854ece12 service nova] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:19:35.280238 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9184355f-63e2-440d-ba15-50c4854ece12 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:19:35.289621 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9184355f-63e2-440d-ba15-50c4854ece12 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:19:35.291244 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9184355f-63e2-440d-ba15-50c4854ece12 service nova] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:19:35.301501 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 699/1409] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 12:19:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 12:19:45.190612 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=7 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:19:45.297171 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=21 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:19:55.581307 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99aecfb3-c6cb-492a-ad80-ace86e037c72 None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:19:55.581908 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99aecfb3-c6cb-492a-ad80-ace86e037c72 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:19:55.581908 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99aecfb3-c6cb-492a-ad80-ace86e037c72 None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:19:55.583232 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 711/1410] 10.222.0.44 () {54 vars in 918 bytes} [Thu Jun 16 12:19:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 12:19:55.588172 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c005c6-83ea-4513-aa36-8acfd5c925e1 None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:19:55.588645 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c005c6-83ea-4513-aa36-8acfd5c925e1 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:19:55.588776 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c005c6-83ea-4513-aa36-8acfd5c925e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:19:55.606291 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-00c005c6-83ea-4513-aa36-8acfd5c925e1 None None] MFA Rules not processed for user `8bff8ccf460a403d993c39327bbcbd29`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:19:55.607487 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-00c005c6-83ea-4513-aa36-8acfd5c925e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:19:55.616487 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 700/1411] 10.222.0.44 () {58 vars in 1015 bytes} [Thu Jun 16 12:19:55 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:19:55.630943 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90323aa-9ba9-4cc3-b793-4468304a998e None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:19:55.631225 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90323aa-9ba9-4cc3-b793-4468304a998e None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:19:55.631501 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90323aa-9ba9-4cc3-b793-4468304a998e None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:19:55.632851 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 712/1412] 10.222.0.44 () {54 vars in 918 bytes} [Thu Jun 16 12:19:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 12:19:55.637213 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d3da94-7c21-4226-8145-3c212d8c0cd2 None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:19:55.637499 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d3da94-7c21-4226-8145-3c212d8c0cd2 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:19:55.637777 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d3da94-7c21-4226-8145-3c212d8c0cd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:19:55.655150 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-81d3da94-7c21-4226-8145-3c212d8c0cd2 None None] MFA Rules not processed for user `edfb12d445e74136b90800e93941f468`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:19:55.656329 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-81d3da94-7c21-4226-8145-3c212d8c0cd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:19:55.665346 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 701/1413] 10.222.0.44 () {58 vars in 1015 bytes} [Thu Jun 16 12:19:55 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:19:58.241049 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2c080d-9d22-4d2b-8285-291046c0116a None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:19:58.241578 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2c080d-9d22-4d2b-8285-291046c0116a None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:19:58.241578 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2c080d-9d22-4d2b-8285-291046c0116a None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:19:58.242977 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 713/1414] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 16 12:19:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 12:19:58.248540 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36594eca-d2e5-48d6-855e-cb7ac47fedd0 None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:19:58.249015 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36594eca-d2e5-48d6-855e-cb7ac47fedd0 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:19:58.249248 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36594eca-d2e5-48d6-855e-cb7ac47fedd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:19:58.267020 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-36594eca-d2e5-48d6-855e-cb7ac47fedd0 None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:19:58.268198 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-36594eca-d2e5-48d6-855e-cb7ac47fedd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:19:58.276745 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 702/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 16 12:19:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:19:58.318848 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2c080d-9d22-4d2b-8285-291046c0116a None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:19:58.333525 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2c080d-9d22-4d2b-8285-291046c0116a None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:19:58.338830 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f3d5ce-16a3-4bab-8ffa-6197c34b021a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edfb12d445e74136b90800e93941f468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '601361df39e34fcca71175aa94e425c4', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:19:58.339457 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f3d5ce-16a3-4bab-8ffa-6197c34b021a service nova] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:19:58.339734 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f3d5ce-16a3-4bab-8ffa-6197c34b021a service nova] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:19:58.340005 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f3d5ce-16a3-4bab-8ffa-6197c34b021a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:19:58.348137 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f3d5ce-16a3-4bab-8ffa-6197c34b021a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:19:58.349766 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f3d5ce-16a3-4bab-8ffa-6197c34b021a service nova] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:19:58.359210 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 714/1416] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 12:19:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 12:19:59.295134 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e75b6f0-c072-463a-a8b1-bda38f5a116c None None] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:19:59.295722 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e75b6f0-c072-463a-a8b1-bda38f5a116c None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:19:59.295722 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e75b6f0-c072-463a-a8b1-bda38f5a116c None None] PATH_INFO: `/` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:19:59.297170 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 703/1417] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 16 12:19:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 12:19:59.302645 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580b158b-6e2b-4721-ac3a-b80c41b448e2 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:19:59.303077 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580b158b-6e2b-4721-ac3a-b80c41b448e2 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:19:59.303220 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580b158b-6e2b-4721-ac3a-b80c41b448e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:19:59.322938 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-580b158b-6e2b-4721-ac3a-b80c41b448e2 None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:19:59.324131 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-580b158b-6e2b-4721-ac3a-b80c41b448e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:19:59.335821 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 715/1418] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 16 12:19:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:19:59.487581 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e75b6f0-c072-463a-a8b1-bda38f5a116c None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:19:59.501611 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e75b6f0-c072-463a-a8b1-bda38f5a116c None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:19:59.506854 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43cf403-eddc-4bfc-b56f-82d4fdb51659 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edfb12d445e74136b90800e93941f468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '601361df39e34fcca71175aa94e425c4', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:19:59.507490 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43cf403-eddc-4bfc-b56f-82d4fdb51659 service nova] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:19:59.507767 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43cf403-eddc-4bfc-b56f-82d4fdb51659 service nova] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:19:59.508038 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43cf403-eddc-4bfc-b56f-82d4fdb51659 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:19:59.515960 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43cf403-eddc-4bfc-b56f-82d4fdb51659 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:19:59.517572 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43cf403-eddc-4bfc-b56f-82d4fdb51659 service nova] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:19:59.527464 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 704/1419] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 12:19:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 12:20:00.456554 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d123234-8ee7-4d34-a396-c868cb8d1800 None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:20:00.457235 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d123234-8ee7-4d34-a396-c868cb8d1800 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:20:00.457235 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d123234-8ee7-4d34-a396-c868cb8d1800 None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:20:00.458520 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 716/1420] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 16 12:20:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 12:20:00.463627 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d43a34-fb00-4f33-ae90-96a379e338c0 None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:20:00.464026 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d43a34-fb00-4f33-ae90-96a379e338c0 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:20:00.464210 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d43a34-fb00-4f33-ae90-96a379e338c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:20:00.483172 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-b9d43a34-fb00-4f33-ae90-96a379e338c0 None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:20:00.484360 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-b9d43a34-fb00-4f33-ae90-96a379e338c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:20:00.492732 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 705/1421] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 16 12:20:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:20:00.643621 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d123234-8ee7-4d34-a396-c868cb8d1800 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:20:00.657908 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d123234-8ee7-4d34-a396-c868cb8d1800 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:20:00.663816 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80d45ab-9a6c-410a-8dfc-4620ba5f09ca service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edfb12d445e74136b90800e93941f468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '601361df39e34fcca71175aa94e425c4', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:20:00.664445 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80d45ab-9a6c-410a-8dfc-4620ba5f09ca service nova] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:20:00.664725 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80d45ab-9a6c-410a-8dfc-4620ba5f09ca service nova] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:20:00.665028 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80d45ab-9a6c-410a-8dfc-4620ba5f09ca service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:20:00.673034 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80d45ab-9a6c-410a-8dfc-4620ba5f09ca service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:20:00.674621 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80d45ab-9a6c-410a-8dfc-4620ba5f09ca service nova] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:20:00.684701 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 717/1422] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 12:20:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 12:20:01.591903 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1706b6b4-7dad-419b-84d8-37e78e5866e7 None None] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:20:01.592465 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1706b6b4-7dad-419b-84d8-37e78e5866e7 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:20:01.592465 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1706b6b4-7dad-419b-84d8-37e78e5866e7 None None] PATH_INFO: `/` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:20:01.593867 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 706/1423] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 16 12:20:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 12:20:01.598630 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d17fdf-b748-462b-95f0-97addc8eab61 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:20:01.599049 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d17fdf-b748-462b-95f0-97addc8eab61 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:20:01.599203 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d17fdf-b748-462b-95f0-97addc8eab61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:20:01.617143 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-29d17fdf-b748-462b-95f0-97addc8eab61 None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:20:01.618318 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-29d17fdf-b748-462b-95f0-97addc8eab61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:20:01.625934 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 718/1424] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 16 12:20:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:20:01.775639 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1706b6b4-7dad-419b-84d8-37e78e5866e7 None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:20:01.789630 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1706b6b4-7dad-419b-84d8-37e78e5866e7 None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:20:01.794878 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37931eb2-309d-478c-8643-686f4579a9e2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edfb12d445e74136b90800e93941f468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '601361df39e34fcca71175aa94e425c4', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:20:01.795498 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37931eb2-309d-478c-8643-686f4579a9e2 service nova] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:20:01.795771 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37931eb2-309d-478c-8643-686f4579a9e2 service nova] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:20:01.796036 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37931eb2-309d-478c-8643-686f4579a9e2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:20:01.804326 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37931eb2-309d-478c-8643-686f4579a9e2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:20:01.805953 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37931eb2-309d-478c-8643-686f4579a9e2 service nova] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:20:01.815023 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 707/1425] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 12:20:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 12:20:02.716460 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924f0797-c92e-4774-acb0-24e87ddd44b7 None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:20:02.717087 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924f0797-c92e-4774-acb0-24e87ddd44b7 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:20:02.717087 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924f0797-c92e-4774-acb0-24e87ddd44b7 None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:20:02.718463 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 719/1426] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 16 12:20:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 12:20:02.723388 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b919f53d-3a9b-4ece-9672-259ff9301803 None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:20:02.723801 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b919f53d-3a9b-4ece-9672-259ff9301803 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:20:02.723942 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b919f53d-3a9b-4ece-9672-259ff9301803 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:20:02.741571 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-b919f53d-3a9b-4ece-9672-259ff9301803 None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:20:02.742744 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-b919f53d-3a9b-4ece-9672-259ff9301803 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:20:02.750376 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 708/1427] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 16 12:20:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:20:02.902269 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924f0797-c92e-4774-acb0-24e87ddd44b7 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:20:02.916442 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924f0797-c92e-4774-acb0-24e87ddd44b7 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:20:02.921794 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e0320e-d525-4c68-b66e-09ab2be09e90 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edfb12d445e74136b90800e93941f468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '601361df39e34fcca71175aa94e425c4', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:20:02.922426 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e0320e-d525-4c68-b66e-09ab2be09e90 service nova] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:20:02.923070 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e0320e-d525-4c68-b66e-09ab2be09e90 service nova] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:20:02.923070 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e0320e-d525-4c68-b66e-09ab2be09e90 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:20:02.931039 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e0320e-d525-4c68-b66e-09ab2be09e90 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:20:02.932612 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e0320e-d525-4c68-b66e-09ab2be09e90 service nova] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:20:02.942692 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 720/1428] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 12:20:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 12:20:03.783436 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21a3fb7-555a-4ef1-a8ad-62b54df96908 None None] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:20:03.783889 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21a3fb7-555a-4ef1-a8ad-62b54df96908 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:20:03.784000 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21a3fb7-555a-4ef1-a8ad-62b54df96908 None None] PATH_INFO: `/` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:20:03.785477 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 709/1429] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 16 12:20:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 12:20:03.790408 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cd5dc3-b2a4-4d81-9c43-506726605884 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:20:03.790834 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cd5dc3-b2a4-4d81-9c43-506726605884 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:20:03.790952 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cd5dc3-b2a4-4d81-9c43-506726605884 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:20:03.808892 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-74cd5dc3-b2a4-4d81-9c43-506726605884 None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:20:03.810071 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-74cd5dc3-b2a4-4d81-9c43-506726605884 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:20:03.817731 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 721/1430] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 16 12:20:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:20:03.978457 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21a3fb7-555a-4ef1-a8ad-62b54df96908 None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:20:03.992966 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21a3fb7-555a-4ef1-a8ad-62b54df96908 None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:20:03.998213 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dba9df0-a74c-4410-9978-ba1bc49aaa61 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edfb12d445e74136b90800e93941f468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '601361df39e34fcca71175aa94e425c4', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:20:03.998840 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dba9df0-a74c-4410-9978-ba1bc49aaa61 service nova] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:20:03.999119 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dba9df0-a74c-4410-9978-ba1bc49aaa61 service nova] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:20:03.999389 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dba9df0-a74c-4410-9978-ba1bc49aaa61 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:20:04.008078 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dba9df0-a74c-4410-9978-ba1bc49aaa61 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:20:04.009651 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dba9df0-a74c-4410-9978-ba1bc49aaa61 service nova] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:20:04.018853 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 710/1431] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 12:20:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 12:20:04.861360 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2940f62f-5b4a-462c-89bb-6f728d65eabc None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:20:04.861900 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2940f62f-5b4a-462c-89bb-6f728d65eabc None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:20:04.861900 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2940f62f-5b4a-462c-89bb-6f728d65eabc None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:20:04.863801 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 722/1432] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 16 12:20:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 12:20:04.868604 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0fd545-0654-4a39-829e-d8d5d3cf25a4 None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:20:04.869042 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0fd545-0654-4a39-829e-d8d5d3cf25a4 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:20:04.869192 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0fd545-0654-4a39-829e-d8d5d3cf25a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:20:04.887120 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-3a0fd545-0654-4a39-829e-d8d5d3cf25a4 None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:20:04.888308 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-3a0fd545-0654-4a39-829e-d8d5d3cf25a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:20:04.895999 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 711/1433] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 16 12:20:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:20:05.047520 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2940f62f-5b4a-462c-89bb-6f728d65eabc None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:20:05.062167 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2940f62f-5b4a-462c-89bb-6f728d65eabc None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:20:05.067501 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d2643f-03ac-4bda-86dd-987da04a831f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edfb12d445e74136b90800e93941f468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '601361df39e34fcca71175aa94e425c4', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:20:05.068125 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d2643f-03ac-4bda-86dd-987da04a831f service nova] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:20:05.068405 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d2643f-03ac-4bda-86dd-987da04a831f service nova] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:20:05.068708 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d2643f-03ac-4bda-86dd-987da04a831f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:20:05.076627 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d2643f-03ac-4bda-86dd-987da04a831f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:20:05.078245 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d2643f-03ac-4bda-86dd-987da04a831f service nova] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:20:05.087414 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 723/1434] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 12:20:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 12:20:05.937304 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a205195b-0d61-4dee-bda8-767030a3b08c None None] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:20:05.937726 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a205195b-0d61-4dee-bda8-767030a3b08c None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:20:05.937833 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a205195b-0d61-4dee-bda8-767030a3b08c None None] PATH_INFO: `/` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:20:05.939334 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 712/1435] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 16 12:20:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 12:20:05.944314 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabe7930-fb3b-4bd1-9fcd-b0806c650870 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:20:05.944867 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabe7930-fb3b-4bd1-9fcd-b0806c650870 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:20:05.944954 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabe7930-fb3b-4bd1-9fcd-b0806c650870 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:20:05.962483 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-eabe7930-fb3b-4bd1-9fcd-b0806c650870 None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:20:05.963672 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-eabe7930-fb3b-4bd1-9fcd-b0806c650870 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:20:05.971354 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 724/1436] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 16 12:20:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:20:06.123303 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a205195b-0d61-4dee-bda8-767030a3b08c None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:20:06.137281 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a205195b-0d61-4dee-bda8-767030a3b08c None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:20:06.142565 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d53968a-8b73-4e0b-9bf6-ad6c188c53ff service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edfb12d445e74136b90800e93941f468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '601361df39e34fcca71175aa94e425c4', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:20:06.143191 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d53968a-8b73-4e0b-9bf6-ad6c188c53ff service nova] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:20:06.143469 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d53968a-8b73-4e0b-9bf6-ad6c188c53ff service nova] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:20:06.143737 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d53968a-8b73-4e0b-9bf6-ad6c188c53ff service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:20:06.152387 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d53968a-8b73-4e0b-9bf6-ad6c188c53ff service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:20:06.153997 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d53968a-8b73-4e0b-9bf6-ad6c188c53ff service nova] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:20:06.163752 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 713/1437] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 12:20:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 12:20:07.012080 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61753fd-0380-4bec-9dfc-d350b4098b31 None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:20:07.012600 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61753fd-0380-4bec-9dfc-d350b4098b31 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:20:07.012600 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61753fd-0380-4bec-9dfc-d350b4098b31 None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:20:07.014021 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 725/1438] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 16 12:20:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 12:20:07.018787 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9a04ae-75f0-44b7-b9c1-8b6fd65635a3 None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:20:07.019221 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9a04ae-75f0-44b7-b9c1-8b6fd65635a3 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:20:07.019380 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9a04ae-75f0-44b7-b9c1-8b6fd65635a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:20:07.037444 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-fd9a04ae-75f0-44b7-b9c1-8b6fd65635a3 None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:20:07.038632 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-fd9a04ae-75f0-44b7-b9c1-8b6fd65635a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:20:07.046333 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 714/1439] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 16 12:20:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:20:07.196037 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61753fd-0380-4bec-9dfc-d350b4098b31 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:20:07.209993 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61753fd-0380-4bec-9dfc-d350b4098b31 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:20:07.215563 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3347a5c8-9da6-4519-8da5-0de61606f31f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edfb12d445e74136b90800e93941f468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '601361df39e34fcca71175aa94e425c4', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:20:07.216195 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3347a5c8-9da6-4519-8da5-0de61606f31f service nova] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:20:07.216475 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3347a5c8-9da6-4519-8da5-0de61606f31f service nova] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:20:07.216774 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3347a5c8-9da6-4519-8da5-0de61606f31f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:20:07.225546 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3347a5c8-9da6-4519-8da5-0de61606f31f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:20:07.227157 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3347a5c8-9da6-4519-8da5-0de61606f31f service nova] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:20:07.236516 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 726/1440] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 12:20:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 12:20:09.248864 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb6b65b-d4d3-4b95-8e92-7a7d4bc9abf9 None None] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:20:09.249480 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb6b65b-d4d3-4b95-8e92-7a7d4bc9abf9 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:20:09.249480 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb6b65b-d4d3-4b95-8e92-7a7d4bc9abf9 None None] PATH_INFO: `/` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:20:09.250814 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 715/1441] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 16 12:20:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 12:20:09.255969 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b76ad5-7448-4edd-8654-96f88cc0b0aa None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:20:09.256426 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b76ad5-7448-4edd-8654-96f88cc0b0aa None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:20:09.256550 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b76ad5-7448-4edd-8654-96f88cc0b0aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:20:09.274429 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-81b76ad5-7448-4edd-8654-96f88cc0b0aa None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:20:09.275875 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-81b76ad5-7448-4edd-8654-96f88cc0b0aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:20:09.283713 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 727/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 16 12:20:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:20:09.321989 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb6b65b-d4d3-4b95-8e92-7a7d4bc9abf9 None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:20:09.323672 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-efb6b65b-d4d3-4b95-8e92-7a7d4bc9abf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:20:09.336682 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb6b65b-d4d3-4b95-8e92-7a7d4bc9abf9 None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:20:09.340099 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4aefe8-5bf8-4bf7-a093-1f268181d88a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1094729b25a4be7b0b394998c9ca681', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '601361df39e34fcca71175aa94e425c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:20:09.340731 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4aefe8-5bf8-4bf7-a093-1f268181d88a service neutron] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:20:09.341063 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4aefe8-5bf8-4bf7-a093-1f268181d88a service neutron] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:20:09.341373 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4aefe8-5bf8-4bf7-a093-1f268181d88a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:20:09.350524 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4aefe8-5bf8-4bf7-a093-1f268181d88a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:20:09.351922 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4aefe8-5bf8-4bf7-a093-1f268181d88a service neutron] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:20:09.360975 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 716/1443] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 12:20:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 12:20:11.604448 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c123b478-82db-4c9f-93be-75b85d2ce7a6 None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:20:11.605037 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c123b478-82db-4c9f-93be-75b85d2ce7a6 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:20:11.605037 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c123b478-82db-4c9f-93be-75b85d2ce7a6 None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:20:11.606446 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 728/1444] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 16 12:20:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 12:20:11.611780 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d81f7b2-daa3-4d72-837c-7c3ab9788318 None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:20:11.612209 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d81f7b2-daa3-4d72-837c-7c3ab9788318 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:20:11.612332 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d81f7b2-daa3-4d72-837c-7c3ab9788318 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:20:11.630522 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-5d81f7b2-daa3-4d72-837c-7c3ab9788318 None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:20:11.631702 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-5d81f7b2-daa3-4d72-837c-7c3ab9788318 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:20:11.639334 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 717/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 16 12:20:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:20:11.678102 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c123b478-82db-4c9f-93be-75b85d2ce7a6 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:20:11.688784 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c123b478-82db-4c9f-93be-75b85d2ce7a6 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:20:11.692225 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea922e3-465f-435f-8e9f-7e83b5b92f96 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1094729b25a4be7b0b394998c9ca681', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '601361df39e34fcca71175aa94e425c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:20:11.692916 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea922e3-465f-435f-8e9f-7e83b5b92f96 service neutron] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:20:11.693194 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea922e3-465f-435f-8e9f-7e83b5b92f96 service neutron] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:20:11.693464 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea922e3-465f-435f-8e9f-7e83b5b92f96 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:20:11.702093 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea922e3-465f-435f-8e9f-7e83b5b92f96 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:20:11.703515 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea922e3-465f-435f-8e9f-7e83b5b92f96 service neutron] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:20:11.712641 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 729/1446] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 12:20:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 12:20:14.144936 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287f1fb9-d72c-4bca-a3d9-01217d2280f7 None None] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:20:14.146111 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287f1fb9-d72c-4bca-a3d9-01217d2280f7 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:20:14.146111 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287f1fb9-d72c-4bca-a3d9-01217d2280f7 None None] PATH_INFO: `/` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:20:14.147343 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 718/1447] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 16 12:20:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 12:20:14.152847 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3bdbe6-7180-4c3b-9aee-fe4dd3d106b5 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:20:14.153267 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3bdbe6-7180-4c3b-9aee-fe4dd3d106b5 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:20:14.153399 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3bdbe6-7180-4c3b-9aee-fe4dd3d106b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:20:14.170507 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-3b3bdbe6-7180-4c3b-9aee-fe4dd3d106b5 None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:20:14.171710 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-3b3bdbe6-7180-4c3b-9aee-fe4dd3d106b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:20:14.179439 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 730/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 16 12:20:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 12:20:14.218200 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287f1fb9-d72c-4bca-a3d9-01217d2280f7 None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:20:14.228675 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287f1fb9-d72c-4bca-a3d9-01217d2280f7 None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:20:14.232165 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fec2bd-89a8-497d-8855-73a4954a6ca4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1094729b25a4be7b0b394998c9ca681', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '601361df39e34fcca71175aa94e425c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:20:14.232824 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fec2bd-89a8-497d-8855-73a4954a6ca4 service neutron] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:20:14.233108 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fec2bd-89a8-497d-8855-73a4954a6ca4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:20:14.233379 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fec2bd-89a8-497d-8855-73a4954a6ca4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:20:14.242176 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fec2bd-89a8-497d-8855-73a4954a6ca4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:20:14.243609 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fec2bd-89a8-497d-8855-73a4954a6ca4 service neutron] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:20:14.252811 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 719/1449] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 12:20:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 12:20:16.509510 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7be326-68ee-493d-8422-2a6107c537b8 None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:20:16.510097 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7be326-68ee-493d-8422-2a6107c537b8 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:20:16.510097 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7be326-68ee-493d-8422-2a6107c537b8 None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:20:16.511421 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 731/1450] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 16 12:20:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 12:20:16.516547 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a374ad-6d6e-4eb6-aa32-167008a6df78 None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:20:16.516998 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a374ad-6d6e-4eb6-aa32-167008a6df78 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:20:16.517132 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a374ad-6d6e-4eb6-aa32-167008a6df78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:20:16.534644 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-66a374ad-6d6e-4eb6-aa32-167008a6df78 None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:20:16.536328 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-66a374ad-6d6e-4eb6-aa32-167008a6df78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:20:16.544098 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 720/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 16 12:20:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:20:16.581868 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7be326-68ee-493d-8422-2a6107c537b8 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:20:16.593230 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7be326-68ee-493d-8422-2a6107c537b8 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:20:16.596653 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8056e63b-eae7-435f-a60f-112cf1cab645 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1094729b25a4be7b0b394998c9ca681', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '601361df39e34fcca71175aa94e425c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:20:16.597312 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8056e63b-eae7-435f-a60f-112cf1cab645 service neutron] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:20:16.597591 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8056e63b-eae7-435f-a60f-112cf1cab645 service neutron] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:20:16.597862 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8056e63b-eae7-435f-a60f-112cf1cab645 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:20:16.607262 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8056e63b-eae7-435f-a60f-112cf1cab645 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:20:16.608683 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8056e63b-eae7-435f-a60f-112cf1cab645 service neutron] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:20:16.617885 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 732/1452] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 12:20:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 12:20:18.788044 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a5bbf3-039d-43d5-a1d3-ccc476962802 None None] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:20:18.788613 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a5bbf3-039d-43d5-a1d3-ccc476962802 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:20:18.788613 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a5bbf3-039d-43d5-a1d3-ccc476962802 None None] PATH_INFO: `/` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:20:18.790006 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 721/1453] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 16 12:20:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 12:20:18.795182 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f5f8ef-7e48-4e5c-8340-430849fbeccf None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:20:18.795624 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f5f8ef-7e48-4e5c-8340-430849fbeccf None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:20:18.795740 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f5f8ef-7e48-4e5c-8340-430849fbeccf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:20:18.813611 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-36f5f8ef-7e48-4e5c-8340-430849fbeccf None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:20:18.814824 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-36f5f8ef-7e48-4e5c-8340-430849fbeccf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:20:18.823471 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 733/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 16 12:20:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 12:20:18.860991 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a5bbf3-039d-43d5-a1d3-ccc476962802 None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:20:18.872134 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a5bbf3-039d-43d5-a1d3-ccc476962802 None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:20:18.875656 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98afdd3-4fba-477c-87d6-c692880b2e70 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1094729b25a4be7b0b394998c9ca681', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '601361df39e34fcca71175aa94e425c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:20:18.876282 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98afdd3-4fba-477c-87d6-c692880b2e70 service neutron] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:20:18.876564 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98afdd3-4fba-477c-87d6-c692880b2e70 service neutron] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:20:18.876870 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98afdd3-4fba-477c-87d6-c692880b2e70 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:20:18.886213 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98afdd3-4fba-477c-87d6-c692880b2e70 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:20:18.887628 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98afdd3-4fba-477c-87d6-c692880b2e70 service neutron] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:20:18.896983 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 722/1455] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 12:20:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 12:20:21.080343 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef731c2-1946-49ad-9ec2-64c839447217 None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:20:21.080918 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef731c2-1946-49ad-9ec2-64c839447217 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:20:21.080918 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef731c2-1946-49ad-9ec2-64c839447217 None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:20:21.082312 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 734/1456] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 16 12:20:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 12:20:21.088298 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72027c0-70c5-46f9-be54-36b133f286ab None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:20:21.088721 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72027c0-70c5-46f9-be54-36b133f286ab None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:20:21.088889 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72027c0-70c5-46f9-be54-36b133f286ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:20:21.107062 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-a72027c0-70c5-46f9-be54-36b133f286ab None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:20:21.108259 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-a72027c0-70c5-46f9-be54-36b133f286ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:20:21.115925 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 723/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 16 12:20:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:20:21.153944 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef731c2-1946-49ad-9ec2-64c839447217 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:20:21.164919 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef731c2-1946-49ad-9ec2-64c839447217 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:20:21.168406 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1bdc5d-e180-482f-8257-bd7b60511433 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1094729b25a4be7b0b394998c9ca681', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '601361df39e34fcca71175aa94e425c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:20:21.169067 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1bdc5d-e180-482f-8257-bd7b60511433 service neutron] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:20:21.169349 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1bdc5d-e180-482f-8257-bd7b60511433 service neutron] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:20:21.169620 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1bdc5d-e180-482f-8257-bd7b60511433 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:20:21.178670 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1bdc5d-e180-482f-8257-bd7b60511433 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:20:21.180038 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1bdc5d-e180-482f-8257-bd7b60511433 service neutron] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:20:21.189265 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 735/1458] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 12:20:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 12:20:23.348200 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc2e38a-21fa-4450-b66a-f9604e37b30c None None] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:20:23.348875 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc2e38a-21fa-4450-b66a-f9604e37b30c None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:20:23.348875 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc2e38a-21fa-4450-b66a-f9604e37b30c None None] PATH_INFO: `/` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:20:23.350942 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 724/1459] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 16 12:20:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 12:20:23.356462 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c45e874-917f-40de-818b-86e32bdbbca0 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:20:23.356935 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c45e874-917f-40de-818b-86e32bdbbca0 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:20:23.357032 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c45e874-917f-40de-818b-86e32bdbbca0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:20:23.375746 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-4c45e874-917f-40de-818b-86e32bdbbca0 None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:20:23.376983 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-4c45e874-917f-40de-818b-86e32bdbbca0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:20:23.385345 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 736/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 16 12:20:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:20:23.422042 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc2e38a-21fa-4450-b66a-f9604e37b30c None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:20:23.433122 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc2e38a-21fa-4450-b66a-f9604e37b30c None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:20:23.436711 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d893f8-72d0-47cc-81d3-ed45e673f1f4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1094729b25a4be7b0b394998c9ca681', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '601361df39e34fcca71175aa94e425c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:20:23.437367 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d893f8-72d0-47cc-81d3-ed45e673f1f4 service neutron] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:20:23.437649 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d893f8-72d0-47cc-81d3-ed45e673f1f4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:20:23.437920 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d893f8-72d0-47cc-81d3-ed45e673f1f4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:20:23.447560 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d893f8-72d0-47cc-81d3-ed45e673f1f4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:20:23.449008 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d893f8-72d0-47cc-81d3-ed45e673f1f4 service neutron] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:20:23.458400 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 725/1461] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 12:20:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 12:20:25.633361 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a1b29f-d630-457b-9e68-8f9623ee7386 None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:20:25.633938 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a1b29f-d630-457b-9e68-8f9623ee7386 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:20:25.633938 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a1b29f-d630-457b-9e68-8f9623ee7386 None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:20:25.635300 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 737/1462] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 16 12:20:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 12:20:25.640635 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db4b8ba-1632-4c6f-9021-f96fc658272f None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:20:25.641034 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db4b8ba-1632-4c6f-9021-f96fc658272f None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:20:25.641221 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db4b8ba-1632-4c6f-9021-f96fc658272f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:20:25.647740 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=79 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:20:25.660339 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-8db4b8ba-1632-4c6f-9021-f96fc658272f None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:20:25.662116 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-8db4b8ba-1632-4c6f-9021-f96fc658272f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:20:25.669784 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 726/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 16 12:20:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:20:25.706028 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a1b29f-d630-457b-9e68-8f9623ee7386 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:20:25.711898 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=73 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:20:25.718091 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a1b29f-d630-457b-9e68-8f9623ee7386 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:20:25.721592 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a32271-4874-4888-bc59-1d7bc335c3af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1094729b25a4be7b0b394998c9ca681', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '601361df39e34fcca71175aa94e425c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:20:25.722222 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a32271-4874-4888-bc59-1d7bc335c3af service neutron] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:20:25.722502 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a32271-4874-4888-bc59-1d7bc335c3af service neutron] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:20:25.722775 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a32271-4874-4888-bc59-1d7bc335c3af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:20:25.732107 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a32271-4874-4888-bc59-1d7bc335c3af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:20:25.733708 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a32271-4874-4888-bc59-1d7bc335c3af service neutron] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:20:25.743083 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 738/1464] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 12:20:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 12:20:27.861484 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c538e7-9a07-4afa-8645-dec9021767dd None None] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:20:27.862005 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c538e7-9a07-4afa-8645-dec9021767dd None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:20:27.862005 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c538e7-9a07-4afa-8645-dec9021767dd None None] PATH_INFO: `/` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:20:27.863396 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 727/1465] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 16 12:20:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 12:20:27.868611 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713436f0-3e4e-42cf-8278-15b77fbe36d1 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:20:27.869066 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713436f0-3e4e-42cf-8278-15b77fbe36d1 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:20:27.869176 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713436f0-3e4e-42cf-8278-15b77fbe36d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:20:27.886452 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-713436f0-3e4e-42cf-8278-15b77fbe36d1 None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:20:27.887672 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-713436f0-3e4e-42cf-8278-15b77fbe36d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:20:27.895377 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 739/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 16 12:20:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:20:27.933957 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c538e7-9a07-4afa-8645-dec9021767dd None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:20:27.944548 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c538e7-9a07-4afa-8645-dec9021767dd None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:20:27.948077 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e111e604-eed6-4956-881f-db919403706d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1094729b25a4be7b0b394998c9ca681', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '601361df39e34fcca71175aa94e425c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:20:27.948713 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e111e604-eed6-4956-881f-db919403706d service neutron] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:20:27.949023 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e111e604-eed6-4956-881f-db919403706d service neutron] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:20:27.949301 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e111e604-eed6-4956-881f-db919403706d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:20:27.958135 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e111e604-eed6-4956-881f-db919403706d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:20:27.960080 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e111e604-eed6-4956-881f-db919403706d service neutron] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:20:27.969368 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 728/1467] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 12:20:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 12:20:30.102249 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d295c8b4-b0d2-470f-bf6d-112148e6a4a9 None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:20:30.102764 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d295c8b4-b0d2-470f-bf6d-112148e6a4a9 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:20:30.102764 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d295c8b4-b0d2-470f-bf6d-112148e6a4a9 None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:20:30.104104 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 740/1468] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 16 12:20:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 12:20:30.109365 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0bf9a1-fc5b-4cb7-a9cc-537104757c01 None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:20:30.109769 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0bf9a1-fc5b-4cb7-a9cc-537104757c01 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:20:30.109943 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0bf9a1-fc5b-4cb7-a9cc-537104757c01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:20:30.127951 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-ac0bf9a1-fc5b-4cb7-a9cc-537104757c01 None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:20:30.129158 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-ac0bf9a1-fc5b-4cb7-a9cc-537104757c01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:20:30.137333 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 729/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 16 12:20:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:20:30.173681 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d295c8b4-b0d2-470f-bf6d-112148e6a4a9 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:20:30.184657 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d295c8b4-b0d2-470f-bf6d-112148e6a4a9 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:20:30.188128 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8153dd-6112-4fdf-814a-cf4d57f29a8e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1094729b25a4be7b0b394998c9ca681', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '601361df39e34fcca71175aa94e425c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:20:30.188778 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8153dd-6112-4fdf-814a-cf4d57f29a8e service neutron] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:20:30.189062 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8153dd-6112-4fdf-814a-cf4d57f29a8e service neutron] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:20:30.189338 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8153dd-6112-4fdf-814a-cf4d57f29a8e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:20:30.198563 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8153dd-6112-4fdf-814a-cf4d57f29a8e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:20:30.199994 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8153dd-6112-4fdf-814a-cf4d57f29a8e service neutron] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:20:30.209238 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 741/1470] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 12:20:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 12:20:40.123452 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=11 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:20:40.205152 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=14 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:20:50.170482 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7862ff2-66de-43f7-9acb-85ac64d717f0 None None] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:20:50.170992 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7862ff2-66de-43f7-9acb-85ac64d717f0 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:20:50.170992 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7862ff2-66de-43f7-9acb-85ac64d717f0 None None] PATH_INFO: `/` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:20:50.172316 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 730/1471] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 12:20:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 12:20:50.177565 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2c853b-ad86-4f55-b19f-a9d9d1d93a09 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:20:50.177996 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2c853b-ad86-4f55-b19f-a9d9d1d93a09 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:20:50.178161 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2c853b-ad86-4f55-b19f-a9d9d1d93a09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:20:50.195847 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-9f2c853b-ad86-4f55-b19f-a9d9d1d93a09 None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:20:50.197068 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-9f2c853b-ad86-4f55-b19f-a9d9d1d93a09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:20:50.204613 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 742/1472] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 12:20:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:20:50.250813 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819b9e9b-166e-4fd0-bd5f-1982a5accb5b None None] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:20:50.251097 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819b9e9b-166e-4fd0-bd5f-1982a5accb5b None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:20:50.251372 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819b9e9b-166e-4fd0-bd5f-1982a5accb5b None None] PATH_INFO: `/` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:20:50.252701 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 731/1473] 10.222.0.44 () {54 vars in 962 bytes} [Thu Jun 16 12:20:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 12:20:50.257796 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ef6d12-255d-4f97-bd3c-807091e85cee None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:20:50.258083 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ef6d12-255d-4f97-bd3c-807091e85cee None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:20:50.258360 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ef6d12-255d-4f97-bd3c-807091e85cee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:20:50.276231 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-d2ef6d12-255d-4f97-bd3c-807091e85cee None None] MFA Rules not processed for user `42dedbccc64747d581c862a69ae20941`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:20:50.277426 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-d2ef6d12-255d-4f97-bd3c-807091e85cee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:20:50.284155 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 743/1474] 10.222.0.44 () {58 vars in 1059 bytes} [Thu Jun 16 12:20:50 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:20:50.291132 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819b9e9b-166e-4fd0-bd5f-1982a5accb5b None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:20:50.301476 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819b9e9b-166e-4fd0-bd5f-1982a5accb5b None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:20:50.305421 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab4f100-48e9-499a-bbad-9f5dcbd141a2 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42dedbccc64747d581c862a69ae20941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '601361df39e34fcca71175aa94e425c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:20:50.306020 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab4f100-48e9-499a-bbad-9f5dcbd141a2 service glance] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:20:50.306298 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab4f100-48e9-499a-bbad-9f5dcbd141a2 service glance] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:20:50.306567 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab4f100-48e9-499a-bbad-9f5dcbd141a2 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:20:50.315206 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab4f100-48e9-499a-bbad-9f5dcbd141a2 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:20:50.316608 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab4f100-48e9-499a-bbad-9f5dcbd141a2 service glance] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:20:50.326292 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 732/1475] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 12:20:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 12:20:52.518398 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72614e5-0745-4595-bab8-3ee240fd5cdb None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:20:52.518970 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72614e5-0745-4595-bab8-3ee240fd5cdb None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:20:52.518970 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72614e5-0745-4595-bab8-3ee240fd5cdb None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:20:52.520305 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 744/1476] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 12:20:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 12:20:52.525467 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe32bc6-73fc-4034-8022-a88d62ed6f86 None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:20:52.525895 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe32bc6-73fc-4034-8022-a88d62ed6f86 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:20:52.526010 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe32bc6-73fc-4034-8022-a88d62ed6f86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:20:52.544096 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-cfe32bc6-73fc-4034-8022-a88d62ed6f86 None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:20:52.545313 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-cfe32bc6-73fc-4034-8022-a88d62ed6f86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:20:52.552835 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 733/1477] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 12:20:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:20:52.577027 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72614e5-0745-4595-bab8-3ee240fd5cdb None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:20:52.589883 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72614e5-0745-4595-bab8-3ee240fd5cdb None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:20:52.594247 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e22933-79fc-4519-82eb-3b00277d47ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:20:52.594866 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e22933-79fc-4519-82eb-3b00277d47ec admin admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:20:52.595144 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e22933-79fc-4519-82eb-3b00277d47ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:20:52.595416 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e22933-79fc-4519-82eb-3b00277d47ec admin admin] PATH_INFO: `/v3/projects` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:20:52.596167 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e22933-79fc-4519-82eb-3b00277d47ec admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:20:52.597996 dv-cinder-846149-2-smb devstack@keystone.service[80076]: WARNING py.warnings [None req-a7e22933-79fc-4519-82eb-3b00277d47ec admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 16 12:20:52.597996 dv-cinder-846149-2-smb devstack@keystone.service[80076]: warnings.warn(msg) Jun 16 12:20:52.597996 dv-cinder-846149-2-smb devstack@keystone.service[80076]: Jun 16 12:20:52.599126 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e22933-79fc-4519-82eb-3b00277d47ec admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:20:52.618250 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 745/1478] 10.222.0.44 () {56 vars in 1108 bytes} [Thu Jun 16 12:20:52 2022] GET /identity/v3/projects => generated 2553 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 12:20:54.743002 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf89067-0890-410a-837a-284b3f85a775 None None] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:20:54.743560 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf89067-0890-410a-837a-284b3f85a775 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:20:54.743560 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf89067-0890-410a-837a-284b3f85a775 None None] PATH_INFO: `/` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:20:54.744947 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 734/1479] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 12:20:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 12:20:54.750109 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a9e220-2716-4816-988a-7a3bfd31653d None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:20:54.750509 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a9e220-2716-4816-988a-7a3bfd31653d None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:20:54.750667 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a9e220-2716-4816-988a-7a3bfd31653d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:20:54.768589 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-b6a9e220-2716-4816-988a-7a3bfd31653d None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:20:54.769845 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-b6a9e220-2716-4816-988a-7a3bfd31653d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:20:54.778188 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 746/1480] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 12:20:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:20:54.821628 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf89067-0890-410a-837a-284b3f85a775 None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:20:54.835835 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf89067-0890-410a-837a-284b3f85a775 None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:20:54.841200 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf395e41-ddc7-4da3-a7d7-d357cd23b9b8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edfb12d445e74136b90800e93941f468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '601361df39e34fcca71175aa94e425c4', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:20:54.841837 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf395e41-ddc7-4da3-a7d7-d357cd23b9b8 service nova] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:20:54.842117 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf395e41-ddc7-4da3-a7d7-d357cd23b9b8 service nova] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:20:54.842393 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf395e41-ddc7-4da3-a7d7-d357cd23b9b8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:20:54.850297 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf395e41-ddc7-4da3-a7d7-d357cd23b9b8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:20:54.851857 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf395e41-ddc7-4da3-a7d7-d357cd23b9b8 service nova] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:20:54.861037 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 735/1481] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 12:20:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 12:20:57.146041 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f19e40-3533-4abe-bb79-ec4d216c00f1 None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:20:57.146625 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f19e40-3533-4abe-bb79-ec4d216c00f1 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:20:57.146625 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f19e40-3533-4abe-bb79-ec4d216c00f1 None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:20:57.148507 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 747/1482] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 12:20:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 12:20:57.153827 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ddaf49-b2fb-4380-ad29-7bcffc4a487a None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:20:57.154515 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ddaf49-b2fb-4380-ad29-7bcffc4a487a None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:20:57.154640 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ddaf49-b2fb-4380-ad29-7bcffc4a487a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:20:57.172404 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-c6ddaf49-b2fb-4380-ad29-7bcffc4a487a None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:20:57.173667 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-c6ddaf49-b2fb-4380-ad29-7bcffc4a487a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:20:57.181311 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 736/1483] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 12:20:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:20:57.217426 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f19e40-3533-4abe-bb79-ec4d216c00f1 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:20:57.228739 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f19e40-3533-4abe-bb79-ec4d216c00f1 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:20:57.232209 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7e4e26-91bf-47b3-b4bb-fab45437e966 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1094729b25a4be7b0b394998c9ca681', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '601361df39e34fcca71175aa94e425c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:20:57.232861 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7e4e26-91bf-47b3-b4bb-fab45437e966 service neutron] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:20:57.233142 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7e4e26-91bf-47b3-b4bb-fab45437e966 service neutron] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:20:57.233424 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7e4e26-91bf-47b3-b4bb-fab45437e966 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:20:57.242113 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7e4e26-91bf-47b3-b4bb-fab45437e966 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:20:57.243533 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7e4e26-91bf-47b3-b4bb-fab45437e966 service neutron] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:20:57.252733 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 748/1484] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 12:20:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 12:20:59.422377 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59abbac6-425f-4bee-b30f-89dfd7eb31d8 None None] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:20:59.422957 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59abbac6-425f-4bee-b30f-89dfd7eb31d8 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:20:59.422957 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59abbac6-425f-4bee-b30f-89dfd7eb31d8 None None] PATH_INFO: `/` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:20:59.424346 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 737/1485] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 12:20:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 12:20:59.429933 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4329b7c-cf3e-44b0-92cc-0bd334d603f3 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:20:59.430359 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4329b7c-cf3e-44b0-92cc-0bd334d603f3 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:20:59.430479 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4329b7c-cf3e-44b0-92cc-0bd334d603f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:20:59.448139 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-a4329b7c-cf3e-44b0-92cc-0bd334d603f3 None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:20:59.449413 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-a4329b7c-cf3e-44b0-92cc-0bd334d603f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:20:59.457023 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 749/1486] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 12:20:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:20:59.493933 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59abbac6-425f-4bee-b30f-89dfd7eb31d8 None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:20:59.504416 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59abbac6-425f-4bee-b30f-89dfd7eb31d8 None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:20:59.508529 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cbc40b-ccda-43fa-ac36-ecad6e5fdbcc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1094729b25a4be7b0b394998c9ca681', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '601361df39e34fcca71175aa94e425c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:20:59.509181 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cbc40b-ccda-43fa-ac36-ecad6e5fdbcc service neutron] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:20:59.509458 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cbc40b-ccda-43fa-ac36-ecad6e5fdbcc service neutron] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:20:59.509726 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cbc40b-ccda-43fa-ac36-ecad6e5fdbcc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:20:59.518282 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cbc40b-ccda-43fa-ac36-ecad6e5fdbcc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:20:59.519686 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cbc40b-ccda-43fa-ac36-ecad6e5fdbcc service neutron] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:20:59.528857 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 738/1487] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 12:20:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 12:21:01.787969 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca2b863-3fab-46f3-a885-361c4d1a9b59 None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:21:01.788371 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca2b863-3fab-46f3-a885-361c4d1a9b59 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:21:01.788606 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca2b863-3fab-46f3-a885-361c4d1a9b59 None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:21:01.789928 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 750/1488] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 12:21:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 12:21:01.795111 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d33eaf-0360-49e3-9e6f-b5f658f86450 None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:21:01.795557 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d33eaf-0360-49e3-9e6f-b5f658f86450 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:21:01.795668 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d33eaf-0360-49e3-9e6f-b5f658f86450 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:21:01.813558 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-77d33eaf-0360-49e3-9e6f-b5f658f86450 None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:21:01.814752 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-77d33eaf-0360-49e3-9e6f-b5f658f86450 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:21:01.823317 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 739/1489] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 12:21:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:21:01.862175 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca2b863-3fab-46f3-a885-361c4d1a9b59 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:21:01.873013 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca2b863-3fab-46f3-a885-361c4d1a9b59 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:21:01.876392 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e44ccf6-6711-4b10-9561-2dee76aff736 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1094729b25a4be7b0b394998c9ca681', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '601361df39e34fcca71175aa94e425c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:21:01.877132 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e44ccf6-6711-4b10-9561-2dee76aff736 service neutron] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:21:01.877406 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e44ccf6-6711-4b10-9561-2dee76aff736 service neutron] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:21:01.877674 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e44ccf6-6711-4b10-9561-2dee76aff736 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:21:01.886823 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e44ccf6-6711-4b10-9561-2dee76aff736 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:21:01.888238 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e44ccf6-6711-4b10-9561-2dee76aff736 service neutron] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:21:01.897661 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 751/1490] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 12:21:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 12:21:04.215935 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9252dfb-b5bd-45ca-853a-30aa234ed8a8 None None] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:21:04.216480 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9252dfb-b5bd-45ca-853a-30aa234ed8a8 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:21:04.216585 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9252dfb-b5bd-45ca-853a-30aa234ed8a8 None None] PATH_INFO: `/` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:21:04.217926 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 740/1491] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 12:21:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 12:21:04.223109 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ccd68e-b640-47ca-85ae-23a9a449ead6 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:21:04.223486 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ccd68e-b640-47ca-85ae-23a9a449ead6 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:21:04.223663 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ccd68e-b640-47ca-85ae-23a9a449ead6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:21:04.241656 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-37ccd68e-b640-47ca-85ae-23a9a449ead6 None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:21:04.242849 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-37ccd68e-b640-47ca-85ae-23a9a449ead6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:21:04.250594 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 752/1492] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 12:21:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:21:04.289822 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9252dfb-b5bd-45ca-853a-30aa234ed8a8 None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:21:04.300356 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9252dfb-b5bd-45ca-853a-30aa234ed8a8 None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:21:04.304498 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef2944f-f062-420c-8c0e-a8edcfb1f5b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1094729b25a4be7b0b394998c9ca681', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '601361df39e34fcca71175aa94e425c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:21:04.305163 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef2944f-f062-420c-8c0e-a8edcfb1f5b3 service neutron] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:21:04.305449 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef2944f-f062-420c-8c0e-a8edcfb1f5b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:21:04.305725 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef2944f-f062-420c-8c0e-a8edcfb1f5b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:21:04.314540 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef2944f-f062-420c-8c0e-a8edcfb1f5b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:21:04.315960 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef2944f-f062-420c-8c0e-a8edcfb1f5b3 service neutron] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:21:04.325279 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 741/1493] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 12:21:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 12:21:14.236564 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=33 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:21:14.321181 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=33 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:22:57.825376 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e27ce5-bc41-4068-af4c-f9069303c802 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:22:57.825992 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e27ce5-bc41-4068-af4c-f9069303c802 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:22:57.825992 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e27ce5-bc41-4068-af4c-f9069303c802 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:22:57.843493 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-d6e27ce5-bc41-4068-af4c-f9069303c802 None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:22:57.844687 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-d6e27ce5-bc41-4068-af4c-f9069303c802 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:22:57.852528 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 753/1494] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 12:22:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:22:57.861473 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7df4ef-ac08-46df-8742-2bd1e232acee None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:22:57.861912 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7df4ef-ac08-46df-8742-2bd1e232acee None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:22:57.862016 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7df4ef-ac08-46df-8742-2bd1e232acee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:22:57.880744 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-4c7df4ef-ac08-46df-8742-2bd1e232acee None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:22:57.881944 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-4c7df4ef-ac08-46df-8742-2bd1e232acee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:22:57.890309 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 742/1495] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 12:22:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:22:57.894674 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e27ce5-bc41-4068-af4c-f9069303c802 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:22:57.904210 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e27ce5-bc41-4068-af4c-f9069303c802 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:22:57.908770 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e681afc-3829-4c39-af7b-d47078712f3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:22:57.909420 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e681afc-3829-4c39-af7b-d47078712f3a admin admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:22:57.909698 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e681afc-3829-4c39-af7b-d47078712f3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:22:57.909968 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e681afc-3829-4c39-af7b-d47078712f3a admin admin] PATH_INFO: `/v3/domains` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:22:57.910947 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e681afc-3829-4c39-af7b-d47078712f3a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:22:57.911249 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e681afc-3829-4c39-af7b-d47078712f3a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:22:57.912260 dv-cinder-846149-2-smb devstack@keystone.service[80076]: WARNING py.warnings [None req-8e681afc-3829-4c39-af7b-d47078712f3a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 12:22:57.912260 dv-cinder-846149-2-smb devstack@keystone.service[80076]: warnings.warn(msg) Jun 16 12:22:57.912260 dv-cinder-846149-2-smb devstack@keystone.service[80076]: Jun 16 12:22:57.913175 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e681afc-3829-4c39-af7b-d47078712f3a admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:22:57.924979 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 754/1496] 10.222.0.44 () {58 vars in 1152 bytes} [Thu Jun 16 12:22:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:22:57.933557 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7df4ef-ac08-46df-8742-2bd1e232acee None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:22:57.942663 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7df4ef-ac08-46df-8742-2bd1e232acee None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:22:57.947209 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4429673-a4b4-406a-b010-7f9d975df9d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:22:57.948444 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4429673-a4b4-406a-b010-7f9d975df9d3 admin admin] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:22:57.948720 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4429673-a4b4-406a-b010-7f9d975df9d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:22:57.949022 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4429673-a4b4-406a-b010-7f9d975df9d3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:22:57.949707 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4429673-a4b4-406a-b010-7f9d975df9d3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:22:57.951475 dv-cinder-846149-2-smb devstack@keystone.service[80075]: WARNING py.warnings [None req-c4429673-a4b4-406a-b010-7f9d975df9d3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 16 12:22:57.951475 dv-cinder-846149-2-smb devstack@keystone.service[80075]: warnings.warn(msg) Jun 16 12:22:57.951475 dv-cinder-846149-2-smb devstack@keystone.service[80075]: Jun 16 12:22:57.952684 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4429673-a4b4-406a-b010-7f9d975df9d3 admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:22:57.987993 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 743/1497] 10.222.0.44 () {60 vars in 1152 bytes} [Thu Jun 16 12:22:57 2022] POST /identity/v3/projects => generated 377 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 12:22:57.992276 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e681afc-3829-4c39-af7b-d47078712f3a admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:22:58.002496 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e681afc-3829-4c39-af7b-d47078712f3a admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:22:58.056591 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa92dc94-93db-46a8-90ef-bf36514e6716 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:22:58.057861 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa92dc94-93db-46a8-90ef-bf36514e6716 admin admin] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:22:58.058136 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa92dc94-93db-46a8-90ef-bf36514e6716 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:22:58.058405 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa92dc94-93db-46a8-90ef-bf36514e6716 admin admin] PATH_INFO: `/v3/users` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:22:58.059072 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa92dc94-93db-46a8-90ef-bf36514e6716 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:22:58.060109 dv-cinder-846149-2-smb devstack@keystone.service[80076]: WARNING py.warnings [None req-fa92dc94-93db-46a8-90ef-bf36514e6716 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 16 12:22:58.060109 dv-cinder-846149-2-smb devstack@keystone.service[80076]: warnings.warn(msg) Jun 16 12:22:58.060109 dv-cinder-846149-2-smb devstack@keystone.service[80076]: Jun 16 12:22:58.061342 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa92dc94-93db-46a8-90ef-bf36514e6716 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:22:58.081525 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 755/1498] 10.222.0.44 () {60 vars in 1143 bytes} [Thu Jun 16 12:22:57 2022] POST /identity/v3/users => generated 289 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 12:22:58.085604 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4429673-a4b4-406a-b010-7f9d975df9d3 admin admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:22:58.095698 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4429673-a4b4-406a-b010-7f9d975df9d3 admin admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:22:58.100413 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7b3bfe-72de-4d78-8da8-b88916f7a819 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:22:58.101134 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7b3bfe-72de-4d78-8da8-b88916f7a819 admin admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:22:58.101416 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7b3bfe-72de-4d78-8da8-b88916f7a819 admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:22:58.101694 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7b3bfe-72de-4d78-8da8-b88916f7a819 admin admin] PATH_INFO: `/v3/roles` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:22:58.102457 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7b3bfe-72de-4d78-8da8-b88916f7a819 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:22:58.103462 dv-cinder-846149-2-smb devstack@keystone.service[80075]: WARNING py.warnings [None req-bc7b3bfe-72de-4d78-8da8-b88916f7a819 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 12:22:58.103462 dv-cinder-846149-2-smb devstack@keystone.service[80075]: warnings.warn(msg) Jun 16 12:22:58.103462 dv-cinder-846149-2-smb devstack@keystone.service[80075]: Jun 16 12:22:58.104346 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7b3bfe-72de-4d78-8da8-b88916f7a819 admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:22:58.117034 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 744/1499] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 12:22:58 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 12:22:58.121591 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa92dc94-93db-46a8-90ef-bf36514e6716 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:22:58.131427 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa92dc94-93db-46a8-90ef-bf36514e6716 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:22:58.136600 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cb6cfd-723c-4974-af15-57577467b449 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:22:58.137295 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cb6cfd-723c-4974-af15-57577467b449 admin admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:22:58.137576 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cb6cfd-723c-4974-af15-57577467b449 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:22:58.137850 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cb6cfd-723c-4974-af15-57577467b449 admin admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:22:58.138566 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cb6cfd-723c-4974-af15-57577467b449 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:22:58.139861 dv-cinder-846149-2-smb devstack@keystone.service[80076]: WARNING py.warnings [None req-a6cb6cfd-723c-4974-af15-57577467b449 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 12:22:58.139861 dv-cinder-846149-2-smb devstack@keystone.service[80076]: warnings.warn(msg) Jun 16 12:22:58.139861 dv-cinder-846149-2-smb devstack@keystone.service[80076]: Jun 16 12:22:58.140771 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cb6cfd-723c-4974-af15-57577467b449 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:22:58.153818 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 756/1500] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 12:22:58 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 12:22:58.158032 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7b3bfe-72de-4d78-8da8-b88916f7a819 admin admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:22:58.168587 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7b3bfe-72de-4d78-8da8-b88916f7a819 admin admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:22:58.173033 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9626958d-7274-4ef4-adde-73d460ad4bee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:22:58.173895 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9626958d-7274-4ef4-adde-73d460ad4bee admin admin] REQUEST_METHOD: `PUT` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:22:58.174170 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9626958d-7274-4ef4-adde-73d460ad4bee admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:22:58.174437 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9626958d-7274-4ef4-adde-73d460ad4bee admin admin] PATH_INFO: `/v3/projects/2de109d6fdc34da787e7424e6be04ae1/users/f63fd922e79e4df69b8f706d3a1813c0/roles/c39882b202e942479a7cdac2fc6da72c` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:22:58.189096 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9626958d-7274-4ef4-adde-73d460ad4bee admin admin] RBAC: Authorizing `identity:create_grant(project_id=2de109d6fdc34da787e7424e6be04ae1, user_id=f63fd922e79e4df69b8f706d3a1813c0, role_id=c39882b202e942479a7cdac2fc6da72c)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:22:58.190114 dv-cinder-846149-2-smb devstack@keystone.service[80075]: WARNING py.warnings [None req-9626958d-7274-4ef4-adde-73d460ad4bee admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 16 12:22:58.190114 dv-cinder-846149-2-smb devstack@keystone.service[80075]: warnings.warn(msg) Jun 16 12:22:58.190114 dv-cinder-846149-2-smb devstack@keystone.service[80075]: Jun 16 12:22:58.192003 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9626958d-7274-4ef4-adde-73d460ad4bee admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:22:58.204344 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 745/1501] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 16 12:22:58 2022] PUT /identity/v3/projects/2de109d6fdc34da787e7424e6be04ae1/users/f63fd922e79e4df69b8f706d3a1813c0/roles/c39882b202e942479a7cdac2fc6da72c => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 12:22:58.215309 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a223668-de56-48d0-8018-254b9c455965 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:22:58.215594 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a223668-de56-48d0-8018-254b9c455965 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:22:58.215869 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a223668-de56-48d0-8018-254b9c455965 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:22:58.241665 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-9a223668-de56-48d0-8018-254b9c455965 None None] MFA Rules not processed for user `f63fd922e79e4df69b8f706d3a1813c0`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:22:58.243194 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-9a223668-de56-48d0-8018-254b9c455965 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:22:58.306627 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 757/1502] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 12:22:58 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:22:58.320186 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38caf204-7700-4532-b36e-20ccfb4ca7ab None None] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:22:58.320529 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38caf204-7700-4532-b36e-20ccfb4ca7ab None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:22:58.320849 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38caf204-7700-4532-b36e-20ccfb4ca7ab None None] PATH_INFO: `/` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:22:58.322200 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 746/1503] 10.222.0.44 () {54 vars in 963 bytes} [Thu Jun 16 12:22:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 12:22:58.327067 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e62fe87-46bf-4576-85ff-c6bccc85c052 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:22:58.327359 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e62fe87-46bf-4576-85ff-c6bccc85c052 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:22:58.327642 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e62fe87-46bf-4576-85ff-c6bccc85c052 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:22:58.345219 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-4e62fe87-46bf-4576-85ff-c6bccc85c052 None None] MFA Rules not processed for user `4f96fc14ed89478c8a8c2f11c87511e3`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:22:58.346369 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-4e62fe87-46bf-4576-85ff-c6bccc85c052 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:22:58.389216 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:22:58.397300 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 758/1504] 10.222.0.44 () {58 vars in 1060 bytes} [Thu Jun 16 12:22:58 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:22:58.404879 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38caf204-7700-4532-b36e-20ccfb4ca7ab None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:22:58.415595 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38caf204-7700-4532-b36e-20ccfb4ca7ab None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:22:58.419675 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126ee080-2834-4958-b960-196430883d21 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f96fc14ed89478c8a8c2f11c87511e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '601361df39e34fcca71175aa94e425c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:22:58.420305 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126ee080-2834-4958-b960-196430883d21 service cinder] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:22:58.420585 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126ee080-2834-4958-b960-196430883d21 service cinder] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:22:58.420964 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126ee080-2834-4958-b960-196430883d21 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:22:58.429008 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126ee080-2834-4958-b960-196430883d21 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:22:58.430445 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126ee080-2834-4958-b960-196430883d21 service cinder] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:22:58.439621 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 747/1505] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 12:22:58 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 12:22:58.481367 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305fc4ad-8df1-4549-8f6b-1c0ff1ed7a2f None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:22:58.481650 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305fc4ad-8df1-4549-8f6b-1c0ff1ed7a2f None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:22:58.481923 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305fc4ad-8df1-4549-8f6b-1c0ff1ed7a2f None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:22:58.483206 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 759/1506] 10.222.0.44 () {52 vars in 829 bytes} [Thu Jun 16 12:22:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 12:22:58.486831 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126ee080-2834-4958-b960-196430883d21 service cinder] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:22:58.548389 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126ee080-2834-4958-b960-196430883d21 service cinder] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:22:58.553082 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c97081d-16fb-4cf6-9dec-ce33b3cfbb9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:22:58.553937 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c97081d-16fb-4cf6-9dec-ce33b3cfbb9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:22:58.554214 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c97081d-16fb-4cf6-9dec-ce33b3cfbb9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:22:58.554831 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c97081d-16fb-4cf6-9dec-ce33b3cfbb9e admin admin] PATH_INFO: `/v3/users/f63fd922e79e4df69b8f706d3a1813c0` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:22:58.555656 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c97081d-16fb-4cf6-9dec-ce33b3cfbb9e admin admin] RBAC: Authorizing `identity:delete_user(user_id=f63fd922e79e4df69b8f706d3a1813c0)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:22:58.556667 dv-cinder-846149-2-smb devstack@keystone.service[80075]: WARNING py.warnings [None req-8c97081d-16fb-4cf6-9dec-ce33b3cfbb9e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 16 12:22:58.556667 dv-cinder-846149-2-smb devstack@keystone.service[80075]: warnings.warn(msg) Jun 16 12:22:58.556667 dv-cinder-846149-2-smb devstack@keystone.service[80075]: Jun 16 12:22:58.557928 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c97081d-16fb-4cf6-9dec-ce33b3cfbb9e admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:22:58.622512 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-8c97081d-16fb-4cf6-9dec-ce33b3cfbb9e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f63fd922e79e4df69b8f706d3a1813c0'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:22:58.640321 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-8c97081d-16fb-4cf6-9dec-ce33b3cfbb9e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f63fd922e79e4df69b8f706d3a1813c0'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:22:58.652815 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-8c97081d-16fb-4cf6-9dec-ce33b3cfbb9e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f63fd922e79e4df69b8f706d3a1813c0'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:22:58.653519 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-8c97081d-16fb-4cf6-9dec-ce33b3cfbb9e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f63fd922e79e4df69b8f706d3a1813c0'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:22:58.654234 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-8c97081d-16fb-4cf6-9dec-ce33b3cfbb9e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f63fd922e79e4df69b8f706d3a1813c0'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:22:58.658120 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:22:58.670979 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 748/1507] 10.222.0.44 () {58 vars in 1223 bytes} [Thu Jun 16 12:22:58 2022] DELETE /identity/v3/users/f63fd922e79e4df69b8f706d3a1813c0 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:22:58.675560 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0690e128-5a44-45bf-8e45-c6b0e2b8a95a None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:22:58.675855 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0690e128-5a44-45bf-8e45-c6b0e2b8a95a None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:22:58.676137 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0690e128-5a44-45bf-8e45-c6b0e2b8a95a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:22:58.693285 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-0690e128-5a44-45bf-8e45-c6b0e2b8a95a None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:22:58.694468 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-0690e128-5a44-45bf-8e45-c6b0e2b8a95a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:22:58.755852 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 760/1508] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 12:22:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:22:58.769104 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c97081d-16fb-4cf6-9dec-ce33b3cfbb9e admin admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:22:58.770716 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-8c97081d-16fb-4cf6-9dec-ce33b3cfbb9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:22:58.836645 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c97081d-16fb-4cf6-9dec-ce33b3cfbb9e admin admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:22:58.840950 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa091ee8-2935-4855-ace0-786895b2b9e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1094729b25a4be7b0b394998c9ca681', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '601361df39e34fcca71175aa94e425c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:22:58.841598 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa091ee8-2935-4855-ace0-786895b2b9e5 service neutron] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:22:58.841876 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa091ee8-2935-4855-ace0-786895b2b9e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:22:58.842147 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa091ee8-2935-4855-ace0-786895b2b9e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:22:58.851242 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa091ee8-2935-4855-ace0-786895b2b9e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:22:58.852673 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa091ee8-2935-4855-ace0-786895b2b9e5 service neutron] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:22:58.862722 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 749/1509] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 12:22:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 12:22:59.189582 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0690e128-5a44-45bf-8e45-c6b0e2b8a95a None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:22:59.191044 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-0690e128-5a44-45bf-8e45-c6b0e2b8a95a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:22:59.203400 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0690e128-5a44-45bf-8e45-c6b0e2b8a95a None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:22:59.209047 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c74c8f-0a3e-4b64-bc2e-f49fea6b0b6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:22:59.209913 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c74c8f-0a3e-4b64-bc2e-f49fea6b0b6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:22:59.210194 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c74c8f-0a3e-4b64-bc2e-f49fea6b0b6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:22:59.210467 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c74c8f-0a3e-4b64-bc2e-f49fea6b0b6d admin admin] PATH_INFO: `/v3/projects/2de109d6fdc34da787e7424e6be04ae1` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:22:59.211670 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c74c8f-0a3e-4b64-bc2e-f49fea6b0b6d admin admin] RBAC: Authorizing `identity:delete_project(project_id=2de109d6fdc34da787e7424e6be04ae1)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:22:59.212708 dv-cinder-846149-2-smb devstack@keystone.service[80076]: WARNING py.warnings [None req-d5c74c8f-0a3e-4b64-bc2e-f49fea6b0b6d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 16 12:22:59.212708 dv-cinder-846149-2-smb devstack@keystone.service[80076]: warnings.warn(msg) Jun 16 12:22:59.212708 dv-cinder-846149-2-smb devstack@keystone.service[80076]: Jun 16 12:22:59.215022 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c74c8f-0a3e-4b64-bc2e-f49fea6b0b6d admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:22:59.274562 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-d5c74c8f-0a3e-4b64-bc2e-f49fea6b0b6d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2de109d6fdc34da787e7424e6be04ae1', 'request_id': 'req-d5c74c8f-0a3e-4b64-bc2e-f49fea6b0b6d'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:22:59.284386 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-d5c74c8f-0a3e-4b64-bc2e-f49fea6b0b6d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2de109d6fdc34da787e7424e6be04ae1', 'request_id': 'req-d5c74c8f-0a3e-4b64-bc2e-f49fea6b0b6d'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:22:59.290541 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-d5c74c8f-0a3e-4b64-bc2e-f49fea6b0b6d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2de109d6fdc34da787e7424e6be04ae1', 'request_id': 'req-d5c74c8f-0a3e-4b64-bc2e-f49fea6b0b6d'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:22:59.308677 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-d5c74c8f-0a3e-4b64-bc2e-f49fea6b0b6d admin admin] The token cache is being invalidate because project 2de109d6fdc34da787e7424e6be04ae1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 12:22:59.308993 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-d5c74c8f-0a3e-4b64-bc2e-f49fea6b0b6d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:22:59.309637 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-d5c74c8f-0a3e-4b64-bc2e-f49fea6b0b6d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:22:59.311262 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 761/1510] 10.222.0.44 () {58 vars in 1232 bytes} [Thu Jun 16 12:22:59 2022] DELETE /identity/v3/projects/2de109d6fdc34da787e7424e6be04ae1 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:23:08.858417 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:DELETE=1,keystone:SELECT=28 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:23:09.305250 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=55,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:24:42.827805 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6aae82-f01f-4f1e-968d-3292432c9be1 None None] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:24:42.828419 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6aae82-f01f-4f1e-968d-3292432c9be1 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:24:42.828419 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6aae82-f01f-4f1e-968d-3292432c9be1 None None] PATH_INFO: `/` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:24:42.829832 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 750/1511] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 16 12:24:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 12:24:42.834501 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ec6d3e-df02-42de-a4bb-fd2dc499fe30 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:24:42.834900 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ec6d3e-df02-42de-a4bb-fd2dc499fe30 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:24:42.835060 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ec6d3e-df02-42de-a4bb-fd2dc499fe30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:24:42.853247 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-85ec6d3e-df02-42de-a4bb-fd2dc499fe30 None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:24:42.855009 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-85ec6d3e-df02-42de-a4bb-fd2dc499fe30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:24:42.911899 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 762/1512] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 16 12:24:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:24:43.082518 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6aae82-f01f-4f1e-968d-3292432c9be1 None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:24:43.084196 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-0f6aae82-f01f-4f1e-968d-3292432c9be1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:24:43.157697 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6aae82-f01f-4f1e-968d-3292432c9be1 None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:24:43.163347 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75eb9cb-a988-4a35-a271-e0194e010447 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edfb12d445e74136b90800e93941f468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '601361df39e34fcca71175aa94e425c4', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:24:43.163986 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75eb9cb-a988-4a35-a271-e0194e010447 service nova] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:24:43.164269 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75eb9cb-a988-4a35-a271-e0194e010447 service nova] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:24:43.164540 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75eb9cb-a988-4a35-a271-e0194e010447 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:24:43.172729 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75eb9cb-a988-4a35-a271-e0194e010447 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:24:43.174981 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75eb9cb-a988-4a35-a271-e0194e010447 service nova] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:24:43.184505 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 751/1513] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 12:24:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 12:24:44.073532 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c527e4-4cd3-4322-81f9-ca2b759345bf None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:24:44.074089 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c527e4-4cd3-4322-81f9-ca2b759345bf None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:24:44.074089 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c527e4-4cd3-4322-81f9-ca2b759345bf None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:24:44.075528 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 763/1514] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 16 12:24:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 12:24:44.080193 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1022dae9-7535-404b-9252-b5eaa519cd8e None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:24:44.080627 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1022dae9-7535-404b-9252-b5eaa519cd8e None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:24:44.080919 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1022dae9-7535-404b-9252-b5eaa519cd8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:24:44.098775 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-1022dae9-7535-404b-9252-b5eaa519cd8e None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:24:44.099978 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-1022dae9-7535-404b-9252-b5eaa519cd8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:24:44.108304 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 752/1515] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 16 12:24:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:24:44.259945 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c527e4-4cd3-4322-81f9-ca2b759345bf None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:24:44.274066 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c527e4-4cd3-4322-81f9-ca2b759345bf None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:24:44.279856 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f039b9fa-c102-40a2-becb-230250bfcb43 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edfb12d445e74136b90800e93941f468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '601361df39e34fcca71175aa94e425c4', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:24:44.280481 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f039b9fa-c102-40a2-becb-230250bfcb43 service nova] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:24:44.280783 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f039b9fa-c102-40a2-becb-230250bfcb43 service nova] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:24:44.281053 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f039b9fa-c102-40a2-becb-230250bfcb43 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:24:44.289321 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f039b9fa-c102-40a2-becb-230250bfcb43 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:24:44.290915 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f039b9fa-c102-40a2-becb-230250bfcb43 service nova] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:24:44.300619 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 764/1516] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 12:24:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 12:24:44.646868 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09fd98f-9268-49ab-a9d2-0872e0081eb8 None None] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:24:44.647081 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09fd98f-9268-49ab-a9d2-0872e0081eb8 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:24:44.647362 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09fd98f-9268-49ab-a9d2-0872e0081eb8 None None] PATH_INFO: `/v3` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:24:44.648678 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 753/1517] 10.222.0.16 () {54 vars in 925 bytes} [Thu Jun 16 12:24:44 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:24:44.655296 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e98dd1b-5c62-40bc-84df-aa7812ee904c None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:24:44.655583 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e98dd1b-5c62-40bc-84df-aa7812ee904c None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:24:44.655860 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e98dd1b-5c62-40bc-84df-aa7812ee904c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:24:44.673673 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-5e98dd1b-5c62-40bc-84df-aa7812ee904c None None] MFA Rules not processed for user `8bff8ccf460a403d993c39327bbcbd29`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:24:44.674884 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-5e98dd1b-5c62-40bc-84df-aa7812ee904c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:24:44.735618 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 765/1518] 10.222.0.16 () {58 vars in 1015 bytes} [Thu Jun 16 12:24:44 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:24:48.455300 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1588c1-1b5b-489a-b09e-4e3911c61403 None None] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:24:48.455861 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1588c1-1b5b-489a-b09e-4e3911c61403 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:24:48.455861 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1588c1-1b5b-489a-b09e-4e3911c61403 None None] PATH_INFO: `/` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:24:48.457310 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 754/1519] 10.222.0.44 () {54 vars in 960 bytes} [Thu Jun 16 12:24:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 12:24:48.462486 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28a8611-d6b3-4686-a73f-7429bca1ef87 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:24:48.463518 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28a8611-d6b3-4686-a73f-7429bca1ef87 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:24:48.463634 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28a8611-d6b3-4686-a73f-7429bca1ef87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:24:48.482931 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-a28a8611-d6b3-4686-a73f-7429bca1ef87 None None] MFA Rules not processed for user `8bff8ccf460a403d993c39327bbcbd29`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:24:48.484255 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-a28a8611-d6b3-4686-a73f-7429bca1ef87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:24:48.495678 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 766/1520] 10.222.0.44 () {58 vars in 1057 bytes} [Thu Jun 16 12:24:48 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:24:48.504233 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1588c1-1b5b-489a-b09e-4e3911c61403 None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:24:48.518244 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1588c1-1b5b-489a-b09e-4e3911c61403 None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:24:48.523059 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca6c6a4-2d0f-48d8-8fd0-38681db6b76c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8bff8ccf460a403d993c39327bbcbd29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '601361df39e34fcca71175aa94e425c4', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:24:48.523681 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca6c6a4-2d0f-48d8-8fd0-38681db6b76c service placement] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:24:48.523959 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca6c6a4-2d0f-48d8-8fd0-38681db6b76c service placement] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:24:48.524228 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca6c6a4-2d0f-48d8-8fd0-38681db6b76c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:24:48.533618 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca6c6a4-2d0f-48d8-8fd0-38681db6b76c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:24:48.535286 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca6c6a4-2d0f-48d8-8fd0-38681db6b76c service placement] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:24:48.545503 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 755/1521] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 12:24:48 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 12:24:55.585315 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f64aa5-64c9-4ef5-bcd2-3abf672ad486 None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:24:55.585912 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f64aa5-64c9-4ef5-bcd2-3abf672ad486 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:24:55.585912 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f64aa5-64c9-4ef5-bcd2-3abf672ad486 None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:24:55.587321 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 767/1522] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 16 12:24:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 12:24:55.592709 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d2d489-fb97-472a-a41e-d2fff053ddff None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:24:55.593156 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d2d489-fb97-472a-a41e-d2fff053ddff None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:24:55.593303 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d2d489-fb97-472a-a41e-d2fff053ddff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:24:55.614140 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-40d2d489-fb97-472a-a41e-d2fff053ddff None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:24:55.615327 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-40d2d489-fb97-472a-a41e-d2fff053ddff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:24:55.623078 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 756/1523] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 16 12:24:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:24:55.777780 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f64aa5-64c9-4ef5-bcd2-3abf672ad486 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:24:55.792842 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f64aa5-64c9-4ef5-bcd2-3abf672ad486 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:24:55.798173 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3609591-7044-40fc-9d00-4120b7b1c31a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edfb12d445e74136b90800e93941f468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '601361df39e34fcca71175aa94e425c4', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:24:55.798799 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3609591-7044-40fc-9d00-4120b7b1c31a service nova] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:24:55.799077 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3609591-7044-40fc-9d00-4120b7b1c31a service nova] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:24:55.799349 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3609591-7044-40fc-9d00-4120b7b1c31a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:24:55.807285 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3609591-7044-40fc-9d00-4120b7b1c31a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:24:55.808936 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3609591-7044-40fc-9d00-4120b7b1c31a service nova] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:24:55.818129 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 768/1524] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 12:24:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 12:24:56.675415 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2c395e-654b-4efc-8103-49817c01b9d9 None None] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:24:56.676008 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2c395e-654b-4efc-8103-49817c01b9d9 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:24:56.676008 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2c395e-654b-4efc-8103-49817c01b9d9 None None] PATH_INFO: `/` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:24:56.677405 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 757/1525] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 16 12:24:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 12:24:56.682820 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c92e906-c2cb-474a-bdd9-4b7b0ae23924 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:24:56.683204 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c92e906-c2cb-474a-bdd9-4b7b0ae23924 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:24:56.683368 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c92e906-c2cb-474a-bdd9-4b7b0ae23924 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:24:56.701055 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-4c92e906-c2cb-474a-bdd9-4b7b0ae23924 None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:24:56.702261 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-4c92e906-c2cb-474a-bdd9-4b7b0ae23924 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:24:56.709965 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 769/1526] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 16 12:24:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:24:56.861126 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2c395e-654b-4efc-8103-49817c01b9d9 None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:24:56.875938 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2c395e-654b-4efc-8103-49817c01b9d9 None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:24:56.881288 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30932327-519c-4ff6-8dbb-c71043b3e0d8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edfb12d445e74136b90800e93941f468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '601361df39e34fcca71175aa94e425c4', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:24:56.881947 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30932327-519c-4ff6-8dbb-c71043b3e0d8 service nova] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:24:56.882231 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30932327-519c-4ff6-8dbb-c71043b3e0d8 service nova] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:24:56.882504 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30932327-519c-4ff6-8dbb-c71043b3e0d8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:24:56.890518 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30932327-519c-4ff6-8dbb-c71043b3e0d8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:24:56.892095 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30932327-519c-4ff6-8dbb-c71043b3e0d8 service nova] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:24:56.901343 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 758/1527] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 12:24:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 12:25:00.774605 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12861dbf-8ddd-4c19-b8cf-fe9fc596f025 None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:25:00.775152 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12861dbf-8ddd-4c19-b8cf-fe9fc596f025 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:25:00.775152 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12861dbf-8ddd-4c19-b8cf-fe9fc596f025 None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:25:00.776574 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 770/1528] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 16 12:25:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 12:25:00.781924 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4896cee-837d-4e39-b1e4-c624074fb182 None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:25:00.782333 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4896cee-837d-4e39-b1e4-c624074fb182 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:25:00.782478 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4896cee-837d-4e39-b1e4-c624074fb182 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:25:00.800050 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-b4896cee-837d-4e39-b1e4-c624074fb182 None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:25:00.801261 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-b4896cee-837d-4e39-b1e4-c624074fb182 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:25:00.809379 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 759/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 16 12:25:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:25:00.846590 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12861dbf-8ddd-4c19-b8cf-fe9fc596f025 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:25:00.848283 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-12861dbf-8ddd-4c19-b8cf-fe9fc596f025 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:25:00.904687 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12861dbf-8ddd-4c19-b8cf-fe9fc596f025 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:25:00.908219 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a8363e-679c-4491-afc2-37c0ff1be6fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1094729b25a4be7b0b394998c9ca681', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '601361df39e34fcca71175aa94e425c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:25:00.908885 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a8363e-679c-4491-afc2-37c0ff1be6fc service neutron] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:25:00.909164 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a8363e-679c-4491-afc2-37c0ff1be6fc service neutron] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:25:00.909436 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a8363e-679c-4491-afc2-37c0ff1be6fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:25:00.918527 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a8363e-679c-4491-afc2-37c0ff1be6fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:25:00.919951 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a8363e-679c-4491-afc2-37c0ff1be6fc service neutron] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:25:00.924923 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:25:00.930093 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 771/1530] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 12:25:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 12:25:03.039509 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb20fbfb-74ec-499e-860f-7a1e52a2d550 None None] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:25:03.040077 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb20fbfb-74ec-499e-860f-7a1e52a2d550 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:25:03.040182 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb20fbfb-74ec-499e-860f-7a1e52a2d550 None None] PATH_INFO: `/` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:25:03.041525 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 760/1531] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 16 12:25:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 12:25:03.046678 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af67d629-c2a1-49f4-8309-39de922ae711 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:25:03.047103 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af67d629-c2a1-49f4-8309-39de922ae711 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:25:03.047223 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af67d629-c2a1-49f4-8309-39de922ae711 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:25:03.065704 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-af67d629-c2a1-49f4-8309-39de922ae711 None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:25:03.066902 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-af67d629-c2a1-49f4-8309-39de922ae711 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:25:03.075380 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 772/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 16 12:25:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:25:03.110498 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb20fbfb-74ec-499e-860f-7a1e52a2d550 None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:25:03.121681 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb20fbfb-74ec-499e-860f-7a1e52a2d550 None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:25:03.125351 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6dce3a-2894-485a-ad90-e24e43facb68 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1094729b25a4be7b0b394998c9ca681', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '601361df39e34fcca71175aa94e425c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:25:03.125977 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6dce3a-2894-485a-ad90-e24e43facb68 service neutron] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:25:03.126259 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6dce3a-2894-485a-ad90-e24e43facb68 service neutron] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:25:03.126532 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6dce3a-2894-485a-ad90-e24e43facb68 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:25:03.136347 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6dce3a-2894-485a-ad90-e24e43facb68 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:25:03.137816 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6dce3a-2894-485a-ad90-e24e43facb68 service neutron] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:25:03.147283 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 761/1533] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 12:25:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 12:25:06.673201 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1669475-d1d3-4246-816a-04457118844f None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:25:06.673773 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1669475-d1d3-4246-816a-04457118844f None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:25:06.673773 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1669475-d1d3-4246-816a-04457118844f None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:25:06.675143 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 773/1534] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 16 12:25:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 12:25:06.680199 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18d68fa-c0e1-4b68-ac4d-35a3bd0cc4e8 None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:25:06.680614 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18d68fa-c0e1-4b68-ac4d-35a3bd0cc4e8 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:25:06.680766 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18d68fa-c0e1-4b68-ac4d-35a3bd0cc4e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:25:06.698945 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-c18d68fa-c0e1-4b68-ac4d-35a3bd0cc4e8 None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:25:06.700137 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-c18d68fa-c0e1-4b68-ac4d-35a3bd0cc4e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:25:06.707837 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 762/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 16 12:25:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:25:06.972399 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1669475-d1d3-4246-816a-04457118844f None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:25:06.974119 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-d1669475-d1d3-4246-816a-04457118844f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:25:07.030187 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1669475-d1d3-4246-816a-04457118844f None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:25:07.033711 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0b0129-a274-4a9d-8fd3-f13277f7d5ea service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f96fc14ed89478c8a8c2f11c87511e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '601361df39e34fcca71175aa94e425c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:25:07.034348 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0b0129-a274-4a9d-8fd3-f13277f7d5ea service cinder] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:25:07.034629 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0b0129-a274-4a9d-8fd3-f13277f7d5ea service cinder] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:25:07.034904 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0b0129-a274-4a9d-8fd3-f13277f7d5ea service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:25:07.043922 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0b0129-a274-4a9d-8fd3-f13277f7d5ea service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:25:07.045395 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0b0129-a274-4a9d-8fd3-f13277f7d5ea service cinder] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:25:07.054575 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 774/1536] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 12:25:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 12:25:09.180280 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24cb019-31ad-475e-9ffc-ea28958a5758 None None] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:25:09.180841 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24cb019-31ad-475e-9ffc-ea28958a5758 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:25:09.180841 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24cb019-31ad-475e-9ffc-ea28958a5758 None None] PATH_INFO: `/` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:25:09.182173 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 763/1537] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 16 12:25:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 12:25:09.187441 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b1940b-258f-4ebd-9c9b-61d8ef53158e None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:25:09.187853 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b1940b-258f-4ebd-9c9b-61d8ef53158e None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:25:09.187974 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b1940b-258f-4ebd-9c9b-61d8ef53158e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:25:09.205400 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-e1b1940b-258f-4ebd-9c9b-61d8ef53158e None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:25:09.206572 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-e1b1940b-258f-4ebd-9c9b-61d8ef53158e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:25:09.214623 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 775/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 16 12:25:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:25:09.475968 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24cb019-31ad-475e-9ffc-ea28958a5758 None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:25:09.477661 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-b24cb019-31ad-475e-9ffc-ea28958a5758 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:25:09.485183 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=65 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:25:09.491652 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24cb019-31ad-475e-9ffc-ea28958a5758 None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:25:09.495164 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2086ff5-8a00-46bb-bd9d-a231e2dc9002 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f96fc14ed89478c8a8c2f11c87511e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '601361df39e34fcca71175aa94e425c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:25:09.495800 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2086ff5-8a00-46bb-bd9d-a231e2dc9002 service cinder] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:25:09.496083 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2086ff5-8a00-46bb-bd9d-a231e2dc9002 service cinder] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:25:09.496357 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2086ff5-8a00-46bb-bd9d-a231e2dc9002 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:25:09.505178 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2086ff5-8a00-46bb-bd9d-a231e2dc9002 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:25:09.506594 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2086ff5-8a00-46bb-bd9d-a231e2dc9002 service cinder] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:25:09.516378 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 764/1539] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 12:25:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 12:25:19.200307 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=32 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:25:19.512368 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=5 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:26:39.790991 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fddc0e2-0301-465e-82ab-d959462c0d37 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:26:39.792238 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fddc0e2-0301-465e-82ab-d959462c0d37 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:26:39.792724 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fddc0e2-0301-465e-82ab-d959462c0d37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:26:39.825842 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-1fddc0e2-0301-465e-82ab-d959462c0d37 None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:26:39.827126 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-1fddc0e2-0301-465e-82ab-d959462c0d37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:26:39.838851 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 776/1540] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 12:26:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 12:26:39.851758 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b538a7f-9fb3-4c3e-885b-c37dd13acfb6 None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:26:39.852342 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b538a7f-9fb3-4c3e-885b-c37dd13acfb6 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:26:39.852342 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b538a7f-9fb3-4c3e-885b-c37dd13acfb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:26:39.885591 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-0b538a7f-9fb3-4c3e-885b-c37dd13acfb6 None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:26:39.887569 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-0b538a7f-9fb3-4c3e-885b-c37dd13acfb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:26:39.897535 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 765/1541] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 12:26:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 12:26:39.902183 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fddc0e2-0301-465e-82ab-d959462c0d37 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:26:39.915371 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fddc0e2-0301-465e-82ab-d959462c0d37 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:26:39.924782 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2243944-443b-4e9e-b9ac-4e8a6605bbce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:26:39.925137 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2243944-443b-4e9e-b9ac-4e8a6605bbce admin admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:26:39.925855 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2243944-443b-4e9e-b9ac-4e8a6605bbce admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:26:39.925855 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2243944-443b-4e9e-b9ac-4e8a6605bbce admin admin] PATH_INFO: `/v3/domains` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:26:39.926421 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2243944-443b-4e9e-b9ac-4e8a6605bbce admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:26:39.926729 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2243944-443b-4e9e-b9ac-4e8a6605bbce admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:26:39.928361 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2243944-443b-4e9e-b9ac-4e8a6605bbce admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:26:39.949129 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 777/1542] 10.222.0.44 () {58 vars in 1152 bytes} [Thu Jun 16 12:26:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:26:39.955258 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b538a7f-9fb3-4c3e-885b-c37dd13acfb6 None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:26:39.974032 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b538a7f-9fb3-4c3e-885b-c37dd13acfb6 None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:26:39.982416 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f787ef73-6f8d-4868-adce-5c8cd98b991e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:26:39.983095 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f787ef73-6f8d-4868-adce-5c8cd98b991e admin admin] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:26:39.983377 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f787ef73-6f8d-4868-adce-5c8cd98b991e admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:26:39.983650 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f787ef73-6f8d-4868-adce-5c8cd98b991e admin admin] PATH_INFO: `/v3/projects` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:26:39.988176 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f787ef73-6f8d-4868-adce-5c8cd98b991e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:26:39.990354 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f787ef73-6f8d-4868-adce-5c8cd98b991e admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:26:40.043971 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 766/1543] 10.222.0.44 () {60 vars in 1152 bytes} [Thu Jun 16 12:26:39 2022] POST /identity/v3/projects => generated 393 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 12:26:40.048146 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2243944-443b-4e9e-b9ac-4e8a6605bbce admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:26:40.069148 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2243944-443b-4e9e-b9ac-4e8a6605bbce admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:26:40.106737 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c327bd-ed58-4e7b-9345-504e3eab4889 None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:26:40.107123 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c327bd-ed58-4e7b-9345-504e3eab4889 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:26:40.108028 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c327bd-ed58-4e7b-9345-504e3eab4889 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:26:40.145532 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-90c327bd-ed58-4e7b-9345-504e3eab4889 None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:26:40.147378 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-90c327bd-ed58-4e7b-9345-504e3eab4889 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:26:40.168498 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7f9b68-9c10-4f7a-8822-12351c229471 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:26:40.169210 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7f9b68-9c10-4f7a-8822-12351c229471 admin admin] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:26:40.169494 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7f9b68-9c10-4f7a-8822-12351c229471 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:26:40.169770 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7f9b68-9c10-4f7a-8822-12351c229471 admin admin] PATH_INFO: `/v3/users` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:26:40.170469 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7f9b68-9c10-4f7a-8822-12351c229471 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:26:40.172897 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7f9b68-9c10-4f7a-8822-12351c229471 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:26:40.218627 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 778/1544] 10.222.0.44 () {60 vars in 1143 bytes} [Thu Jun 16 12:26:40 2022] POST /identity/v3/users => generated 297 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 12:26:40.234636 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7f9b68-9c10-4f7a-8822-12351c229471 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:26:40.251503 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 767/1545] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 12:26:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 12:26:40.261546 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7f9b68-9c10-4f7a-8822-12351c229471 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:26:40.269496 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cf941b-1d98-43e4-8d19-3f53dfb9a1b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:26:40.270197 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cf941b-1d98-43e4-8d19-3f53dfb9a1b3 admin admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:26:40.270478 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cf941b-1d98-43e4-8d19-3f53dfb9a1b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:26:40.270748 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cf941b-1d98-43e4-8d19-3f53dfb9a1b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:26:40.271494 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cf941b-1d98-43e4-8d19-3f53dfb9a1b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:26:40.273207 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cf941b-1d98-43e4-8d19-3f53dfb9a1b3 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:26:40.278566 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b490891-baba-4f89-a4dd-a9497c947b9e None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:26:40.278909 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b490891-baba-4f89-a4dd-a9497c947b9e None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:26:40.279123 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b490891-baba-4f89-a4dd-a9497c947b9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:26:40.310972 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 779/1546] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 12:26:40 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 12:26:40.311791 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cf941b-1d98-43e4-8d19-3f53dfb9a1b3 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:26:40.313184 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-6b490891-baba-4f89-a4dd-a9497c947b9e None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:26:40.314399 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-6b490891-baba-4f89-a4dd-a9497c947b9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:26:40.328964 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cf941b-1d98-43e4-8d19-3f53dfb9a1b3 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:26:40.339274 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 768/1547] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 12:26:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Jun 16 12:26:40.342163 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278c54d2-59b2-4f9e-9baf-e6d8c616e0e1 None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:26:40.343103 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278c54d2-59b2-4f9e-9baf-e6d8c616e0e1 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:26:40.344947 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7c7982-a2ac-4f60-bb57-6e7776ede792 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:26:40.345579 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278c54d2-59b2-4f9e-9baf-e6d8c616e0e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:26:40.346515 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7c7982-a2ac-4f60-bb57-6e7776ede792 admin admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:26:40.348878 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7c7982-a2ac-4f60-bb57-6e7776ede792 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:26:40.349443 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7c7982-a2ac-4f60-bb57-6e7776ede792 admin admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:26:40.350456 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7c7982-a2ac-4f60-bb57-6e7776ede792 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:26:40.352866 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7c7982-a2ac-4f60-bb57-6e7776ede792 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:26:40.373549 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 780/1548] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 12:26:40 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 12:26:40.373769 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7c7982-a2ac-4f60-bb57-6e7776ede792 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:26:40.385987 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-278c54d2-59b2-4f9e-9baf-e6d8c616e0e1 None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:26:40.387635 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-278c54d2-59b2-4f9e-9baf-e6d8c616e0e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:26:40.391449 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7c7982-a2ac-4f60-bb57-6e7776ede792 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:26:40.404208 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8919a1a7-90e9-4931-8c7a-67bf78b58a0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:26:40.406296 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 769/1549] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 12:26:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:26:40.407526 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278c54d2-59b2-4f9e-9baf-e6d8c616e0e1 None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:26:40.410548 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8919a1a7-90e9-4931-8c7a-67bf78b58a0c admin admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:26:40.410870 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8919a1a7-90e9-4931-8c7a-67bf78b58a0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:26:40.411150 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8919a1a7-90e9-4931-8c7a-67bf78b58a0c admin admin] PATH_INFO: `/v3/domains` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:26:40.412187 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8919a1a7-90e9-4931-8c7a-67bf78b58a0c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:26:40.412490 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8919a1a7-90e9-4931-8c7a-67bf78b58a0c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:26:40.416792 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8919a1a7-90e9-4931-8c7a-67bf78b58a0c admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:26:40.432124 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278c54d2-59b2-4f9e-9baf-e6d8c616e0e1 None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:26:40.440799 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 781/1550] 10.222.0.44 () {58 vars in 1152 bytes} [Thu Jun 16 12:26:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:26:40.442322 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede91eb6-6b36-404e-935c-cabcf45b6915 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:26:40.442613 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede91eb6-6b36-404e-935c-cabcf45b6915 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:26:40.442895 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede91eb6-6b36-404e-935c-cabcf45b6915 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:26:40.445008 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476fa19b-0083-4f0c-9a0a-0769f006450c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:26:40.445943 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476fa19b-0083-4f0c-9a0a-0769f006450c admin admin] REQUEST_METHOD: `PUT` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:26:40.446228 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476fa19b-0083-4f0c-9a0a-0769f006450c admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:26:40.447069 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476fa19b-0083-4f0c-9a0a-0769f006450c admin admin] PATH_INFO: `/v3/projects/fc803b34925d4a9aa0c3f92780976def/users/93da8714f87144e6a75e3bd076ebeab6/roles/c39882b202e942479a7cdac2fc6da72c` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:26:40.482794 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-ede91eb6-6b36-404e-935c-cabcf45b6915 None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:26:40.484224 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-ede91eb6-6b36-404e-935c-cabcf45b6915 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:26:40.486071 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476fa19b-0083-4f0c-9a0a-0769f006450c admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc803b34925d4a9aa0c3f92780976def, user_id=93da8714f87144e6a75e3bd076ebeab6, role_id=c39882b202e942479a7cdac2fc6da72c)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:26:40.488874 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476fa19b-0083-4f0c-9a0a-0769f006450c admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:26:40.501231 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 782/1551] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 12:26:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:26:40.502547 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24977c3-1086-44da-8aea-81e0fdcea1dc None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:26:40.502840 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24977c3-1086-44da-8aea-81e0fdcea1dc None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:26:40.503104 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24977c3-1086-44da-8aea-81e0fdcea1dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:26:40.518380 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 770/1552] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 16 12:26:40 2022] PUT /identity/v3/projects/fc803b34925d4a9aa0c3f92780976def/users/93da8714f87144e6a75e3bd076ebeab6/roles/c39882b202e942479a7cdac2fc6da72c => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:26:40.519185 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476fa19b-0083-4f0c-9a0a-0769f006450c admin admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:26:40.541814 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-d24977c3-1086-44da-8aea-81e0fdcea1dc None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:26:40.543025 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-d24977c3-1086-44da-8aea-81e0fdcea1dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:26:40.611104 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476fa19b-0083-4f0c-9a0a-0769f006450c admin admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:26:40.615669 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2cb28d-28d2-4c10-8c53-ba53ce4e213a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:26:40.616328 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2cb28d-28d2-4c10-8c53-ba53ce4e213a admin admin] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:26:40.616612 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2cb28d-28d2-4c10-8c53-ba53ce4e213a admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:26:40.616918 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2cb28d-28d2-4c10-8c53-ba53ce4e213a admin admin] PATH_INFO: `/v3/projects` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:26:40.617787 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2cb28d-28d2-4c10-8c53-ba53ce4e213a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:26:40.620244 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2cb28d-28d2-4c10-8c53-ba53ce4e213a admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:26:40.632508 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 783/1553] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 12:26:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:26:40.633856 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d534276f-cf87-419c-9e8f-b81b71b8edaa None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:26:40.635011 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d534276f-cf87-419c-9e8f-b81b71b8edaa None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:26:40.635144 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d534276f-cf87-419c-9e8f-b81b71b8edaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:26:40.647771 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 771/1554] 10.222.0.44 () {60 vars in 1152 bytes} [Thu Jun 16 12:26:40 2022] POST /identity/v3/projects => generated 371 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 12:26:40.648599 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2cb28d-28d2-4c10-8c53-ba53ce4e213a admin admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:26:40.655829 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-d534276f-cf87-419c-9e8f-b81b71b8edaa None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:26:40.657067 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-d534276f-cf87-419c-9e8f-b81b71b8edaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:26:40.672187 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:26:40.681551 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:26:40.717546 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2cb28d-28d2-4c10-8c53-ba53ce4e213a admin admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:26:40.718327 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 784/1555] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 12:26:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:26:40.719602 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8237c8b-1d3c-412c-897f-0f06838a0605 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:26:40.719894 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8237c8b-1d3c-412c-897f-0f06838a0605 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:26:40.720169 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8237c8b-1d3c-412c-897f-0f06838a0605 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:26:40.728172 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2a0811-24ed-4162-a92a-3577219adb89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:26:40.728871 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2a0811-24ed-4162-a92a-3577219adb89 admin admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:26:40.729151 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2a0811-24ed-4162-a92a-3577219adb89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:26:40.729428 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2a0811-24ed-4162-a92a-3577219adb89 admin admin] PATH_INFO: `/v3/domains` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:26:40.730162 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2a0811-24ed-4162-a92a-3577219adb89 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:26:40.730463 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2a0811-24ed-4162-a92a-3577219adb89 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:26:40.731482 dv-cinder-846149-2-smb devstack@keystone.service[80075]: WARNING py.warnings [None req-ce2a0811-24ed-4162-a92a-3577219adb89 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 12:26:40.731482 dv-cinder-846149-2-smb devstack@keystone.service[80075]: warnings.warn(msg) Jun 16 12:26:40.731482 dv-cinder-846149-2-smb devstack@keystone.service[80075]: Jun 16 12:26:40.732462 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2a0811-24ed-4162-a92a-3577219adb89 admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:26:40.740309 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-a8237c8b-1d3c-412c-897f-0f06838a0605 None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:26:40.741670 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-a8237c8b-1d3c-412c-897f-0f06838a0605 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:26:40.744661 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 772/1556] 10.222.0.44 () {58 vars in 1152 bytes} [Thu Jun 16 12:26:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:26:40.745920 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa82b32d-720c-4bd0-9eea-593deb6aadf5 None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:26:40.746200 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa82b32d-720c-4bd0-9eea-593deb6aadf5 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:26:40.746489 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa82b32d-720c-4bd0-9eea-593deb6aadf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:26:40.753699 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 785/1557] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 12:26:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:26:40.753699 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53728755-e43d-434b-be6f-4b3b3fdc20c0 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:26:40.753699 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53728755-e43d-434b-be6f-4b3b3fdc20c0 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:26:40.753699 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53728755-e43d-434b-be6f-4b3b3fdc20c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:26:40.768886 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-aa82b32d-720c-4bd0-9eea-593deb6aadf5 None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:26:40.770124 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-aa82b32d-720c-4bd0-9eea-593deb6aadf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:26:40.770636 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-53728755-e43d-434b-be6f-4b3b3fdc20c0 None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:26:40.771801 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-53728755-e43d-434b-be6f-4b3b3fdc20c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:26:40.778126 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 773/1558] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 12:26:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:26:40.779406 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adad8caa-3659-43b9-afde-be03c3afa22a None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:26:40.786857 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adad8caa-3659-43b9-afde-be03c3afa22a None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:26:40.787019 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 786/1559] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 12:26:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:26:40.787127 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adad8caa-3659-43b9-afde-be03c3afa22a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:26:40.787207 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186f2ab0-10ac-47db-9e6b-9a2a8e347801 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:26:40.787207 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186f2ab0-10ac-47db-9e6b-9a2a8e347801 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:26:40.787207 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186f2ab0-10ac-47db-9e6b-9a2a8e347801 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:26:40.804514 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-adad8caa-3659-43b9-afde-be03c3afa22a None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:26:40.804781 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-186f2ab0-10ac-47db-9e6b-9a2a8e347801 None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:26:40.806447 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-186f2ab0-10ac-47db-9e6b-9a2a8e347801 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:26:40.806572 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-adad8caa-3659-43b9-afde-be03c3afa22a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:26:40.814258 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 774/1560] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 12:26:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:26:40.814370 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 787/1561] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 12:26:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:26:40.815320 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adad8caa-3659-43b9-afde-be03c3afa22a None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:26:40.816069 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa62357-5935-4795-8e11-9c2f7ca4e275 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:26:40.816356 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa62357-5935-4795-8e11-9c2f7ca4e275 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:26:40.816632 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa62357-5935-4795-8e11-9c2f7ca4e275 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:26:40.825381 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adad8caa-3659-43b9-afde-be03c3afa22a None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:26:40.830831 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f740c164-e37f-47a6-81b9-6d32da85b98b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:26:40.831497 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f740c164-e37f-47a6-81b9-6d32da85b98b admin admin] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:26:40.831781 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f740c164-e37f-47a6-81b9-6d32da85b98b admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:26:40.832056 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f740c164-e37f-47a6-81b9-6d32da85b98b admin admin] PATH_INFO: `/v3/users` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:26:40.832759 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f740c164-e37f-47a6-81b9-6d32da85b98b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:26:40.833825 dv-cinder-846149-2-smb devstack@keystone.service[80075]: WARNING py.warnings [None req-f740c164-e37f-47a6-81b9-6d32da85b98b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 16 12:26:40.833825 dv-cinder-846149-2-smb devstack@keystone.service[80075]: warnings.warn(msg) Jun 16 12:26:40.833825 dv-cinder-846149-2-smb devstack@keystone.service[80075]: Jun 16 12:26:40.835162 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f740c164-e37f-47a6-81b9-6d32da85b98b admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:26:40.839626 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-7aa62357-5935-4795-8e11-9c2f7ca4e275 None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:26:40.840875 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-7aa62357-5935-4795-8e11-9c2f7ca4e275 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:26:40.851906 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 788/1562] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 12:26:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:26:40.853312 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa62357-5935-4795-8e11-9c2f7ca4e275 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:26:40.859496 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 775/1563] 10.222.0.44 () {60 vars in 1143 bytes} [Thu Jun 16 12:26:40 2022] POST /identity/v3/users => generated 286 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 12:26:40.860939 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f740c164-e37f-47a6-81b9-6d32da85b98b admin admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:26:40.864937 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa62357-5935-4795-8e11-9c2f7ca4e275 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:26:40.870246 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5223ed58-5c93-4dd6-9e78-6de9bd78cde2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:26:40.870974 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5223ed58-5c93-4dd6-9e78-6de9bd78cde2 admin admin] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:26:40.871303 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5223ed58-5c93-4dd6-9e78-6de9bd78cde2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:26:40.871582 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5223ed58-5c93-4dd6-9e78-6de9bd78cde2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:26:40.872274 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5223ed58-5c93-4dd6-9e78-6de9bd78cde2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:26:40.873327 dv-cinder-846149-2-smb devstack@keystone.service[80076]: WARNING py.warnings [None req-5223ed58-5c93-4dd6-9e78-6de9bd78cde2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 16 12:26:40.873327 dv-cinder-846149-2-smb devstack@keystone.service[80076]: warnings.warn(msg) Jun 16 12:26:40.873327 dv-cinder-846149-2-smb devstack@keystone.service[80076]: Jun 16 12:26:40.874586 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5223ed58-5c93-4dd6-9e78-6de9bd78cde2 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:26:40.900502 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 789/1564] 10.222.0.44 () {60 vars in 1152 bytes} [Thu Jun 16 12:26:40 2022] POST /identity/v3/projects => generated 357 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 12:26:40.901869 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064e6ab7-9a7e-4583-9858-09fc3c1cf84a None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:26:40.902170 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064e6ab7-9a7e-4583-9858-09fc3c1cf84a None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:26:40.902446 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064e6ab7-9a7e-4583-9858-09fc3c1cf84a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:26:40.920616 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-064e6ab7-9a7e-4583-9858-09fc3c1cf84a None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:26:40.920941 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f740c164-e37f-47a6-81b9-6d32da85b98b admin admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:26:40.921871 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-064e6ab7-9a7e-4583-9858-09fc3c1cf84a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:26:40.976886 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e209c6-c160-4319-b137-fa4bd10b4f93 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1094729b25a4be7b0b394998c9ca681', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '601361df39e34fcca71175aa94e425c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:26:40.978175 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e209c6-c160-4319-b137-fa4bd10b4f93 service neutron] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:26:40.978480 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e209c6-c160-4319-b137-fa4bd10b4f93 service neutron] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:26:40.978791 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e209c6-c160-4319-b137-fa4bd10b4f93 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:26:40.985549 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 790/1565] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 12:26:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:26:40.986866 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1b0eb9-2bb0-410d-b7c1-e55e5d97c803 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:26:40.987153 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1b0eb9-2bb0-410d-b7c1-e55e5d97c803 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:26:40.987429 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1b0eb9-2bb0-410d-b7c1-e55e5d97c803 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:26:40.991651 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e209c6-c160-4319-b137-fa4bd10b4f93 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:26:40.993128 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e209c6-c160-4319-b137-fa4bd10b4f93 service neutron] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:26:41.003528 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 776/1566] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 12:26:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 12:26:41.004326 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e209c6-c160-4319-b137-fa4bd10b4f93 service neutron] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:26:41.006561 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-2c1b0eb9-2bb0-410d-b7c1-e55e5d97c803 None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:26:41.007883 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-2c1b0eb9-2bb0-410d-b7c1-e55e5d97c803 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:26:41.013340 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e209c6-c160-4319-b137-fa4bd10b4f93 service neutron] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:26:41.019846 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 791/1567] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 12:26:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:26:41.019846 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908a8dd4-6cf4-4153-84b0-9a36e2faabaa None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:26:41.019846 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908a8dd4-6cf4-4153-84b0-9a36e2faabaa None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:26:41.019846 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908a8dd4-6cf4-4153-84b0-9a36e2faabaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:26:41.022139 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ffe0cd-ae07-4405-be71-75fbd3b2ff85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:26:41.022801 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ffe0cd-ae07-4405-be71-75fbd3b2ff85 admin admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:26:41.023086 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ffe0cd-ae07-4405-be71-75fbd3b2ff85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:26:41.023362 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ffe0cd-ae07-4405-be71-75fbd3b2ff85 admin admin] PATH_INFO: `/v3/domains` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:26:41.024311 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ffe0cd-ae07-4405-be71-75fbd3b2ff85 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:26:41.024419 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ffe0cd-ae07-4405-be71-75fbd3b2ff85 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:26:41.026076 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ffe0cd-ae07-4405-be71-75fbd3b2ff85 admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:26:41.038671 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-908a8dd4-6cf4-4153-84b0-9a36e2faabaa None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:26:41.039953 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-908a8dd4-6cf4-4153-84b0-9a36e2faabaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:26:41.044573 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 777/1568] 10.222.0.44 () {58 vars in 1152 bytes} [Thu Jun 16 12:26:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:26:41.046157 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ffe0cd-ae07-4405-be71-75fbd3b2ff85 admin admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:26:41.058237 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 792/1569] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 12:26:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:26:41.059875 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908a8dd4-6cf4-4153-84b0-9a36e2faabaa None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:26:41.062988 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ffe0cd-ae07-4405-be71-75fbd3b2ff85 admin admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:26:41.069756 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdda411-072f-4823-8bcf-f7ef2d938ac2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:26:41.070457 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdda411-072f-4823-8bcf-f7ef2d938ac2 admin admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:26:41.070754 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdda411-072f-4823-8bcf-f7ef2d938ac2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:26:41.070980 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908a8dd4-6cf4-4153-84b0-9a36e2faabaa None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:26:41.071211 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdda411-072f-4823-8bcf-f7ef2d938ac2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:26:41.071998 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bdda411-072f-4823-8bcf-f7ef2d938ac2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:26:41.072316 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bdda411-072f-4823-8bcf-f7ef2d938ac2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:26:41.074409 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bdda411-072f-4823-8bcf-f7ef2d938ac2 admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:26:41.076197 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62c683f-a616-40ca-9366-9683824d60a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:26:41.077145 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62c683f-a616-40ca-9366-9683824d60a9 admin admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:26:41.078144 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62c683f-a616-40ca-9366-9683824d60a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:26:41.078449 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62c683f-a616-40ca-9366-9683824d60a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:26:41.079160 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62c683f-a616-40ca-9366-9683824d60a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:26:41.089089 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62c683f-a616-40ca-9366-9683824d60a9 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:26:41.096560 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 778/1570] 10.222.0.44 () {58 vars in 1152 bytes} [Thu Jun 16 12:26:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:26:41.097529 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdda411-072f-4823-8bcf-f7ef2d938ac2 admin admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:26:41.102152 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 793/1571] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 12:26:41 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 12:26:41.104047 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62c683f-a616-40ca-9366-9683824d60a9 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:26:41.110662 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdda411-072f-4823-8bcf-f7ef2d938ac2 admin admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:26:41.115325 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62c683f-a616-40ca-9366-9683824d60a9 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:26:41.116095 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7eebc52-0a55-4b12-baad-85c57f899dc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:26:41.116786 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7eebc52-0a55-4b12-baad-85c57f899dc5 admin admin] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:26:41.117406 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7eebc52-0a55-4b12-baad-85c57f899dc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:26:41.117406 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7eebc52-0a55-4b12-baad-85c57f899dc5 admin admin] PATH_INFO: `/v3/users` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:26:41.118030 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7eebc52-0a55-4b12-baad-85c57f899dc5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:26:41.120085 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7eebc52-0a55-4b12-baad-85c57f899dc5 admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:26:41.120695 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cf4b6e-34bc-4af2-9023-dfc735380e69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:26:41.121475 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cf4b6e-34bc-4af2-9023-dfc735380e69 admin admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:26:41.121940 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cf4b6e-34bc-4af2-9023-dfc735380e69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:26:41.122334 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cf4b6e-34bc-4af2-9023-dfc735380e69 admin admin] PATH_INFO: `/v3/domains` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:26:41.123132 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48cf4b6e-34bc-4af2-9023-dfc735380e69 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:26:41.123500 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48cf4b6e-34bc-4af2-9023-dfc735380e69 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:26:41.125275 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48cf4b6e-34bc-4af2-9023-dfc735380e69 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:26:41.136146 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:26:41.141181 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 794/1572] 10.222.0.44 () {58 vars in 1152 bytes} [Thu Jun 16 12:26:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:26:41.142297 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cf4b6e-34bc-4af2-9023-dfc735380e69 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:26:41.149452 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 779/1573] 10.222.0.44 () {60 vars in 1143 bytes} [Thu Jun 16 12:26:41 2022] POST /identity/v3/users => generated 279 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 12:26:41.153699 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7eebc52-0a55-4b12-baad-85c57f899dc5 admin admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:26:41.157882 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cf4b6e-34bc-4af2-9023-dfc735380e69 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:26:41.163399 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40db6b6e-4b79-457a-8d92-8006cd9ab8a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:26:41.164431 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40db6b6e-4b79-457a-8d92-8006cd9ab8a0 admin admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:26:41.164911 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40db6b6e-4b79-457a-8d92-8006cd9ab8a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:26:41.165909 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40db6b6e-4b79-457a-8d92-8006cd9ab8a0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:26:41.166789 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40db6b6e-4b79-457a-8d92-8006cd9ab8a0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:26:41.167235 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40db6b6e-4b79-457a-8d92-8006cd9ab8a0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:26:41.167768 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7eebc52-0a55-4b12-baad-85c57f899dc5 admin admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:26:41.169315 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40db6b6e-4b79-457a-8d92-8006cd9ab8a0 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:26:41.172845 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4aa4990-51c1-46ef-be58-a0d22ea7c6b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:26:41.173419 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4aa4990-51c1-46ef-be58-a0d22ea7c6b4 admin admin] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:26:41.173703 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4aa4990-51c1-46ef-be58-a0d22ea7c6b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:26:41.173980 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4aa4990-51c1-46ef-be58-a0d22ea7c6b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:26:41.174814 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4aa4990-51c1-46ef-be58-a0d22ea7c6b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:26:41.177088 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4aa4990-51c1-46ef-be58-a0d22ea7c6b4 admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:26:41.184596 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 795/1574] 10.222.0.44 () {58 vars in 1152 bytes} [Thu Jun 16 12:26:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:26:41.185629 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40db6b6e-4b79-457a-8d92-8006cd9ab8a0 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:26:41.206545 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40db6b6e-4b79-457a-8d92-8006cd9ab8a0 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:26:41.213762 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30ee77e-892d-4cb6-87f9-4a23fa8ea15c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:26:41.214548 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30ee77e-892d-4cb6-87f9-4a23fa8ea15c admin admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:26:41.214838 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30ee77e-892d-4cb6-87f9-4a23fa8ea15c admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:26:41.215245 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30ee77e-892d-4cb6-87f9-4a23fa8ea15c admin admin] PATH_INFO: `/v3/domains` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:26:41.216031 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30ee77e-892d-4cb6-87f9-4a23fa8ea15c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:26:41.216338 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30ee77e-892d-4cb6-87f9-4a23fa8ea15c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:26:41.218046 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30ee77e-892d-4cb6-87f9-4a23fa8ea15c admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:26:41.222755 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 780/1575] 10.222.0.44 () {60 vars in 1152 bytes} [Thu Jun 16 12:26:41 2022] POST /identity/v3/projects => generated 377 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 12:26:41.227464 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4aa4990-51c1-46ef-be58-a0d22ea7c6b4 admin admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:26:41.234051 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 796/1576] 10.222.0.44 () {58 vars in 1152 bytes} [Thu Jun 16 12:26:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:26:41.235361 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30ee77e-892d-4cb6-87f9-4a23fa8ea15c admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:26:41.247526 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30ee77e-892d-4cb6-87f9-4a23fa8ea15c admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:26:41.261493 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:26:41.310146 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4aa4990-51c1-46ef-be58-a0d22ea7c6b4 admin admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:26:41.314716 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526d3dea-f2a2-4376-b4f2-283f6cf9911f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:26:41.315376 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526d3dea-f2a2-4376-b4f2-283f6cf9911f admin admin] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:26:41.315509 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98c9c54-4f08-4acb-b888-442d31227067 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:26:41.315675 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526d3dea-f2a2-4376-b4f2-283f6cf9911f admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:26:41.315956 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526d3dea-f2a2-4376-b4f2-283f6cf9911f admin admin] PATH_INFO: `/v3/projects` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:26:41.316550 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98c9c54-4f08-4acb-b888-442d31227067 admin admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:26:41.316674 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526d3dea-f2a2-4376-b4f2-283f6cf9911f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:26:41.317022 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98c9c54-4f08-4acb-b888-442d31227067 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:26:41.317385 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98c9c54-4f08-4acb-b888-442d31227067 admin admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:26:41.318229 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98c9c54-4f08-4acb-b888-442d31227067 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:26:41.318570 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526d3dea-f2a2-4376-b4f2-283f6cf9911f admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:26:41.320040 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98c9c54-4f08-4acb-b888-442d31227067 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:26:41.345152 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 797/1577] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 12:26:41 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 12:26:41.346173 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98c9c54-4f08-4acb-b888-442d31227067 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:26:41.359313 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98c9c54-4f08-4acb-b888-442d31227067 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:26:41.359962 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 781/1578] 10.222.0.44 () {60 vars in 1152 bytes} [Thu Jun 16 12:26:41 2022] POST /identity/v3/projects => generated 373 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 12:26:41.361796 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526d3dea-f2a2-4376-b4f2-283f6cf9911f admin admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:26:41.424635 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ce20ff-0646-433f-8b86-050a40a4e063 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:26:41.425495 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ce20ff-0646-433f-8b86-050a40a4e063 admin admin] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:26:41.425869 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ce20ff-0646-433f-8b86-050a40a4e063 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:26:41.426241 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ce20ff-0646-433f-8b86-050a40a4e063 admin admin] PATH_INFO: `/v3/projects` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:26:41.427046 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ce20ff-0646-433f-8b86-050a40a4e063 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:26:41.429127 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ce20ff-0646-433f-8b86-050a40a4e063 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:26:41.445731 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526d3dea-f2a2-4376-b4f2-283f6cf9911f admin admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:26:41.452407 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09591d0e-690c-4eb5-a2b1-f8f7e87f1a64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:26:41.453264 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09591d0e-690c-4eb5-a2b1-f8f7e87f1a64 admin admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:26:41.453552 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09591d0e-690c-4eb5-a2b1-f8f7e87f1a64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:26:41.453836 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09591d0e-690c-4eb5-a2b1-f8f7e87f1a64 admin admin] PATH_INFO: `/v3/roles` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:26:41.454556 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09591d0e-690c-4eb5-a2b1-f8f7e87f1a64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:26:41.456240 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09591d0e-690c-4eb5-a2b1-f8f7e87f1a64 admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:26:41.458589 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 798/1579] 10.222.0.44 () {60 vars in 1152 bytes} [Thu Jun 16 12:26:41 2022] POST /identity/v3/projects => generated 385 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 12:26:41.459479 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ce20ff-0646-433f-8b86-050a40a4e063 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:26:41.467921 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 782/1580] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 12:26:41 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 12:26:41.468961 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09591d0e-690c-4eb5-a2b1-f8f7e87f1a64 admin admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:26:41.480741 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09591d0e-690c-4eb5-a2b1-f8f7e87f1a64 admin admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:26:41.536821 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ce20ff-0646-433f-8b86-050a40a4e063 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:26:41.539379 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:26:41.543307 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c09a2c6-1581-47cf-8b27-39ebef07a96b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:26:41.544215 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c09a2c6-1581-47cf-8b27-39ebef07a96b admin admin] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:26:41.545248 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c09a2c6-1581-47cf-8b27-39ebef07a96b admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:26:41.545248 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c09a2c6-1581-47cf-8b27-39ebef07a96b admin admin] PATH_INFO: `/v3/projects` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:26:41.545825 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c09a2c6-1581-47cf-8b27-39ebef07a96b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:26:41.547837 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c09a2c6-1581-47cf-8b27-39ebef07a96b admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:26:41.549338 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1471082e-4a36-4820-b556-df93395fc73c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:26:41.550122 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1471082e-4a36-4820-b556-df93395fc73c admin admin] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:26:41.550479 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1471082e-4a36-4820-b556-df93395fc73c admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:26:41.550824 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1471082e-4a36-4820-b556-df93395fc73c admin admin] PATH_INFO: `/v3/users` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:26:41.551813 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1471082e-4a36-4820-b556-df93395fc73c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:26:41.554236 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1471082e-4a36-4820-b556-df93395fc73c admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:26:41.580570 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 799/1581] 10.222.0.44 () {60 vars in 1152 bytes} [Thu Jun 16 12:26:41 2022] POST /identity/v3/projects => generated 367 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 12:26:41.580570 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c09a2c6-1581-47cf-8b27-39ebef07a96b admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:26:41.581222 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 783/1582] 10.222.0.44 () {60 vars in 1143 bytes} [Thu Jun 16 12:26:41 2022] POST /identity/v3/users => generated 289 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 12:26:41.581222 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1471082e-4a36-4820-b556-df93395fc73c admin admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:26:41.591550 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1471082e-4a36-4820-b556-df93395fc73c admin admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:26:41.611973 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:26:41.652482 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c09a2c6-1581-47cf-8b27-39ebef07a96b admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:26:41.657191 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dbd717-bd2b-4c27-b8f5-8bfd91966498 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:26:41.657857 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dbd717-bd2b-4c27-b8f5-8bfd91966498 admin admin] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:26:41.658141 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dbd717-bd2b-4c27-b8f5-8bfd91966498 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:26:41.658416 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dbd717-bd2b-4c27-b8f5-8bfd91966498 admin admin] PATH_INFO: `/v3/projects` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:26:41.659109 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87dbd717-bd2b-4c27-b8f5-8bfd91966498 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:26:41.661061 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87dbd717-bd2b-4c27-b8f5-8bfd91966498 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:26:41.669496 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6015a0-18b3-4fed-b253-eb1674e43556 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:26:41.671305 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6015a0-18b3-4fed-b253-eb1674e43556 admin admin] REQUEST_METHOD: `PUT` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:26:41.672230 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6015a0-18b3-4fed-b253-eb1674e43556 admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:26:41.672699 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6015a0-18b3-4fed-b253-eb1674e43556 admin admin] PATH_INFO: `/v3/projects/bbb61152d18b49139ff00a55160e7d58/users/60bb8a52c96e4dcca085aabaf901f655/roles/c39882b202e942479a7cdac2fc6da72c` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:26:41.698035 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 800/1583] 10.222.0.44 () {60 vars in 1152 bytes} [Thu Jun 16 12:26:41 2022] POST /identity/v3/projects => generated 385 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 12:26:41.698035 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dbd717-bd2b-4c27-b8f5-8bfd91966498 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:26:41.699439 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6015a0-18b3-4fed-b253-eb1674e43556 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bbb61152d18b49139ff00a55160e7d58, user_id=60bb8a52c96e4dcca085aabaf901f655, role_id=c39882b202e942479a7cdac2fc6da72c)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:26:41.702513 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6015a0-18b3-4fed-b253-eb1674e43556 admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:26:41.721456 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 784/1584] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 16 12:26:41 2022] PUT /identity/v3/projects/bbb61152d18b49139ff00a55160e7d58/users/60bb8a52c96e4dcca085aabaf901f655/roles/c39882b202e942479a7cdac2fc6da72c => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:26:41.722620 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6015a0-18b3-4fed-b253-eb1674e43556 admin admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:26:41.795635 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dbd717-bd2b-4c27-b8f5-8bfd91966498 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:26:41.812764 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6015a0-18b3-4fed-b253-eb1674e43556 admin admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:26:41.820957 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcfabfd-d0be-43a8-b38f-d30baf881c4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:26:41.821726 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcfabfd-d0be-43a8-b38f-d30baf881c4d admin admin] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:26:41.822015 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcfabfd-d0be-43a8-b38f-d30baf881c4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:26:41.822989 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcfabfd-d0be-43a8-b38f-d30baf881c4d admin admin] PATH_INFO: `/v3/users` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:26:41.823710 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcfabfd-d0be-43a8-b38f-d30baf881c4d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:26:41.827528 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcfabfd-d0be-43a8-b38f-d30baf881c4d admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:26:41.859918 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 785/1585] 10.222.0.44 () {60 vars in 1143 bytes} [Thu Jun 16 12:26:41 2022] POST /identity/v3/users => generated 293 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 12:26:41.860858 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcfabfd-d0be-43a8-b38f-d30baf881c4d admin admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:26:41.868426 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b86c07a-f575-45a9-8c28-30d80f6e7bea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:26:41.869457 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b86c07a-f575-45a9-8c28-30d80f6e7bea admin admin] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:26:41.869816 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b86c07a-f575-45a9-8c28-30d80f6e7bea admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:26:41.870232 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b86c07a-f575-45a9-8c28-30d80f6e7bea admin admin] PATH_INFO: `/v3/users` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:26:41.870988 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b86c07a-f575-45a9-8c28-30d80f6e7bea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:26:41.873312 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b86c07a-f575-45a9-8c28-30d80f6e7bea admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:26:41.876528 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcfabfd-d0be-43a8-b38f-d30baf881c4d admin admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:26:41.881888 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cf53f9-a709-41ae-b956-6521427e55c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:26:41.883629 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cf53f9-a709-41ae-b956-6521427e55c7 admin admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:26:41.884232 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cf53f9-a709-41ae-b956-6521427e55c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:26:41.884905 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cf53f9-a709-41ae-b956-6521427e55c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:26:41.885956 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49cf53f9-a709-41ae-b956-6521427e55c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:26:41.888172 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49cf53f9-a709-41ae-b956-6521427e55c7 admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:26:41.899356 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 786/1586] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 12:26:41 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 12:26:41.900560 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cf53f9-a709-41ae-b956-6521427e55c7 admin admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:26:41.901876 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 801/1587] 10.222.0.44 () {60 vars in 1143 bytes} [Thu Jun 16 12:26:41 2022] POST /identity/v3/users => generated 287 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 12:26:41.903157 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b86c07a-f575-45a9-8c28-30d80f6e7bea admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:26:41.917562 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cf53f9-a709-41ae-b956-6521427e55c7 admin admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:26:41.918063 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b86c07a-f575-45a9-8c28-30d80f6e7bea admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:26:41.927052 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f1b89d-6346-4e60-9826-b3d1cf288cee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:26:41.927735 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f1b89d-6346-4e60-9826-b3d1cf288cee admin admin] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:26:41.928019 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f1b89d-6346-4e60-9826-b3d1cf288cee admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:26:41.928295 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f1b89d-6346-4e60-9826-b3d1cf288cee admin admin] PATH_INFO: `/v3/users` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:26:41.928857 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5756dc-e427-4137-b08f-53b7316f54f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:26:41.929038 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f1b89d-6346-4e60-9826-b3d1cf288cee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:26:41.929905 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5756dc-e427-4137-b08f-53b7316f54f3 admin admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:26:41.930347 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5756dc-e427-4137-b08f-53b7316f54f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:26:41.930881 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5756dc-e427-4137-b08f-53b7316f54f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:26:41.931299 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f1b89d-6346-4e60-9826-b3d1cf288cee admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:26:41.935226 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5756dc-e427-4137-b08f-53b7316f54f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:26:41.938430 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5756dc-e427-4137-b08f-53b7316f54f3 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:26:41.954851 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 802/1588] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 12:26:41 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 12:26:41.955699 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5756dc-e427-4137-b08f-53b7316f54f3 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:26:41.964804 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 787/1589] 10.222.0.44 () {60 vars in 1143 bytes} [Thu Jun 16 12:26:41 2022] POST /identity/v3/users => generated 284 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 12:26:41.966475 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cceff875-9cf3-4386-82bf-d32dfeb22966 None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:26:41.966931 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cceff875-9cf3-4386-82bf-d32dfeb22966 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:26:41.967351 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cceff875-9cf3-4386-82bf-d32dfeb22966 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:26:41.968073 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5756dc-e427-4137-b08f-53b7316f54f3 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:26:41.973531 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694f61c7-f776-4ec9-8e46-3866f836602b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:26:41.974752 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694f61c7-f776-4ec9-8e46-3866f836602b admin admin] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:26:41.975300 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694f61c7-f776-4ec9-8e46-3866f836602b admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:26:41.975738 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694f61c7-f776-4ec9-8e46-3866f836602b admin admin] PATH_INFO: `/v3/users` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:26:41.976687 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694f61c7-f776-4ec9-8e46-3866f836602b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:26:41.979528 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694f61c7-f776-4ec9-8e46-3866f836602b admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:26:42.008305 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-cceff875-9cf3-4386-82bf-d32dfeb22966 None None] MFA Rules not processed for user `60bb8a52c96e4dcca085aabaf901f655`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:26:42.009902 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-cceff875-9cf3-4386-82bf-d32dfeb22966 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:26:42.015074 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 803/1590] 10.222.0.44 () {60 vars in 1143 bytes} [Thu Jun 16 12:26:41 2022] POST /identity/v3/users => generated 293 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 12:26:42.016053 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694f61c7-f776-4ec9-8e46-3866f836602b admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:26:42.030907 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=90,keystone:INSERT=10 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:26:42.034983 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694f61c7-f776-4ec9-8e46-3866f836602b admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:26:42.042806 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5ef3ce-3ff0-4cc1-8dfe-3495710a85b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:26:42.043529 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5ef3ce-3ff0-4cc1-8dfe-3495710a85b7 admin admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:26:42.043825 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5ef3ce-3ff0-4cc1-8dfe-3495710a85b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:26:42.044100 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5ef3ce-3ff0-4cc1-8dfe-3495710a85b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:26:42.044869 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5ef3ce-3ff0-4cc1-8dfe-3495710a85b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:26:42.046915 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5ef3ce-3ff0-4cc1-8dfe-3495710a85b7 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:26:42.059123 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 804/1591] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 12:26:42 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 12:26:42.060019 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5ef3ce-3ff0-4cc1-8dfe-3495710a85b7 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:26:42.077213 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5ef3ce-3ff0-4cc1-8dfe-3495710a85b7 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:26:42.082503 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12da88bb-89e0-4018-971b-976bc01efc52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:26:42.083518 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12da88bb-89e0-4018-971b-976bc01efc52 admin admin] REQUEST_METHOD: `PUT` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:26:42.083803 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12da88bb-89e0-4018-971b-976bc01efc52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:26:42.084081 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12da88bb-89e0-4018-971b-976bc01efc52 admin admin] PATH_INFO: `/v3/projects/18d1df990e2c44e7bf7161a00fcc8828/users/60837558214148d3ab487ea95b68e638/roles/c39882b202e942479a7cdac2fc6da72c` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:26:42.087522 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:26:42.102084 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 788/1592] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 12:26:41 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:26:42.103804 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cceff875-9cf3-4386-82bf-d32dfeb22966 None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:26:42.107111 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12da88bb-89e0-4018-971b-976bc01efc52 admin admin] RBAC: Authorizing `identity:create_grant(project_id=18d1df990e2c44e7bf7161a00fcc8828, user_id=60837558214148d3ab487ea95b68e638, role_id=c39882b202e942479a7cdac2fc6da72c)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:26:42.108181 dv-cinder-846149-2-smb devstack@keystone.service[80076]: WARNING py.warnings [None req-12da88bb-89e0-4018-971b-976bc01efc52 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 16 12:26:42.108181 dv-cinder-846149-2-smb devstack@keystone.service[80076]: warnings.warn(msg) Jun 16 12:26:42.108181 dv-cinder-846149-2-smb devstack@keystone.service[80076]: Jun 16 12:26:42.110720 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12da88bb-89e0-4018-971b-976bc01efc52 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:26:42.122290 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cceff875-9cf3-4386-82bf-d32dfeb22966 None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:26:42.140335 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 805/1593] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 16 12:26:42 2022] PUT /identity/v3/projects/18d1df990e2c44e7bf7161a00fcc8828/users/60837558214148d3ab487ea95b68e638/roles/c39882b202e942479a7cdac2fc6da72c => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:26:42.141563 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12da88bb-89e0-4018-971b-976bc01efc52 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:26:42.207936 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6ab8b6-e15c-49bd-98d1-9f0f968a5c3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:26:42.208624 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6ab8b6-e15c-49bd-98d1-9f0f968a5c3b admin admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:26:42.208937 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6ab8b6-e15c-49bd-98d1-9f0f968a5c3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:26:42.209208 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6ab8b6-e15c-49bd-98d1-9f0f968a5c3b admin admin] PATH_INFO: `/v3/roles` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:26:42.210000 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6ab8b6-e15c-49bd-98d1-9f0f968a5c3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:26:42.211680 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6ab8b6-e15c-49bd-98d1-9f0f968a5c3b admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:26:42.224143 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 789/1594] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 12:26:42 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 12:26:42.225204 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6ab8b6-e15c-49bd-98d1-9f0f968a5c3b admin admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:26:42.238949 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6ab8b6-e15c-49bd-98d1-9f0f968a5c3b admin admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:26:42.240903 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12da88bb-89e0-4018-971b-976bc01efc52 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:26:42.244669 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7357640c-3356-406e-ad95-5f0018e05c3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:26:42.245378 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7357640c-3356-406e-ad95-5f0018e05c3c admin admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:26:42.245657 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7357640c-3356-406e-ad95-5f0018e05c3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:26:42.245937 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7357640c-3356-406e-ad95-5f0018e05c3c admin admin] PATH_INFO: `/v3/roles` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:26:42.246711 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7357640c-3356-406e-ad95-5f0018e05c3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:26:42.247830 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db57a9e-3235-454b-a20f-23a09df26bee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:26:42.248614 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db57a9e-3235-454b-a20f-23a09df26bee admin admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:26:42.248790 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7357640c-3356-406e-ad95-5f0018e05c3c admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:26:42.249599 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db57a9e-3235-454b-a20f-23a09df26bee admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:26:42.250087 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db57a9e-3235-454b-a20f-23a09df26bee admin admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:26:42.250936 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db57a9e-3235-454b-a20f-23a09df26bee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:26:42.252789 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db57a9e-3235-454b-a20f-23a09df26bee admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:26:42.262447 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 790/1595] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 12:26:42 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 12:26:42.263567 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7357640c-3356-406e-ad95-5f0018e05c3c admin admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:26:42.271167 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 806/1596] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 12:26:42 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 12:26:42.272530 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db57a9e-3235-454b-a20f-23a09df26bee admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:26:42.275566 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7357640c-3356-406e-ad95-5f0018e05c3c admin admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:26:42.280925 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5858a83c-fbda-46dd-b88e-e32ee483049d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:26:42.281630 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5858a83c-fbda-46dd-b88e-e32ee483049d admin admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:26:42.282005 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5858a83c-fbda-46dd-b88e-e32ee483049d admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:26:42.282380 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5858a83c-fbda-46dd-b88e-e32ee483049d admin admin] PATH_INFO: `/v3/roles` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:26:42.283110 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5858a83c-fbda-46dd-b88e-e32ee483049d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:26:42.284806 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5858a83c-fbda-46dd-b88e-e32ee483049d admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:26:42.287022 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db57a9e-3235-454b-a20f-23a09df26bee admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:26:42.292557 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9bd06c-56a2-4079-9602-ca359468257d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:26:42.293501 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9bd06c-56a2-4079-9602-ca359468257d admin admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:26:42.293974 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9bd06c-56a2-4079-9602-ca359468257d admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:26:42.294506 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9bd06c-56a2-4079-9602-ca359468257d admin admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:26:42.295661 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9bd06c-56a2-4079-9602-ca359468257d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:26:42.299450 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 791/1597] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 12:26:42 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 12:26:42.299450 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafbbb5e-4ba1-4a31-964a-8fa47d74ffec None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:26:42.299450 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafbbb5e-4ba1-4a31-964a-8fa47d74ffec None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:26:42.299450 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafbbb5e-4ba1-4a31-964a-8fa47d74ffec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:26:42.302795 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9bd06c-56a2-4079-9602-ca359468257d admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:26:42.317248 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 807/1598] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 12:26:42 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 12:26:42.319136 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a57200f-1c53-40b3-9e63-b2e24b96cbaf None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:26:42.320050 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a57200f-1c53-40b3-9e63-b2e24b96cbaf None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:26:42.320823 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a57200f-1c53-40b3-9e63-b2e24b96cbaf None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:26:42.330984 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 808/1599] 10.222.0.44 () {54 vars in 961 bytes} [Thu Jun 16 12:26:42 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 12:26:42.332098 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-dafbbb5e-4ba1-4a31-964a-8fa47d74ffec None None] MFA Rules not processed for user `60837558214148d3ab487ea95b68e638`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:26:42.332437 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a57200f-1c53-40b3-9e63-b2e24b96cbaf None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:26:42.335505 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-dafbbb5e-4ba1-4a31-964a-8fa47d74ffec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:26:42.355093 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a57200f-1c53-40b3-9e63-b2e24b96cbaf None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:26:42.360625 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cfdb5c-aa73-4ef2-9608-494f8847ebe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:26:42.368242 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cfdb5c-aa73-4ef2-9608-494f8847ebe8 admin admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:26:42.368725 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cfdb5c-aa73-4ef2-9608-494f8847ebe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:26:42.370184 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cfdb5c-aa73-4ef2-9608-494f8847ebe8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:26:42.371139 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cfdb5c-aa73-4ef2-9608-494f8847ebe8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:26:42.373389 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cfdb5c-aa73-4ef2-9608-494f8847ebe8 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:26:42.400852 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 809/1600] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 12:26:42 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 12:26:42.400852 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cfdb5c-aa73-4ef2-9608-494f8847ebe8 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:26:42.417815 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cfdb5c-aa73-4ef2-9608-494f8847ebe8 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:26:42.424712 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ee5a35-39a3-4578-ab71-25a2a7ff531a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:26:42.425516 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ee5a35-39a3-4578-ab71-25a2a7ff531a admin admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:26:42.425808 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ee5a35-39a3-4578-ab71-25a2a7ff531a admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:26:42.426142 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ee5a35-39a3-4578-ab71-25a2a7ff531a admin admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:26:42.426918 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ee5a35-39a3-4578-ab71-25a2a7ff531a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:26:42.429534 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ee5a35-39a3-4578-ab71-25a2a7ff531a admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:26:42.449843 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 810/1601] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 12:26:42 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 12:26:42.450938 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ee5a35-39a3-4578-ab71-25a2a7ff531a admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:26:42.464367 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 792/1602] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 12:26:42 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:26:42.464367 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafbbb5e-4ba1-4a31-964a-8fa47d74ffec None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:26:42.470509 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ee5a35-39a3-4578-ab71-25a2a7ff531a admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:26:42.475815 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafbbb5e-4ba1-4a31-964a-8fa47d74ffec None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:26:42.476739 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a713040-48dc-4fac-a3fe-f6d5bde3ce4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:26:42.478505 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a713040-48dc-4fac-a3fe-f6d5bde3ce4c admin admin] REQUEST_METHOD: `PUT` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:26:42.478788 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a713040-48dc-4fac-a3fe-f6d5bde3ce4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:26:42.479058 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a713040-48dc-4fac-a3fe-f6d5bde3ce4c admin admin] PATH_INFO: `/v3/projects/f3f87f9a4f134a96b8d94f8bda417f83/users/799308ced5f04bbba8e5e19cdd6acb1b/roles/c39882b202e942479a7cdac2fc6da72c` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:26:42.488352 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68a5b71-9e82-4c08-9a33-0318d854bb24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:26:42.489185 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68a5b71-9e82-4c08-9a33-0318d854bb24 admin admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:26:42.489636 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68a5b71-9e82-4c08-9a33-0318d854bb24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:26:42.490122 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68a5b71-9e82-4c08-9a33-0318d854bb24 admin admin] PATH_INFO: `/v3/roles` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:26:42.491083 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68a5b71-9e82-4c08-9a33-0318d854bb24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:26:42.494379 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68a5b71-9e82-4c08-9a33-0318d854bb24 admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:26:42.495188 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a713040-48dc-4fac-a3fe-f6d5bde3ce4c admin admin] RBAC: Authorizing `identity:create_grant(project_id=f3f87f9a4f134a96b8d94f8bda417f83, user_id=799308ced5f04bbba8e5e19cdd6acb1b, role_id=c39882b202e942479a7cdac2fc6da72c)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:26:42.498958 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a713040-48dc-4fac-a3fe-f6d5bde3ce4c admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:26:42.511138 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 793/1603] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 12:26:42 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 12:26:42.511138 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68a5b71-9e82-4c08-9a33-0318d854bb24 admin admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:26:42.522007 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 811/1604] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 16 12:26:42 2022] PUT /identity/v3/projects/f3f87f9a4f134a96b8d94f8bda417f83/users/799308ced5f04bbba8e5e19cdd6acb1b/roles/c39882b202e942479a7cdac2fc6da72c => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:26:42.522007 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f09783-b97e-4883-b965-ccc71fc5f7fe None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:26:42.522007 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f09783-b97e-4883-b965-ccc71fc5f7fe None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:26:42.522007 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f09783-b97e-4883-b965-ccc71fc5f7fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:26:42.526269 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68a5b71-9e82-4c08-9a33-0318d854bb24 admin admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:26:42.537417 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:26:42.546981 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-86f09783-b97e-4883-b965-ccc71fc5f7fe None None] MFA Rules not processed for user `edfb12d445e74136b90800e93941f468`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:26:42.549026 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-86f09783-b97e-4883-b965-ccc71fc5f7fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:26:42.609715 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4587e257-1689-4770-959a-d84023b947c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:26:42.610778 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4587e257-1689-4770-959a-d84023b947c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:26:42.611236 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4587e257-1689-4770-959a-d84023b947c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:26:42.611627 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4587e257-1689-4770-959a-d84023b947c2 admin admin] PATH_INFO: `/v3/projects/23a1b762c28a48b8ad7364069104985d/users/dcb0b632b30649609216933c50f287b9/roles/c39882b202e942479a7cdac2fc6da72c` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:26:42.631453 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4587e257-1689-4770-959a-d84023b947c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=23a1b762c28a48b8ad7364069104985d, user_id=dcb0b632b30649609216933c50f287b9, role_id=c39882b202e942479a7cdac2fc6da72c)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:26:42.635194 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4587e257-1689-4770-959a-d84023b947c2 admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:26:42.651089 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 794/1605] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 16 12:26:42 2022] PUT /identity/v3/projects/23a1b762c28a48b8ad7364069104985d/users/dcb0b632b30649609216933c50f287b9/roles/c39882b202e942479a7cdac2fc6da72c => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:26:42.652019 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4587e257-1689-4770-959a-d84023b947c2 admin admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:26:42.697375 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 812/1606] 10.222.0.44 () {58 vars in 1058 bytes} [Thu Jun 16 12:26:42 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:26:42.698537 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f09783-b97e-4883-b965-ccc71fc5f7fe None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:26:42.712714 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f09783-b97e-4883-b965-ccc71fc5f7fe None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:26:42.722985 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:26:42.740189 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4587e257-1689-4770-959a-d84023b947c2 admin admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:26:42.748653 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83a3458-22bf-4665-9247-8056a24fbcd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:26:42.750244 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83a3458-22bf-4665-9247-8056a24fbcd3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:26:42.750620 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83a3458-22bf-4665-9247-8056a24fbcd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:26:42.750976 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83a3458-22bf-4665-9247-8056a24fbcd3 admin admin] PATH_INFO: `/v3/projects/72fe16e881194f37bbd883a561f8973d/users/24a8e642ca2f48678b270cdc8372d0bd/roles/c39882b202e942479a7cdac2fc6da72c` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:26:42.775047 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83a3458-22bf-4665-9247-8056a24fbcd3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=72fe16e881194f37bbd883a561f8973d, user_id=24a8e642ca2f48678b270cdc8372d0bd, role_id=c39882b202e942479a7cdac2fc6da72c)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:26:42.779531 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83a3458-22bf-4665-9247-8056a24fbcd3 admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:26:42.793971 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00f9acf-dffc-4383-a8a6-8d92e39485ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:26:42.795007 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00f9acf-dffc-4383-a8a6-8d92e39485ca admin admin] REQUEST_METHOD: `PUT` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:26:42.795296 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00f9acf-dffc-4383-a8a6-8d92e39485ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:26:42.796906 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00f9acf-dffc-4383-a8a6-8d92e39485ca admin admin] PATH_INFO: `/v3/projects/66e5454e50a74221b0ec163094c0fd56/users/a070fcd6c4234ff293bcb548b087b7aa/roles/c39882b202e942479a7cdac2fc6da72c` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:26:42.804829 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 795/1607] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 16 12:26:42 2022] PUT /identity/v3/projects/72fe16e881194f37bbd883a561f8973d/users/24a8e642ca2f48678b270cdc8372d0bd/roles/c39882b202e942479a7cdac2fc6da72c => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:26:42.812228 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83a3458-22bf-4665-9247-8056a24fbcd3 admin admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:26:42.812526 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00f9acf-dffc-4383-a8a6-8d92e39485ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=66e5454e50a74221b0ec163094c0fd56, user_id=a070fcd6c4234ff293bcb548b087b7aa, role_id=c39882b202e942479a7cdac2fc6da72c)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:26:42.816347 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00f9acf-dffc-4383-a8a6-8d92e39485ca admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:26:42.875291 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 813/1608] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 16 12:26:42 2022] PUT /identity/v3/projects/66e5454e50a74221b0ec163094c0fd56/users/a070fcd6c4234ff293bcb548b087b7aa/roles/c39882b202e942479a7cdac2fc6da72c => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:26:42.875291 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00f9acf-dffc-4383-a8a6-8d92e39485ca admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:26:42.944932 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83a3458-22bf-4665-9247-8056a24fbcd3 admin admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:26:42.951682 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfec2f67-226a-4ad5-8312-c727e88a144c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:26:42.952478 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfec2f67-226a-4ad5-8312-c727e88a144c admin admin] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:26:42.952878 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfec2f67-226a-4ad5-8312-c727e88a144c admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:26:42.953255 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfec2f67-226a-4ad5-8312-c727e88a144c admin admin] PATH_INFO: `/v3/projects` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:26:42.954046 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfec2f67-226a-4ad5-8312-c727e88a144c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:26:42.954835 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00f9acf-dffc-4383-a8a6-8d92e39485ca admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:26:42.956576 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfec2f67-226a-4ad5-8312-c727e88a144c admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:26:42.961017 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf04de9-d4a4-4bf0-8f74-c09088b28a6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:26:42.962573 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf04de9-d4a4-4bf0-8f74-c09088b28a6d admin admin] REQUEST_METHOD: `PUT` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:26:42.962866 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf04de9-d4a4-4bf0-8f74-c09088b28a6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:26:42.963143 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf04de9-d4a4-4bf0-8f74-c09088b28a6d admin admin] PATH_INFO: `/v3/projects/03bcef899d464a9cb286f2b56b7b9ce4/users/6ea1062df9c34057aa23b586d7dc474b/roles/c39882b202e942479a7cdac2fc6da72c` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:26:42.980848 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf04de9-d4a4-4bf0-8f74-c09088b28a6d admin admin] RBAC: Authorizing `identity:create_grant(project_id=03bcef899d464a9cb286f2b56b7b9ce4, user_id=6ea1062df9c34057aa23b586d7dc474b, role_id=c39882b202e942479a7cdac2fc6da72c)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:26:42.983549 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf04de9-d4a4-4bf0-8f74-c09088b28a6d admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:26:43.001778 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 796/1609] 10.222.0.44 () {60 vars in 1152 bytes} [Thu Jun 16 12:26:42 2022] POST /identity/v3/projects => generated 357 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 12:26:43.003336 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 814/1610] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 16 12:26:42 2022] PUT /identity/v3/projects/03bcef899d464a9cb286f2b56b7b9ce4/users/6ea1062df9c34057aa23b586d7dc474b/roles/c39882b202e942479a7cdac2fc6da72c => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:26:43.004833 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb94c9ab-40f7-448e-8b1e-6ad28193bd27 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:26:43.005122 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb94c9ab-40f7-448e-8b1e-6ad28193bd27 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:26:43.005398 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb94c9ab-40f7-448e-8b1e-6ad28193bd27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:26:43.009442 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352999cf-0fd7-4f54-a547-5f3def50f621 None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:26:43.009893 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352999cf-0fd7-4f54-a547-5f3def50f621 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:26:43.010236 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352999cf-0fd7-4f54-a547-5f3def50f621 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:26:43.019545 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:26:43.032538 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-cb94c9ab-40f7-448e-8b1e-6ad28193bd27 None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:26:43.033937 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-cb94c9ab-40f7-448e-8b1e-6ad28193bd27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:26:43.036743 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-352999cf-0fd7-4f54-a547-5f3def50f621 None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:26:43.039411 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-352999cf-0fd7-4f54-a547-5f3def50f621 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:26:43.134335 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 815/1611] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 12:26:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:26:43.134335 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb94c9ab-40f7-448e-8b1e-6ad28193bd27 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:26:43.135439 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 797/1612] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 12:26:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:26:43.138454 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50c54c7-0616-43ba-878c-a320d22bbac0 None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:26:43.138454 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50c54c7-0616-43ba-878c-a320d22bbac0 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:26:43.138454 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50c54c7-0616-43ba-878c-a320d22bbac0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:26:43.156301 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:26:43.167353 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-b50c54c7-0616-43ba-878c-a320d22bbac0 None None] MFA Rules not processed for user `24a8e642ca2f48678b270cdc8372d0bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:26:43.168574 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-b50c54c7-0616-43ba-878c-a320d22bbac0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:26:43.211217 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb94c9ab-40f7-448e-8b1e-6ad28193bd27 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:26:43.218005 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44acb0f2-b4fd-420d-a4f4-e3431a5d2196 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edfb12d445e74136b90800e93941f468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '601361df39e34fcca71175aa94e425c4', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:26:43.218753 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44acb0f2-b4fd-420d-a4f4-e3431a5d2196 service nova] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:26:43.219103 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44acb0f2-b4fd-420d-a4f4-e3431a5d2196 service nova] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:26:43.219447 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44acb0f2-b4fd-420d-a4f4-e3431a5d2196 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:26:43.238141 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 798/1613] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 12:26:43 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:26:43.239592 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c315e6fd-1414-4992-b960-9968cf982c3c None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:26:43.239945 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c315e6fd-1414-4992-b960-9968cf982c3c None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:26:43.240473 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c315e6fd-1414-4992-b960-9968cf982c3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:26:43.283296 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-c315e6fd-1414-4992-b960-9968cf982c3c None None] MFA Rules not processed for user `a070fcd6c4234ff293bcb548b087b7aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:26:43.284943 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-c315e6fd-1414-4992-b960-9968cf982c3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:26:43.299395 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44acb0f2-b4fd-420d-a4f4-e3431a5d2196 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:26:43.302110 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44acb0f2-b4fd-420d-a4f4-e3431a5d2196 service nova] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:26:43.316639 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 816/1614] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 12:26:43 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 12:26:43.317603 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44acb0f2-b4fd-420d-a4f4-e3431a5d2196 service nova] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:26:43.328995 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44acb0f2-b4fd-420d-a4f4-e3431a5d2196 service nova] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:26:43.333690 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f229a6a3-10a1-46d0-9dc8-5df16eff60e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:26:43.334363 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f229a6a3-10a1-46d0-9dc8-5df16eff60e4 admin admin] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:26:43.334649 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f229a6a3-10a1-46d0-9dc8-5df16eff60e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:26:43.335054 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f229a6a3-10a1-46d0-9dc8-5df16eff60e4 admin admin] PATH_INFO: `/v3/users` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:26:43.336050 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f229a6a3-10a1-46d0-9dc8-5df16eff60e4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:26:43.338923 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f229a6a3-10a1-46d0-9dc8-5df16eff60e4 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:26:43.371233 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 817/1615] 10.222.0.44 () {60 vars in 1143 bytes} [Thu Jun 16 12:26:43 2022] POST /identity/v3/users => generated 285 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 12:26:43.371233 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de57ac31-922f-4f56-b342-0d22be7ea6e5 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:26:43.371233 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de57ac31-922f-4f56-b342-0d22be7ea6e5 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:26:43.371233 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de57ac31-922f-4f56-b342-0d22be7ea6e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:26:43.394728 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 799/1616] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 12:26:43 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:26:43.396704 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c315e6fd-1414-4992-b960-9968cf982c3c None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:26:43.413626 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-de57ac31-922f-4f56-b342-0d22be7ea6e5 None None] MFA Rules not processed for user `6ea1062df9c34057aa23b586d7dc474b`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:26:43.416220 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-de57ac31-922f-4f56-b342-0d22be7ea6e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:26:43.438042 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:26:43.475501 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c315e6fd-1414-4992-b960-9968cf982c3c None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:26:43.479932 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd3f9bb-5cef-4ad6-aa6d-f1fd49eea18f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1094729b25a4be7b0b394998c9ca681', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '601361df39e34fcca71175aa94e425c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:26:43.480933 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd3f9bb-5cef-4ad6-aa6d-f1fd49eea18f service neutron] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:26:43.481436 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd3f9bb-5cef-4ad6-aa6d-f1fd49eea18f service neutron] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:26:43.481920 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd3f9bb-5cef-4ad6-aa6d-f1fd49eea18f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:26:43.492864 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd3f9bb-5cef-4ad6-aa6d-f1fd49eea18f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:26:43.495236 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd3f9bb-5cef-4ad6-aa6d-f1fd49eea18f service neutron] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:26:43.506264 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 800/1617] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 12:26:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 12:26:43.507409 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd3f9bb-5cef-4ad6-aa6d-f1fd49eea18f service neutron] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:26:43.518016 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd3f9bb-5cef-4ad6-aa6d-f1fd49eea18f service neutron] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:26:43.522082 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 818/1618] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 12:26:43 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:26:43.523590 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f426d9-c933-439e-924a-e975baf6c8c1 None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:26:43.523867 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f426d9-c933-439e-924a-e975baf6c8c1 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:26:43.524145 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f426d9-c933-439e-924a-e975baf6c8c1 None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:26:43.524480 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3e1f59-363d-4a81-8836-ee79a72e6eab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1094729b25a4be7b0b394998c9ca681', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '601361df39e34fcca71175aa94e425c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:26:43.525376 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3e1f59-363d-4a81-8836-ee79a72e6eab service neutron] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:26:43.525879 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3e1f59-363d-4a81-8836-ee79a72e6eab service neutron] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:26:43.525988 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 819/1619] 10.222.0.44 () {54 vars in 961 bytes} [Thu Jun 16 12:26:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 12:26:43.526557 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3e1f59-363d-4a81-8836-ee79a72e6eab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:26:43.526745 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f426d9-c933-439e-924a-e975baf6c8c1 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:26:43.538602 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3e1f59-363d-4a81-8836-ee79a72e6eab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:26:43.540417 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3e1f59-363d-4a81-8836-ee79a72e6eab service neutron] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:26:43.551133 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f426d9-c933-439e-924a-e975baf6c8c1 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:26:43.555484 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 801/1620] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 12:26:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 12:26:43.557874 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3e1f59-363d-4a81-8836-ee79a72e6eab service neutron] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:26:43.566502 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b097ad1d-5422-4379-8c54-1874e5f0bc87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:26:43.567213 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b097ad1d-5422-4379-8c54-1874e5f0bc87 admin admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:26:43.567499 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b097ad1d-5422-4379-8c54-1874e5f0bc87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:26:43.567780 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b097ad1d-5422-4379-8c54-1874e5f0bc87 admin admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:26:43.569005 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b097ad1d-5422-4379-8c54-1874e5f0bc87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:26:43.570742 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b097ad1d-5422-4379-8c54-1874e5f0bc87 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:26:43.574168 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3e1f59-363d-4a81-8836-ee79a72e6eab service neutron] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:26:43.579934 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f148ce71-ab87-4d1e-a449-140a016ad348 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:26:43.580953 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f148ce71-ab87-4d1e-a449-140a016ad348 admin admin] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:26:43.581863 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f148ce71-ab87-4d1e-a449-140a016ad348 admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:26:43.582357 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f148ce71-ab87-4d1e-a449-140a016ad348 admin admin] PATH_INFO: `/v3/projects` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:26:43.583631 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f148ce71-ab87-4d1e-a449-140a016ad348 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:26:43.584016 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 820/1621] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 12:26:43 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 12:26:43.590893 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f148ce71-ab87-4d1e-a449-140a016ad348 admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:26:43.591753 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3207e74-23bf-4685-a9cf-682fb83d295e None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:26:43.592052 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3207e74-23bf-4685-a9cf-682fb83d295e None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:26:43.592401 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3207e74-23bf-4685-a9cf-682fb83d295e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:26:43.630087 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 802/1622] 10.222.0.44 () {60 vars in 1152 bytes} [Thu Jun 16 12:26:43 2022] POST /identity/v3/projects => generated 365 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 12:26:43.631332 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f148ce71-ab87-4d1e-a449-140a016ad348 admin admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:26:43.649523 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-d3207e74-23bf-4685-a9cf-682fb83d295e None None] MFA Rules not processed for user `edfb12d445e74136b90800e93941f468`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:26:43.650779 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-d3207e74-23bf-4685-a9cf-682fb83d295e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:26:43.675631 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:26:43.709270 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f148ce71-ab87-4d1e-a449-140a016ad348 admin admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:26:43.714957 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5ef4ae-4a58-482c-85b8-83ed3b179e41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:26:43.716081 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5ef4ae-4a58-482c-85b8-83ed3b179e41 admin admin] REQUEST_METHOD: `PUT` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:26:43.716463 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5ef4ae-4a58-482c-85b8-83ed3b179e41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:26:43.716866 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5ef4ae-4a58-482c-85b8-83ed3b179e41 admin admin] PATH_INFO: `/v3/projects/cd3610de98b54df7a459950de3cfe781/users/7b39d7d4fe14491c957739cfb4fd523a/roles/0688968254744e3f9913653cafea3091` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:26:43.737697 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5ef4ae-4a58-482c-85b8-83ed3b179e41 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd3610de98b54df7a459950de3cfe781, user_id=7b39d7d4fe14491c957739cfb4fd523a, role_id=0688968254744e3f9913653cafea3091)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:26:43.740567 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5ef4ae-4a58-482c-85b8-83ed3b179e41 admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:26:43.772004 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 803/1623] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 16 12:26:43 2022] PUT /identity/v3/projects/cd3610de98b54df7a459950de3cfe781/users/7b39d7d4fe14491c957739cfb4fd523a/roles/0688968254744e3f9913653cafea3091 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:26:43.776157 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5ef4ae-4a58-482c-85b8-83ed3b179e41 admin admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:26:43.776705 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 821/1624] 10.222.0.44 () {58 vars in 1058 bytes} [Thu Jun 16 12:26:43 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:26:43.778295 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbadd737-acda-429f-96f6-4a226235c1a4 None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:26:43.778740 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbadd737-acda-429f-96f6-4a226235c1a4 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:26:43.779169 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbadd737-acda-429f-96f6-4a226235c1a4 None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:26:43.781099 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 822/1625] 10.222.0.44 () {54 vars in 912 bytes} [Thu Jun 16 12:26:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 12:26:43.782013 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbadd737-acda-429f-96f6-4a226235c1a4 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:26:43.917317 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5ef4ae-4a58-482c-85b8-83ed3b179e41 admin admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:26:43.926398 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa720c7-0b0f-43af-a348-1293fc2cecc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:26:43.927178 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa720c7-0b0f-43af-a348-1293fc2cecc6 admin admin] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:26:43.927536 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa720c7-0b0f-43af-a348-1293fc2cecc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:26:43.930669 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa720c7-0b0f-43af-a348-1293fc2cecc6 admin admin] PATH_INFO: `/v3/users` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:26:43.932022 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa720c7-0b0f-43af-a348-1293fc2cecc6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:26:43.936587 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa720c7-0b0f-43af-a348-1293fc2cecc6 admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:26:43.964518 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbadd737-acda-429f-96f6-4a226235c1a4 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:26:43.980039 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5875cf-7a44-4a02-aff0-b6c7be12b43b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:26:43.980975 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5875cf-7a44-4a02-aff0-b6c7be12b43b admin admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:26:43.982418 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5875cf-7a44-4a02-aff0-b6c7be12b43b admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:26:43.982832 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5875cf-7a44-4a02-aff0-b6c7be12b43b admin admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:26:43.985141 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5875cf-7a44-4a02-aff0-b6c7be12b43b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:26:43.989534 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5875cf-7a44-4a02-aff0-b6c7be12b43b admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:26:44.014150 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 804/1626] 10.222.0.44 () {60 vars in 1143 bytes} [Thu Jun 16 12:26:43 2022] POST /identity/v3/users => generated 289 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 12:26:44.016143 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3010f99d-85e6-404e-b1a3-557d53aa2ed2 None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:26:44.020956 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 823/1627] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 12:26:43 2022] GET /identity/v3/roles => generated 1420 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 12:26:44.021239 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3010f99d-85e6-404e-b1a3-557d53aa2ed2 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:26:44.021727 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3010f99d-85e6-404e-b1a3-557d53aa2ed2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:26:44.023446 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5875cf-7a44-4a02-aff0-b6c7be12b43b admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:26:44.068085 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:26:44.106862 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-3010f99d-85e6-404e-b1a3-557d53aa2ed2 None None] MFA Rules not processed for user `edfb12d445e74136b90800e93941f468`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:26:44.110401 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-3010f99d-85e6-404e-b1a3-557d53aa2ed2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:26:44.239848 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5875cf-7a44-4a02-aff0-b6c7be12b43b admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:26:44.254520 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0ef8b0-bbef-4954-af03-177045078d5b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edfb12d445e74136b90800e93941f468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '601361df39e34fcca71175aa94e425c4', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:26:44.256637 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0ef8b0-bbef-4954-af03-177045078d5b service nova] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:26:44.256957 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0ef8b0-bbef-4954-af03-177045078d5b service nova] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:26:44.258470 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0ef8b0-bbef-4954-af03-177045078d5b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:26:44.275279 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 805/1628] 10.222.0.44 () {58 vars in 1009 bytes} [Thu Jun 16 12:26:44 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:26:44.276237 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3010f99d-85e6-404e-b1a3-557d53aa2ed2 None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:26:44.303735 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3010f99d-85e6-404e-b1a3-557d53aa2ed2 None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:26:44.319788 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbdaf72-48ef-48bd-88cf-0833b095b91a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:26:44.320491 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbdaf72-48ef-48bd-88cf-0833b095b91a admin admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:26:44.320786 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbdaf72-48ef-48bd-88cf-0833b095b91a admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:26:44.321070 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbdaf72-48ef-48bd-88cf-0833b095b91a admin admin] PATH_INFO: `/v3/roles` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:26:44.322531 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbdaf72-48ef-48bd-88cf-0833b095b91a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:26:44.325267 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbdaf72-48ef-48bd-88cf-0833b095b91a admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:26:44.355555 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 806/1629] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 12:26:44 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 12:26:44.358006 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbdaf72-48ef-48bd-88cf-0833b095b91a admin admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:26:44.359850 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:26:44.381796 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbdaf72-48ef-48bd-88cf-0833b095b91a admin admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:26:44.395001 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0ef8b0-bbef-4954-af03-177045078d5b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:26:44.397160 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0ef8b0-bbef-4954-af03-177045078d5b service nova] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:26:44.400629 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058090f0-6847-471d-ab48-6dc40d14dd6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:26:44.402111 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058090f0-6847-471d-ab48-6dc40d14dd6e admin admin] REQUEST_METHOD: `PUT` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:26:44.402393 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058090f0-6847-471d-ab48-6dc40d14dd6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:26:44.402663 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058090f0-6847-471d-ab48-6dc40d14dd6e admin admin] PATH_INFO: `/v3/projects/cd3610de98b54df7a459950de3cfe781/users/7b39d7d4fe14491c957739cfb4fd523a/roles/0688968254744e3f9913653cafea3091` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:26:44.405675 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058090f0-6847-471d-ab48-6dc40d14dd6e admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd3610de98b54df7a459950de3cfe781, user_id=7b39d7d4fe14491c957739cfb4fd523a, role_id=0688968254744e3f9913653cafea3091)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:26:44.411227 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058090f0-6847-471d-ab48-6dc40d14dd6e admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:26:44.418993 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 824/1630] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 12:26:44 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 12:26:44.420337 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0ef8b0-bbef-4954-af03-177045078d5b service nova] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:26:44.458615 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 807/1631] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 16 12:26:44 2022] PUT /identity/v3/projects/cd3610de98b54df7a459950de3cfe781/users/7b39d7d4fe14491c957739cfb4fd523a/roles/0688968254744e3f9913653cafea3091 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:26:44.459898 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058090f0-6847-471d-ab48-6dc40d14dd6e admin admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:26:44.565348 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0ef8b0-bbef-4954-af03-177045078d5b service nova] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:26:44.678324 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d440fa-f94d-4815-82da-acfe1f9179fc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f96fc14ed89478c8a8c2f11c87511e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '601361df39e34fcca71175aa94e425c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:26:44.678996 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d440fa-f94d-4815-82da-acfe1f9179fc service cinder] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:26:44.679276 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d440fa-f94d-4815-82da-acfe1f9179fc service cinder] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:26:44.679547 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d440fa-f94d-4815-82da-acfe1f9179fc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:26:44.894886 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d440fa-f94d-4815-82da-acfe1f9179fc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:26:44.896353 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d440fa-f94d-4815-82da-acfe1f9179fc service cinder] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:26:44.927070 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 825/1632] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 12:26:44 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 507 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 12:26:44.929286 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1001733b-51ca-4baa-83fa-931951d27f22 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:26:44.929595 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1001733b-51ca-4baa-83fa-931951d27f22 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:26:44.929873 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1001733b-51ca-4baa-83fa-931951d27f22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:26:44.967630 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058090f0-6847-471d-ab48-6dc40d14dd6e admin admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:26:44.980672 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0e587a-5f10-48b4-96c2-e6f6d6c367de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:26:44.981604 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0e587a-5f10-48b4-96c2-e6f6d6c367de admin admin] REQUEST_METHOD: `PUT` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:26:44.981884 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0e587a-5f10-48b4-96c2-e6f6d6c367de admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:26:44.982205 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0e587a-5f10-48b4-96c2-e6f6d6c367de admin admin] PATH_INFO: `/v3/projects/27abe244b0b44d84a3ed4144aecb6ada/users/d3028d4679034015bff663e2a03f3471/roles/0688968254744e3f9913653cafea3091` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:26:44.997502 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-1001733b-51ca-4baa-83fa-931951d27f22 None None] MFA Rules not processed for user `7b39d7d4fe14491c957739cfb4fd523a`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:26:44.999853 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-1001733b-51ca-4baa-83fa-931951d27f22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:26:45.014657 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0e587a-5f10-48b4-96c2-e6f6d6c367de admin admin] RBAC: Authorizing `identity:create_grant(project_id=27abe244b0b44d84a3ed4144aecb6ada, user_id=d3028d4679034015bff663e2a03f3471, role_id=0688968254744e3f9913653cafea3091)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:26:45.020863 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0e587a-5f10-48b4-96c2-e6f6d6c367de admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:26:45.049254 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 808/1633] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 16 12:26:44 2022] PUT /identity/v3/projects/27abe244b0b44d84a3ed4144aecb6ada/users/d3028d4679034015bff663e2a03f3471/roles/0688968254744e3f9913653cafea3091 => generated 0 bytes in 590 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:26:45.053244 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0e587a-5f10-48b4-96c2-e6f6d6c367de admin admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:26:45.065058 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:26:45.153209 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 826/1634] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 12:26:44 2022] POST /identity/v3/auth/tokens => generated 3291 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:26:45.154311 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1001733b-51ca-4baa-83fa-931951d27f22 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:26:45.170577 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:26:45.183567 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1001733b-51ca-4baa-83fa-931951d27f22 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:26:45.234087 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0e587a-5f10-48b4-96c2-e6f6d6c367de admin admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:26:45.253911 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec11e9b-8a92-47aa-8a53-e3cb96b74fc5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edfb12d445e74136b90800e93941f468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '601361df39e34fcca71175aa94e425c4', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:26:45.255685 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec11e9b-8a92-47aa-8a53-e3cb96b74fc5 service nova] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:26:45.259089 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec11e9b-8a92-47aa-8a53-e3cb96b74fc5 service nova] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:26:45.259578 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec11e9b-8a92-47aa-8a53-e3cb96b74fc5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:26:45.348398 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0d9ed1-0dd1-4ae8-90db-7fe1758be252 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:26:45.349424 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0d9ed1-0dd1-4ae8-90db-7fe1758be252 admin admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:26:45.349921 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0d9ed1-0dd1-4ae8-90db-7fe1758be252 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:26:45.350343 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0d9ed1-0dd1-4ae8-90db-7fe1758be252 admin admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:26:45.351243 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0d9ed1-0dd1-4ae8-90db-7fe1758be252 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:26:45.358680 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0d9ed1-0dd1-4ae8-90db-7fe1758be252 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:26:45.380474 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 827/1635] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 12:26:45 2022] GET /identity/v3/roles => generated 1420 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 12:26:45.382987 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0d9ed1-0dd1-4ae8-90db-7fe1758be252 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:26:45.441301 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec11e9b-8a92-47aa-8a53-e3cb96b74fc5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:26:45.445354 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec11e9b-8a92-47aa-8a53-e3cb96b74fc5 service nova] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:26:45.469059 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 809/1636] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 12:26:45 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 12:26:45.469990 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec11e9b-8a92-47aa-8a53-e3cb96b74fc5 service nova] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:26:45.497519 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec11e9b-8a92-47aa-8a53-e3cb96b74fc5 service nova] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:26:45.509422 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf76255-2111-4e73-8821-33aa85cbcc03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:26:45.510314 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf76255-2111-4e73-8821-33aa85cbcc03 admin admin] REQUEST_METHOD: `PUT` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:26:45.510641 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf76255-2111-4e73-8821-33aa85cbcc03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:26:45.510861 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf76255-2111-4e73-8821-33aa85cbcc03 admin admin] PATH_INFO: `/v3/projects/27abe244b0b44d84a3ed4144aecb6ada/users/d3028d4679034015bff663e2a03f3471/roles/0688968254744e3f9913653cafea3091` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:26:45.518346 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf76255-2111-4e73-8821-33aa85cbcc03 admin admin] RBAC: Authorizing `identity:create_grant(project_id=27abe244b0b44d84a3ed4144aecb6ada, user_id=d3028d4679034015bff663e2a03f3471, role_id=0688968254744e3f9913653cafea3091)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:26:45.523678 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf76255-2111-4e73-8821-33aa85cbcc03 admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:26:45.527656 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0d9ed1-0dd1-4ae8-90db-7fe1758be252 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:26:45.536069 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4977a7b-a079-40c5-9ae7-bd3795f32a15 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f96fc14ed89478c8a8c2f11c87511e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '601361df39e34fcca71175aa94e425c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:26:45.537763 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4977a7b-a079-40c5-9ae7-bd3795f32a15 service cinder] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:26:45.538039 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4977a7b-a079-40c5-9ae7-bd3795f32a15 service cinder] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:26:45.538313 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4977a7b-a079-40c5-9ae7-bd3795f32a15 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:26:45.572593 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 810/1637] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 16 12:26:45 2022] PUT /identity/v3/projects/27abe244b0b44d84a3ed4144aecb6ada/users/d3028d4679034015bff663e2a03f3471/roles/0688968254744e3f9913653cafea3091 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:26:45.572593 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d8db36-2298-4a71-876a-e3e93116b301 None None] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:26:45.572593 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d8db36-2298-4a71-876a-e3e93116b301 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:26:45.572593 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d8db36-2298-4a71-876a-e3e93116b301 None None] PATH_INFO: `/` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:26:45.572593 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 811/1638] 10.222.0.44 () {54 vars in 912 bytes} [Thu Jun 16 12:26:45 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 12:26:45.572593 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba500b4c-6733-4168-b02f-7a58b3aaf2bf None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:26:45.574489 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba500b4c-6733-4168-b02f-7a58b3aaf2bf None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:26:45.574489 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba500b4c-6733-4168-b02f-7a58b3aaf2bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:26:45.616948 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-ba500b4c-6733-4168-b02f-7a58b3aaf2bf None None] MFA Rules not processed for user `edfb12d445e74136b90800e93941f468`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:26:45.618289 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-ba500b4c-6733-4168-b02f-7a58b3aaf2bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:26:45.731167 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4977a7b-a079-40c5-9ae7-bd3795f32a15 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:26:45.733760 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4977a7b-a079-40c5-9ae7-bd3795f32a15 service cinder] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:26:45.770683 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 828/1639] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 12:26:45 2022] GET /identity/v3/auth/tokens => generated 3291 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 12:26:45.772200 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd52bfe-6959-46b2-8463-67024024bfb8 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:26:45.772486 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd52bfe-6959-46b2-8463-67024024bfb8 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:26:45.775458 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd52bfe-6959-46b2-8463-67024024bfb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:26:45.793567 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 812/1640] 10.222.0.44 () {58 vars in 1009 bytes} [Thu Jun 16 12:26:45 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:26:45.834337 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba500b4c-6733-4168-b02f-7a58b3aaf2bf None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:26:45.835147 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:26:45.855105 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-5cd52bfe-6959-46b2-8463-67024024bfb8 None None] MFA Rules not processed for user `d3028d4679034015bff663e2a03f3471`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:26:45.858739 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-5cd52bfe-6959-46b2-8463-67024024bfb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:26:46.019913 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba500b4c-6733-4168-b02f-7a58b3aaf2bf None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:26:46.036103 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73afbd7-995a-42e9-addd-864bec6db57b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f96fc14ed89478c8a8c2f11c87511e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '601361df39e34fcca71175aa94e425c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:26:46.039763 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73afbd7-995a-42e9-addd-864bec6db57b service cinder] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:26:46.040466 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73afbd7-995a-42e9-addd-864bec6db57b service cinder] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:26:46.042409 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73afbd7-995a-42e9-addd-864bec6db57b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:26:46.075490 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73afbd7-995a-42e9-addd-864bec6db57b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:26:46.080371 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73afbd7-995a-42e9-addd-864bec6db57b service cinder] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:26:46.094121 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 829/1641] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 12:26:45 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 323 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:26:46.141450 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 813/1642] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 12:26:45 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 12:26:46.467212 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd52bfe-6959-46b2-8463-67024024bfb8 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:26:46.494008 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd52bfe-6959-46b2-8463-67024024bfb8 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:26:46.501048 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9f0830-be20-4831-b867-b16b15b70e2d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f96fc14ed89478c8a8c2f11c87511e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '601361df39e34fcca71175aa94e425c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:26:46.503261 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9f0830-be20-4831-b867-b16b15b70e2d service cinder] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:26:46.503643 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9f0830-be20-4831-b867-b16b15b70e2d service cinder] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:26:46.504015 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9f0830-be20-4831-b867-b16b15b70e2d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:26:46.636796 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9f0830-be20-4831-b867-b16b15b70e2d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:26:46.638351 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9f0830-be20-4831-b867-b16b15b70e2d service cinder] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:26:46.663866 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 830/1643] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 12:26:46 2022] GET /identity/v3/auth/tokens => generated 3224 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 12:26:46.867790 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764d8db4-112c-4697-85be-dc2801df3911 None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:26:46.868149 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764d8db4-112c-4697-85be-dc2801df3911 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:26:46.868416 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764d8db4-112c-4697-85be-dc2801df3911 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:26:46.916718 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:26:46.929071 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-764d8db4-112c-4697-85be-dc2801df3911 None None] MFA Rules not processed for user `93da8714f87144e6a75e3bd076ebeab6`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:26:46.940109 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-764d8db4-112c-4697-85be-dc2801df3911 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:26:47.059788 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9f0830-be20-4831-b867-b16b15b70e2d service cinder] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:26:47.073854 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9f0830-be20-4831-b867-b16b15b70e2d service cinder] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:26:47.078611 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 814/1644] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 12:26:46 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 12:26:47.084573 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c2c95b-aa07-4252-a007-d4e3cbd7f292 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f96fc14ed89478c8a8c2f11c87511e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '601361df39e34fcca71175aa94e425c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:26:47.085300 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c2c95b-aa07-4252-a007-d4e3cbd7f292 service cinder] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:26:47.085585 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c2c95b-aa07-4252-a007-d4e3cbd7f292 service cinder] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:26:47.085864 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c2c95b-aa07-4252-a007-d4e3cbd7f292 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:26:47.091106 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79035b99-2898-48bf-86f9-b3b98d3be452 None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:26:47.091324 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79035b99-2898-48bf-86f9-b3b98d3be452 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:26:47.099806 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79035b99-2898-48bf-86f9-b3b98d3be452 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:26:47.109480 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c2c95b-aa07-4252-a007-d4e3cbd7f292 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:26:47.113486 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c2c95b-aa07-4252-a007-d4e3cbd7f292 service cinder] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:26:47.135267 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 831/1645] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 12:26:47 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 12:26:47.189248 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-79035b99-2898-48bf-86f9-b3b98d3be452 None None] MFA Rules not processed for user `93da8714f87144e6a75e3bd076ebeab6`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:26:47.191597 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-79035b99-2898-48bf-86f9-b3b98d3be452 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:26:47.228227 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 815/1646] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 12:26:47 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:26:47.318991 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c2c95b-aa07-4252-a007-d4e3cbd7f292 service cinder] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:26:47.339671 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c2c95b-aa07-4252-a007-d4e3cbd7f292 service cinder] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:26:47.356496 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cd89b5-6931-4616-bc89-bacea86f1bcc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edfb12d445e74136b90800e93941f468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '601361df39e34fcca71175aa94e425c4', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:26:47.357254 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cd89b5-6931-4616-bc89-bacea86f1bcc service nova] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:26:47.357539 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cd89b5-6931-4616-bc89-bacea86f1bcc service nova] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:26:47.360011 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cd89b5-6931-4616-bc89-bacea86f1bcc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:26:47.374765 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79035b99-2898-48bf-86f9-b3b98d3be452 None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:26:47.387101 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79035b99-2898-48bf-86f9-b3b98d3be452 None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:26:47.390685 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cd89b5-6931-4616-bc89-bacea86f1bcc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:26:47.392381 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cd89b5-6931-4616-bc89-bacea86f1bcc service nova] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:26:47.402884 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d00676-531b-43af-bed2-a914975396a4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f96fc14ed89478c8a8c2f11c87511e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '601361df39e34fcca71175aa94e425c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:26:47.407034 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d00676-531b-43af-bed2-a914975396a4 service cinder] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:26:47.407662 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d00676-531b-43af-bed2-a914975396a4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:26:47.410018 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d00676-531b-43af-bed2-a914975396a4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:26:47.439205 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 832/1647] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 12:26:47 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 12:26:47.629006 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d00676-531b-43af-bed2-a914975396a4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:26:47.635374 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d00676-531b-43af-bed2-a914975396a4 service cinder] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:26:47.655719 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 816/1648] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 12:26:47 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 12:26:48.131983 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cd89b5-6931-4616-bc89-bacea86f1bcc service nova] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:26:48.299413 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cd89b5-6931-4616-bc89-bacea86f1bcc service nova] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:26:48.310228 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f915369-d857-4a9d-b00d-fff74cc49a74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:26:48.312701 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f915369-d857-4a9d-b00d-fff74cc49a74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:26:48.313149 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f915369-d857-4a9d-b00d-fff74cc49a74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:26:48.313473 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f915369-d857-4a9d-b00d-fff74cc49a74 admin admin] PATH_INFO: `/v3/users/24a8e642ca2f48678b270cdc8372d0bd` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:26:48.315317 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f915369-d857-4a9d-b00d-fff74cc49a74 admin admin] RBAC: Authorizing `identity:delete_user(user_id=24a8e642ca2f48678b270cdc8372d0bd)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:26:48.316638 dv-cinder-846149-2-smb devstack@keystone.service[80076]: WARNING py.warnings [None req-3f915369-d857-4a9d-b00d-fff74cc49a74 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 16 12:26:48.316638 dv-cinder-846149-2-smb devstack@keystone.service[80076]: warnings.warn(msg) Jun 16 12:26:48.316638 dv-cinder-846149-2-smb devstack@keystone.service[80076]: Jun 16 12:26:48.327403 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f915369-d857-4a9d-b00d-fff74cc49a74 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:26:48.349842 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:26:48.467379 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-3f915369-d857-4a9d-b00d-fff74cc49a74 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '24a8e642ca2f48678b270cdc8372d0bd'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:26:48.468099 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-3f915369-d857-4a9d-b00d-fff74cc49a74 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '24a8e642ca2f48678b270cdc8372d0bd'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:26:48.480606 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-3f915369-d857-4a9d-b00d-fff74cc49a74 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '24a8e642ca2f48678b270cdc8372d0bd'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:26:48.481513 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-3f915369-d857-4a9d-b00d-fff74cc49a74 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '24a8e642ca2f48678b270cdc8372d0bd'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:26:48.495539 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-3f915369-d857-4a9d-b00d-fff74cc49a74 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '24a8e642ca2f48678b270cdc8372d0bd'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:26:48.553298 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 833/1649] 10.222.0.44 () {58 vars in 1223 bytes} [Thu Jun 16 12:26:48 2022] DELETE /identity/v3/users/24a8e642ca2f48678b270cdc8372d0bd => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:26:48.560907 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0ff6bd-bcaf-45db-a2f8-37d254c5f7b2 None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:26:48.561480 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0ff6bd-bcaf-45db-a2f8-37d254c5f7b2 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:26:48.561592 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0ff6bd-bcaf-45db-a2f8-37d254c5f7b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:26:48.614310 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-8c0ff6bd-bcaf-45db-a2f8-37d254c5f7b2 None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:26:48.620057 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-8c0ff6bd-bcaf-45db-a2f8-37d254c5f7b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:26:48.666505 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1380a2fe-8c43-41d5-b901-4d3e6c3f2911 None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:26:48.667567 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1380a2fe-8c43-41d5-b901-4d3e6c3f2911 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:26:48.667823 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1380a2fe-8c43-41d5-b901-4d3e6c3f2911 None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:26:48.669295 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 834/1650] 10.222.0.44 () {54 vars in 912 bytes} [Thu Jun 16 12:26:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 12:26:48.675558 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5cff07-3002-4ae2-befc-71c6c24de764 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:26:48.675886 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5cff07-3002-4ae2-befc-71c6c24de764 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:26:48.676478 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5cff07-3002-4ae2-befc-71c6c24de764 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:26:48.803120 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 817/1651] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 12:26:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:26:48.829956 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0ff6bd-bcaf-45db-a2f8-37d254c5f7b2 None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:26:48.837565 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-8c0ff6bd-bcaf-45db-a2f8-37d254c5f7b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:26:48.843704 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-8d5cff07-3002-4ae2-befc-71c6c24de764 None None] MFA Rules not processed for user `e1094729b25a4be7b0b394998c9ca681`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:26:48.850738 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-8d5cff07-3002-4ae2-befc-71c6c24de764 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:26:48.978443 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:26:48.998713 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 835/1652] 10.222.0.44 () {58 vars in 1009 bytes} [Thu Jun 16 12:26:48 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 324 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 12:26:49.018924 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0ff6bd-bcaf-45db-a2f8-37d254c5f7b2 None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:26:49.024361 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5cff07-3002-4ae2-befc-71c6c24de764 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:26:49.025814 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-8d5cff07-3002-4ae2-befc-71c6c24de764 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:26:49.036145 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f37a88c-cbee-4a74-8823-7065b6ae589f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1094729b25a4be7b0b394998c9ca681', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '601361df39e34fcca71175aa94e425c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:26:49.037093 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f37a88c-cbee-4a74-8823-7065b6ae589f service neutron] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:26:49.037375 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f37a88c-cbee-4a74-8823-7065b6ae589f service neutron] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:26:49.037652 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f37a88c-cbee-4a74-8823-7065b6ae589f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:26:49.045678 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5cff07-3002-4ae2-befc-71c6c24de764 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:26:49.057684 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f37a88c-cbee-4a74-8823-7065b6ae589f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:26:49.059878 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f37a88c-cbee-4a74-8823-7065b6ae589f service neutron] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:26:49.064435 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6802c28d-677d-4909-86f7-28b29fe64217 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1094729b25a4be7b0b394998c9ca681', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '601361df39e34fcca71175aa94e425c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:26:49.066293 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6802c28d-677d-4909-86f7-28b29fe64217 service neutron] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:26:49.068742 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6802c28d-677d-4909-86f7-28b29fe64217 service neutron] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:26:49.069193 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6802c28d-677d-4909-86f7-28b29fe64217 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:26:49.081313 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 818/1653] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 12:26:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 12:26:49.091771 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6802c28d-677d-4909-86f7-28b29fe64217 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:26:49.095304 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6802c28d-677d-4909-86f7-28b29fe64217 service neutron] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:26:49.115561 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 836/1654] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 12:26:49 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 12:26:49.366343 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f37a88c-cbee-4a74-8823-7065b6ae589f service neutron] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:26:49.367748 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-0f37a88c-cbee-4a74-8823-7065b6ae589f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:26:49.403560 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f37a88c-cbee-4a74-8823-7065b6ae589f service neutron] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:26:49.412349 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4568a10-94c1-41c4-a34a-a4fd793bb28a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:26:49.413550 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4568a10-94c1-41c4-a34a-a4fd793bb28a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:26:49.414230 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4568a10-94c1-41c4-a34a-a4fd793bb28a admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:26:49.414230 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4568a10-94c1-41c4-a34a-a4fd793bb28a admin admin] PATH_INFO: `/v3/users/60bb8a52c96e4dcca085aabaf901f655` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:26:49.430172 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4568a10-94c1-41c4-a34a-a4fd793bb28a admin admin] RBAC: Authorizing `identity:delete_user(user_id=60bb8a52c96e4dcca085aabaf901f655)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:26:49.433780 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4568a10-94c1-41c4-a34a-a4fd793bb28a admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:26:49.532618 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-a4568a10-94c1-41c4-a34a-a4fd793bb28a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '60bb8a52c96e4dcca085aabaf901f655'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:26:49.583759 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-a4568a10-94c1-41c4-a34a-a4fd793bb28a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '60bb8a52c96e4dcca085aabaf901f655'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:26:49.602780 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-a4568a10-94c1-41c4-a34a-a4fd793bb28a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '60bb8a52c96e4dcca085aabaf901f655'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:26:49.604165 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-a4568a10-94c1-41c4-a34a-a4fd793bb28a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '60bb8a52c96e4dcca085aabaf901f655'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:26:49.605421 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-a4568a10-94c1-41c4-a34a-a4fd793bb28a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '60bb8a52c96e4dcca085aabaf901f655'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:26:49.629786 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 819/1655] 10.222.0.44 () {58 vars in 1223 bytes} [Thu Jun 16 12:26:49 2022] DELETE /identity/v3/users/60bb8a52c96e4dcca085aabaf901f655 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:26:49.636325 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ae9c2d-8836-414a-95eb-9be53c2b145c None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:26:49.636967 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ae9c2d-8836-414a-95eb-9be53c2b145c None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:26:49.637273 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ae9c2d-8836-414a-95eb-9be53c2b145c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:26:49.725903 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-a5ae9c2d-8836-414a-95eb-9be53c2b145c None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:26:49.730362 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-a5ae9c2d-8836-414a-95eb-9be53c2b145c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:26:49.979678 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 837/1656] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 12:26:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 346 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:26:50.011357 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4568a10-94c1-41c4-a34a-a4fd793bb28a admin admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:26:50.013532 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-a4568a10-94c1-41c4-a34a-a4fd793bb28a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:26:50.215618 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4568a10-94c1-41c4-a34a-a4fd793bb28a admin admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:26:50.226702 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2827e704-b7a2-4ce5-a46f-5e053e3811fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1094729b25a4be7b0b394998c9ca681', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '601361df39e34fcca71175aa94e425c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:26:50.228280 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2827e704-b7a2-4ce5-a46f-5e053e3811fc service neutron] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:26:50.228489 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2827e704-b7a2-4ce5-a46f-5e053e3811fc service neutron] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:26:50.228838 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2827e704-b7a2-4ce5-a46f-5e053e3811fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:26:50.250461 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2827e704-b7a2-4ce5-a46f-5e053e3811fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:26:50.255941 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2827e704-b7a2-4ce5-a46f-5e053e3811fc service neutron] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:26:50.259026 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ae9c2d-8836-414a-95eb-9be53c2b145c None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:26:50.262609 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-a5ae9c2d-8836-414a-95eb-9be53c2b145c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:26:50.289413 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ae9c2d-8836-414a-95eb-9be53c2b145c None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:26:50.310493 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a4062a-f41d-4048-a0f3-cdddd079ffec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:26:50.311161 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 820/1657] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 12:26:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 12:26:50.311262 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a4062a-f41d-4048-a0f3-cdddd079ffec admin admin] REQUEST_METHOD: `DELETE` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:26:50.311550 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a4062a-f41d-4048-a0f3-cdddd079ffec admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:26:50.311829 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a4062a-f41d-4048-a0f3-cdddd079ffec admin admin] PATH_INFO: `/v3/projects/72fe16e881194f37bbd883a561f8973d` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:26:50.326964 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a4062a-f41d-4048-a0f3-cdddd079ffec admin admin] RBAC: Authorizing `identity:delete_project(project_id=72fe16e881194f37bbd883a561f8973d)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:26:50.337467 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a4062a-f41d-4048-a0f3-cdddd079ffec admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:26:50.357874 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:26:50.445394 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-33a4062a-f41d-4048-a0f3-cdddd079ffec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '72fe16e881194f37bbd883a561f8973d', 'request_id': 'req-33a4062a-f41d-4048-a0f3-cdddd079ffec'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:26:50.466496 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-33a4062a-f41d-4048-a0f3-cdddd079ffec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '72fe16e881194f37bbd883a561f8973d', 'request_id': 'req-33a4062a-f41d-4048-a0f3-cdddd079ffec'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:26:50.491703 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-33a4062a-f41d-4048-a0f3-cdddd079ffec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '72fe16e881194f37bbd883a561f8973d', 'request_id': 'req-33a4062a-f41d-4048-a0f3-cdddd079ffec'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:26:50.514407 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-33a4062a-f41d-4048-a0f3-cdddd079ffec admin admin] The token cache is being invalidate because project 72fe16e881194f37bbd883a561f8973d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 12:26:50.514908 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-33a4062a-f41d-4048-a0f3-cdddd079ffec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:26:50.515711 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-33a4062a-f41d-4048-a0f3-cdddd079ffec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:26:50.517857 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 838/1658] 10.222.0.44 () {58 vars in 1232 bytes} [Thu Jun 16 12:26:50 2022] DELETE /identity/v3/projects/72fe16e881194f37bbd883a561f8973d => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:26:50.522504 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979cd3c8-268b-439b-99fe-aeffc0a65446 None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:26:50.522902 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979cd3c8-268b-439b-99fe-aeffc0a65446 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:26:50.523290 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979cd3c8-268b-439b-99fe-aeffc0a65446 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:26:50.556822 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-979cd3c8-268b-439b-99fe-aeffc0a65446 None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:26:50.560631 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-979cd3c8-268b-439b-99fe-aeffc0a65446 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:26:50.664532 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:26:50.693160 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 821/1659] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 12:26:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:26:50.701918 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fd0982-7ac6-40b3-bdaa-3aed1f3efd42 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:26:50.702352 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fd0982-7ac6-40b3-bdaa-3aed1f3efd42 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:26:50.702707 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fd0982-7ac6-40b3-bdaa-3aed1f3efd42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:26:50.712245 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d2afc1-6b2e-4f81-9120-a5a7d54544e5 None None] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:26:50.712911 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d2afc1-6b2e-4f81-9120-a5a7d54544e5 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:26:50.713382 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d2afc1-6b2e-4f81-9120-a5a7d54544e5 None None] PATH_INFO: `/` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:26:50.715654 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 822/1660] 10.222.0.44 () {54 vars in 960 bytes} [Thu Jun 16 12:26:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 12:26:50.722294 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17227c13-5b1c-4d85-8330-5e873cd6b988 None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:26:50.722947 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17227c13-5b1c-4d85-8330-5e873cd6b988 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:26:50.723515 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17227c13-5b1c-4d85-8330-5e873cd6b988 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:26:50.748239 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-a9fd0982-7ac6-40b3-bdaa-3aed1f3efd42 None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:26:50.750017 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-a9fd0982-7ac6-40b3-bdaa-3aed1f3efd42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:26:50.761798 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-17227c13-5b1c-4d85-8330-5e873cd6b988 None None] MFA Rules not processed for user `8bff8ccf460a403d993c39327bbcbd29`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:26:50.765116 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-17227c13-5b1c-4d85-8330-5e873cd6b988 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:26:50.769800 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 839/1661] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 12:26:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:26:50.776183 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fd0982-7ac6-40b3-bdaa-3aed1f3efd42 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:26:50.829649 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fd0982-7ac6-40b3-bdaa-3aed1f3efd42 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:26:50.850606 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beed269b-852c-4c7d-83ad-c14079d6aa79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:26:50.851740 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beed269b-852c-4c7d-83ad-c14079d6aa79 admin admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:26:50.852227 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beed269b-852c-4c7d-83ad-c14079d6aa79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:26:50.852638 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beed269b-852c-4c7d-83ad-c14079d6aa79 admin admin] PATH_INFO: `/v3/domains` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:26:50.853594 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beed269b-852c-4c7d-83ad-c14079d6aa79 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:26:50.854039 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beed269b-852c-4c7d-83ad-c14079d6aa79 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:26:50.861050 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beed269b-852c-4c7d-83ad-c14079d6aa79 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:26:50.897710 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 840/1662] 10.222.0.44 () {58 vars in 1152 bytes} [Thu Jun 16 12:26:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:26:50.898678 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beed269b-852c-4c7d-83ad-c14079d6aa79 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:26:50.934055 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beed269b-852c-4c7d-83ad-c14079d6aa79 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:26:50.946740 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1904f4f-298e-4e4e-90a1-c35982f529e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:26:50.947437 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1904f4f-298e-4e4e-90a1-c35982f529e2 admin admin] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:26:50.947717 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1904f4f-298e-4e4e-90a1-c35982f529e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:26:50.949764 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1904f4f-298e-4e4e-90a1-c35982f529e2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:26:50.950521 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1904f4f-298e-4e4e-90a1-c35982f529e2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:26:50.957873 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1904f4f-298e-4e4e-90a1-c35982f529e2 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:26:50.988864 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 823/1663] 10.222.0.44 () {58 vars in 1057 bytes} [Thu Jun 16 12:26:50 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:26:50.998525 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17227c13-5b1c-4d85-8330-5e873cd6b988 None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:26:51.034018 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17227c13-5b1c-4d85-8330-5e873cd6b988 None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:26:51.039273 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 841/1664] 10.222.0.44 () {60 vars in 1152 bytes} [Thu Jun 16 12:26:50 2022] POST /identity/v3/projects => generated 403 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 12:26:51.046196 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c6fef8-380b-450e-b06f-67431599ae8c None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:26:51.048208 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c6fef8-380b-450e-b06f-67431599ae8c None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:26:51.048208 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c6fef8-380b-450e-b06f-67431599ae8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:26:51.102656 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-45c6fef8-380b-450e-b06f-67431599ae8c None None] MFA Rules not processed for user `93da8714f87144e6a75e3bd076ebeab6`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:26:51.103956 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-45c6fef8-380b-450e-b06f-67431599ae8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:26:51.252081 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2218b8e-51b0-46a3-9418-56b7050625b6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8bff8ccf460a403d993c39327bbcbd29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '601361df39e34fcca71175aa94e425c4', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:26:51.253639 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2218b8e-51b0-46a3-9418-56b7050625b6 service placement] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:26:51.253930 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2218b8e-51b0-46a3-9418-56b7050625b6 service placement] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:26:51.254399 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2218b8e-51b0-46a3-9418-56b7050625b6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:26:51.256464 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-b2218b8e-51b0-46a3-9418-56b7050625b6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:26:51.263264 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 842/1665] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 12:26:51 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:26:51.264471 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c6fef8-380b-450e-b06f-67431599ae8c None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:26:51.297657 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2218b8e-51b0-46a3-9418-56b7050625b6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:26:51.299422 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2218b8e-51b0-46a3-9418-56b7050625b6 service placement] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:26:51.336836 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 824/1666] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 12:26:50 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 12:26:51.523520 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:26:51.542527 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c6fef8-380b-450e-b06f-67431599ae8c None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:26:51.557425 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126ff5a9-2302-4d3f-99a5-2ebf67d97b7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:26:51.558124 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126ff5a9-2302-4d3f-99a5-2ebf67d97b7c admin admin] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:26:51.558407 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126ff5a9-2302-4d3f-99a5-2ebf67d97b7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:26:51.558685 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126ff5a9-2302-4d3f-99a5-2ebf67d97b7c admin admin] PATH_INFO: `/v3/users` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:26:51.559399 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126ff5a9-2302-4d3f-99a5-2ebf67d97b7c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:26:51.561788 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126ff5a9-2302-4d3f-99a5-2ebf67d97b7c admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:26:51.605858 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 843/1667] 10.222.0.44 () {60 vars in 1143 bytes} [Thu Jun 16 12:26:51 2022] POST /identity/v3/users => generated 302 bytes in 342 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 12:26:51.610047 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2218b8e-51b0-46a3-9418-56b7050625b6 service placement] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:26:51.627060 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2218b8e-51b0-46a3-9418-56b7050625b6 service placement] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:26:51.645941 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7ca75b-5bd0-49b8-aa99-8a98a0f01953 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:26:51.646637 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7ca75b-5bd0-49b8-aa99-8a98a0f01953 admin admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:26:51.646925 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7ca75b-5bd0-49b8-aa99-8a98a0f01953 admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:26:51.647205 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7ca75b-5bd0-49b8-aa99-8a98a0f01953 admin admin] PATH_INFO: `/v3/roles` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:26:51.656332 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7ca75b-5bd0-49b8-aa99-8a98a0f01953 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:26:51.658264 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7ca75b-5bd0-49b8-aa99-8a98a0f01953 admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:26:51.713957 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 825/1668] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 12:26:51 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 12:26:51.718458 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126ff5a9-2302-4d3f-99a5-2ebf67d97b7c admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:26:51.736854 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126ff5a9-2302-4d3f-99a5-2ebf67d97b7c admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:26:51.769646 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79e101f-93e5-4d66-a1c5-d35536030b29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:26:51.770348 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79e101f-93e5-4d66-a1c5-d35536030b29 admin admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:26:51.770634 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79e101f-93e5-4d66-a1c5-d35536030b29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:26:51.770921 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79e101f-93e5-4d66-a1c5-d35536030b29 admin admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:26:51.771819 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79e101f-93e5-4d66-a1c5-d35536030b29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:26:51.773638 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79e101f-93e5-4d66-a1c5-d35536030b29 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:26:51.819601 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7ca75b-5bd0-49b8-aa99-8a98a0f01953 admin admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:26:51.826151 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 844/1669] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 12:26:51 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 12:26:51.833457 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7ca75b-5bd0-49b8-aa99-8a98a0f01953 admin admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:26:51.857847 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e165de67-60b7-41d8-b278-bd9550a3049e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:26:51.858757 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e165de67-60b7-41d8-b278-bd9550a3049e admin admin] REQUEST_METHOD: `PUT` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:26:51.860263 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e165de67-60b7-41d8-b278-bd9550a3049e admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:26:51.860708 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e165de67-60b7-41d8-b278-bd9550a3049e admin admin] PATH_INFO: `/v3/projects/da9ef7b61aec49df9ed74e2f30d7dfcb/users/87dac0ae7de94c70bc05da592e4faa02/roles/c39882b202e942479a7cdac2fc6da72c` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:26:51.909784 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e165de67-60b7-41d8-b278-bd9550a3049e admin admin] RBAC: Authorizing `identity:create_grant(project_id=da9ef7b61aec49df9ed74e2f30d7dfcb, user_id=87dac0ae7de94c70bc05da592e4faa02, role_id=c39882b202e942479a7cdac2fc6da72c)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:26:51.912741 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e165de67-60b7-41d8-b278-bd9550a3049e admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:26:51.970760 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 826/1670] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 16 12:26:51 2022] PUT /identity/v3/projects/da9ef7b61aec49df9ed74e2f30d7dfcb/users/87dac0ae7de94c70bc05da592e4faa02/roles/c39882b202e942479a7cdac2fc6da72c => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 12:26:51.975833 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8924650e-26a0-49e0-a285-21d8a4baf0df None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:26:51.976279 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8924650e-26a0-49e0-a285-21d8a4baf0df None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:26:51.976631 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8924650e-26a0-49e0-a285-21d8a4baf0df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:26:52.012795 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-8924650e-26a0-49e0-a285-21d8a4baf0df None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:26:52.014556 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-8924650e-26a0-49e0-a285-21d8a4baf0df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:26:52.188455 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 845/1671] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 12:26:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:26:52.228892 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e165de67-60b7-41d8-b278-bd9550a3049e admin admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:26:52.231626 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-e165de67-60b7-41d8-b278-bd9550a3049e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:26:52.394295 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:26:52.417908 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e165de67-60b7-41d8-b278-bd9550a3049e admin admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:26:52.434259 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482ef3aa-f076-46a4-89f3-38851d93e63a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1094729b25a4be7b0b394998c9ca681', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '601361df39e34fcca71175aa94e425c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:26:52.434928 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482ef3aa-f076-46a4-89f3-38851d93e63a service neutron] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:26:52.435211 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482ef3aa-f076-46a4-89f3-38851d93e63a service neutron] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:26:52.435546 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482ef3aa-f076-46a4-89f3-38851d93e63a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:26:52.454063 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482ef3aa-f076-46a4-89f3-38851d93e63a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:26:52.459218 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482ef3aa-f076-46a4-89f3-38851d93e63a service neutron] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:26:52.488224 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 827/1672] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 12:26:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 261 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 12:26:52.749068 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8924650e-26a0-49e0-a285-21d8a4baf0df None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:26:52.750249 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-8924650e-26a0-49e0-a285-21d8a4baf0df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:26:52.770188 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8924650e-26a0-49e0-a285-21d8a4baf0df None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:26:52.794443 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcc3bb6-0525-425a-94d5-daa995387ca0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:26:52.799952 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcc3bb6-0525-425a-94d5-daa995387ca0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:26:52.800538 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcc3bb6-0525-425a-94d5-daa995387ca0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:26:52.801743 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcc3bb6-0525-425a-94d5-daa995387ca0 admin admin] PATH_INFO: `/v3/users/6ea1062df9c34057aa23b586d7dc474b` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:26:52.808083 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcc3bb6-0525-425a-94d5-daa995387ca0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6ea1062df9c34057aa23b586d7dc474b)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:26:52.816175 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcc3bb6-0525-425a-94d5-daa995387ca0 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:26:52.951694 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-5fcc3bb6-0525-425a-94d5-daa995387ca0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6ea1062df9c34057aa23b586d7dc474b'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:26:52.952925 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-5fcc3bb6-0525-425a-94d5-daa995387ca0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6ea1062df9c34057aa23b586d7dc474b'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:26:52.962741 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482ef3aa-f076-46a4-89f3-38851d93e63a service neutron] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:26:52.966331 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-482ef3aa-f076-46a4-89f3-38851d93e63a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:26:52.975489 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-5fcc3bb6-0525-425a-94d5-daa995387ca0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6ea1062df9c34057aa23b586d7dc474b'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:26:52.978844 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-5fcc3bb6-0525-425a-94d5-daa995387ca0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6ea1062df9c34057aa23b586d7dc474b'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:26:52.995402 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-5fcc3bb6-0525-425a-94d5-daa995387ca0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6ea1062df9c34057aa23b586d7dc474b'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:26:53.014633 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482ef3aa-f076-46a4-89f3-38851d93e63a service neutron] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:26:53.042596 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f899114-9c94-4bd5-8dd1-126f3efa8cb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:26:53.044872 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f899114-9c94-4bd5-8dd1-126f3efa8cb5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:26:53.047015 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f899114-9c94-4bd5-8dd1-126f3efa8cb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:26:53.047441 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f899114-9c94-4bd5-8dd1-126f3efa8cb5 admin admin] PATH_INFO: `/v3/projects/bbb61152d18b49139ff00a55160e7d58` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:26:53.055895 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f899114-9c94-4bd5-8dd1-126f3efa8cb5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bbb61152d18b49139ff00a55160e7d58)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:26:53.057013 dv-cinder-846149-2-smb devstack@keystone.service[80075]: WARNING py.warnings [None req-5f899114-9c94-4bd5-8dd1-126f3efa8cb5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 16 12:26:53.057013 dv-cinder-846149-2-smb devstack@keystone.service[80075]: warnings.warn(msg) Jun 16 12:26:53.057013 dv-cinder-846149-2-smb devstack@keystone.service[80075]: Jun 16 12:26:53.058228 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f899114-9c94-4bd5-8dd1-126f3efa8cb5 admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:26:53.067863 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 846/1673] 10.222.0.44 () {58 vars in 1223 bytes} [Thu Jun 16 12:26:52 2022] DELETE /identity/v3/users/6ea1062df9c34057aa23b586d7dc474b => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:26:53.071639 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b19a64b-4d55-489a-8c35-72b253db2365 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:26:53.073874 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b19a64b-4d55-489a-8c35-72b253db2365 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:26:53.074339 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b19a64b-4d55-489a-8c35-72b253db2365 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:26:53.132355 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-1b19a64b-4d55-489a-8c35-72b253db2365 None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:26:53.137478 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-1b19a64b-4d55-489a-8c35-72b253db2365 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:26:53.287262 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:26:53.291526 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-5f899114-9c94-4bd5-8dd1-126f3efa8cb5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bbb61152d18b49139ff00a55160e7d58', 'request_id': 'req-5f899114-9c94-4bd5-8dd1-126f3efa8cb5'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:26:53.322750 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-5f899114-9c94-4bd5-8dd1-126f3efa8cb5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bbb61152d18b49139ff00a55160e7d58', 'request_id': 'req-5f899114-9c94-4bd5-8dd1-126f3efa8cb5'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:26:53.340411 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 847/1674] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 12:26:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:26:53.343057 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-5f899114-9c94-4bd5-8dd1-126f3efa8cb5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bbb61152d18b49139ff00a55160e7d58', 'request_id': 'req-5f899114-9c94-4bd5-8dd1-126f3efa8cb5'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:26:53.365629 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b19a64b-4d55-489a-8c35-72b253db2365 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:26:53.369502 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-1b19a64b-4d55-489a-8c35-72b253db2365 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:26:53.394805 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-5f899114-9c94-4bd5-8dd1-126f3efa8cb5 admin admin] The token cache is being invalidate because project bbb61152d18b49139ff00a55160e7d58 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 12:26:53.395592 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-5f899114-9c94-4bd5-8dd1-126f3efa8cb5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:26:53.397526 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-5f899114-9c94-4bd5-8dd1-126f3efa8cb5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:26:53.401571 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 828/1675] 10.222.0.44 () {58 vars in 1232 bytes} [Thu Jun 16 12:26:52 2022] DELETE /identity/v3/projects/bbb61152d18b49139ff00a55160e7d58 => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:26:53.406710 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d3f65d-e2a9-440c-8825-c408fc3cf465 None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:26:53.407539 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d3f65d-e2a9-440c-8825-c408fc3cf465 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:26:53.409267 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d3f65d-e2a9-440c-8825-c408fc3cf465 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:26:53.440397 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-86d3f65d-e2a9-440c-8825-c408fc3cf465 None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:26:53.441984 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-86d3f65d-e2a9-440c-8825-c408fc3cf465 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:26:53.517392 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b19a64b-4d55-489a-8c35-72b253db2365 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:26:53.577742 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 829/1676] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 12:26:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:26:53.580841 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a94ab1-e507-48af-a5c3-450d0577391c None None] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:26:53.581373 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a94ab1-e507-48af-a5c3-450d0577391c None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:26:53.581942 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a94ab1-e507-48af-a5c3-450d0577391c None None] PATH_INFO: `/` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:26:53.584913 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 830/1677] 10.222.0.44 () {54 vars in 912 bytes} [Thu Jun 16 12:26:53 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 12:26:53.587407 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c4f56c-0b5a-48a2-9081-972becb2bb1b None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:26:53.587904 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c4f56c-0b5a-48a2-9081-972becb2bb1b None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:26:53.589640 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c4f56c-0b5a-48a2-9081-972becb2bb1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:26:53.632772 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-33c4f56c-0b5a-48a2-9081-972becb2bb1b None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:26:53.636583 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-33c4f56c-0b5a-48a2-9081-972becb2bb1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:26:53.660670 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 831/1678] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 12:26:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:26:53.663022 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d807c8ec-cd31-4927-817b-8b91af9b8ca4 None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:26:53.664727 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d807c8ec-cd31-4927-817b-8b91af9b8ca4 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:26:53.665137 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d807c8ec-cd31-4927-817b-8b91af9b8ca4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:26:53.682475 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6454fc-36a1-47c3-b8e3-884d07b0388f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1094729b25a4be7b0b394998c9ca681', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '601361df39e34fcca71175aa94e425c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:26:53.685381 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6454fc-36a1-47c3-b8e3-884d07b0388f service neutron] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:26:53.687040 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6454fc-36a1-47c3-b8e3-884d07b0388f service neutron] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:26:53.687445 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6454fc-36a1-47c3-b8e3-884d07b0388f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:26:53.693839 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-ad6454fc-36a1-47c3-b8e3-884d07b0388f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:26:53.717709 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-d807c8ec-cd31-4927-817b-8b91af9b8ca4 None None] MFA Rules not processed for user `e1094729b25a4be7b0b394998c9ca681`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:26:53.720416 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-d807c8ec-cd31-4927-817b-8b91af9b8ca4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:26:53.737910 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6454fc-36a1-47c3-b8e3-884d07b0388f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:26:53.740769 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6454fc-36a1-47c3-b8e3-884d07b0388f service neutron] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:26:53.748776 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 832/1679] 10.222.0.44 () {58 vars in 1009 bytes} [Thu Jun 16 12:26:53 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:26:53.751800 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d807c8ec-cd31-4927-817b-8b91af9b8ca4 None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:26:53.787443 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 848/1680] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 12:26:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 12:26:53.798545 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d807c8ec-cd31-4927-817b-8b91af9b8ca4 None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:26:53.810154 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893d61c7-c563-472e-9146-2abca7911d1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:26:53.810857 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893d61c7-c563-472e-9146-2abca7911d1a admin admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:26:53.811137 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893d61c7-c563-472e-9146-2abca7911d1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:26:53.811405 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893d61c7-c563-472e-9146-2abca7911d1a admin admin] PATH_INFO: `/v3/domains` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:26:53.814639 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893d61c7-c563-472e-9146-2abca7911d1a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:26:53.815051 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893d61c7-c563-472e-9146-2abca7911d1a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:26:53.818053 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6454fc-36a1-47c3-b8e3-884d07b0388f service neutron] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:26:53.819522 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-ad6454fc-36a1-47c3-b8e3-884d07b0388f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:26:53.830976 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893d61c7-c563-472e-9146-2abca7911d1a admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:26:53.847075 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6454fc-36a1-47c3-b8e3-884d07b0388f service neutron] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:26:53.862401 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be35a1e6-21c2-49c3-bd66-4e052afa0f30 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1094729b25a4be7b0b394998c9ca681', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '601361df39e34fcca71175aa94e425c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:26:53.863084 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be35a1e6-21c2-49c3-bd66-4e052afa0f30 service neutron] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:26:53.863372 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be35a1e6-21c2-49c3-bd66-4e052afa0f30 service neutron] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:26:53.863658 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be35a1e6-21c2-49c3-bd66-4e052afa0f30 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:26:53.889316 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 833/1681] 10.222.0.44 () {58 vars in 1152 bytes} [Thu Jun 16 12:26:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:26:53.892167 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893d61c7-c563-472e-9146-2abca7911d1a admin admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:26:53.907162 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be35a1e6-21c2-49c3-bd66-4e052afa0f30 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:26:53.908780 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be35a1e6-21c2-49c3-bd66-4e052afa0f30 service neutron] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:26:53.929486 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893d61c7-c563-472e-9146-2abca7911d1a admin admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:26:53.951531 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 849/1682] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 12:26:53 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 12:26:53.951922 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f51aa35-0c47-4ac8-b1f8-3d49372b1318 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:26:53.954114 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f51aa35-0c47-4ac8-b1f8-3d49372b1318 admin admin] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:26:53.954608 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f51aa35-0c47-4ac8-b1f8-3d49372b1318 admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:26:53.954810 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f51aa35-0c47-4ac8-b1f8-3d49372b1318 admin admin] PATH_INFO: `/v3/projects` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:26:53.956081 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f51aa35-0c47-4ac8-b1f8-3d49372b1318 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:26:53.958077 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f51aa35-0c47-4ac8-b1f8-3d49372b1318 admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:26:54.031264 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 834/1683] 10.222.0.44 () {60 vars in 1152 bytes} [Thu Jun 16 12:26:53 2022] POST /identity/v3/projects => generated 373 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 12:26:54.033205 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be35a1e6-21c2-49c3-bd66-4e052afa0f30 service neutron] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:26:54.050530 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be35a1e6-21c2-49c3-bd66-4e052afa0f30 service neutron] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:26:54.187146 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21a5d77-4caf-44d3-8cef-69983ac7b624 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:26:54.188622 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21a5d77-4caf-44d3-8cef-69983ac7b624 admin admin] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:26:54.189627 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21a5d77-4caf-44d3-8cef-69983ac7b624 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:26:54.191045 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21a5d77-4caf-44d3-8cef-69983ac7b624 admin admin] PATH_INFO: `/v3/users` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:26:54.191940 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21a5d77-4caf-44d3-8cef-69983ac7b624 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:26:54.194381 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21a5d77-4caf-44d3-8cef-69983ac7b624 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:26:54.241319 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 850/1684] 10.222.0.44 () {60 vars in 1143 bytes} [Thu Jun 16 12:26:54 2022] POST /identity/v3/users => generated 287 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 12:26:54.245736 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f51aa35-0c47-4ac8-b1f8-3d49372b1318 admin admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:26:54.260644 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f51aa35-0c47-4ac8-b1f8-3d49372b1318 admin admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:26:54.273491 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c728c76-cb7b-417e-8d3d-40c0e9b65912 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:26:54.276095 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c728c76-cb7b-417e-8d3d-40c0e9b65912 admin admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:26:54.277770 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c728c76-cb7b-417e-8d3d-40c0e9b65912 admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:26:54.278197 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c728c76-cb7b-417e-8d3d-40c0e9b65912 admin admin] PATH_INFO: `/v3/roles` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:26:54.279254 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c728c76-cb7b-417e-8d3d-40c0e9b65912 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:26:54.281097 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c728c76-cb7b-417e-8d3d-40c0e9b65912 admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:26:54.298495 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 835/1685] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 12:26:54 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 12:26:54.302108 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21a5d77-4caf-44d3-8cef-69983ac7b624 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:26:54.316711 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21a5d77-4caf-44d3-8cef-69983ac7b624 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:26:54.323732 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f70c29-35df-4169-8331-28e9b7759301 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:26:54.324792 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f70c29-35df-4169-8331-28e9b7759301 admin admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:26:54.325406 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f70c29-35df-4169-8331-28e9b7759301 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:26:54.326015 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f70c29-35df-4169-8331-28e9b7759301 admin admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:26:54.327114 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f70c29-35df-4169-8331-28e9b7759301 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:26:54.329446 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f70c29-35df-4169-8331-28e9b7759301 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:26:54.348392 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 851/1686] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 12:26:54 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 12:26:54.353006 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c728c76-cb7b-417e-8d3d-40c0e9b65912 admin admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:26:54.369244 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c728c76-cb7b-417e-8d3d-40c0e9b65912 admin admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:26:54.381784 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f093bb-f32a-45cd-9a85-d08a21d5e325 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:26:54.382831 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f093bb-f32a-45cd-9a85-d08a21d5e325 admin admin] REQUEST_METHOD: `PUT` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:26:54.383212 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f093bb-f32a-45cd-9a85-d08a21d5e325 admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:26:54.383958 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f093bb-f32a-45cd-9a85-d08a21d5e325 admin admin] PATH_INFO: `/v3/projects/0bb4ce4b37474e4e8b906cd91b5d2c8a/users/cea98a0c139d461792016725c2173592/roles/c39882b202e942479a7cdac2fc6da72c` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:26:54.407168 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:26:54.420176 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f093bb-f32a-45cd-9a85-d08a21d5e325 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0bb4ce4b37474e4e8b906cd91b5d2c8a, user_id=cea98a0c139d461792016725c2173592, role_id=c39882b202e942479a7cdac2fc6da72c)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:26:54.423123 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f093bb-f32a-45cd-9a85-d08a21d5e325 admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:26:54.461355 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 836/1687] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 16 12:26:54 2022] PUT /identity/v3/projects/0bb4ce4b37474e4e8b906cd91b5d2c8a/users/cea98a0c139d461792016725c2173592/roles/c39882b202e942479a7cdac2fc6da72c => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:26:54.463158 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ec1d85-15ee-4426-b5f4-a32c59a8b71d None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:26:54.463529 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ec1d85-15ee-4426-b5f4-a32c59a8b71d None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:26:54.463918 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ec1d85-15ee-4426-b5f4-a32c59a8b71d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:26:54.514177 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:26:54.516693 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-41ec1d85-15ee-4426-b5f4-a32c59a8b71d None None] MFA Rules not processed for user `cea98a0c139d461792016725c2173592`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:26:54.518281 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-41ec1d85-15ee-4426-b5f4-a32c59a8b71d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:26:54.622736 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 852/1688] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 12:26:54 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 12:26:54.627707 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f093bb-f32a-45cd-9a85-d08a21d5e325 admin admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:26:54.914264 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f093bb-f32a-45cd-9a85-d08a21d5e325 admin admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:26:54.927551 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bce8b7e-5fa9-464f-8ef7-43319aaf2c39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:26:54.928361 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bce8b7e-5fa9-464f-8ef7-43319aaf2c39 admin admin] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:26:54.928772 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bce8b7e-5fa9-464f-8ef7-43319aaf2c39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:26:54.932053 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bce8b7e-5fa9-464f-8ef7-43319aaf2c39 admin admin] PATH_INFO: `/v3/projects` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:26:54.934398 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bce8b7e-5fa9-464f-8ef7-43319aaf2c39 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:26:54.949986 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bce8b7e-5fa9-464f-8ef7-43319aaf2c39 admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:26:55.021183 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 837/1689] 10.222.0.44 () {60 vars in 1152 bytes} [Thu Jun 16 12:26:54 2022] POST /identity/v3/projects => generated 373 bytes in 394 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 12:26:55.022193 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ec1d85-15ee-4426-b5f4-a32c59a8b71d None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:26:55.046646 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ec1d85-15ee-4426-b5f4-a32c59a8b71d None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:26:55.063987 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc87628-747c-4e3e-8a36-ecec6c7a6242 None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:26:55.064551 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc87628-747c-4e3e-8a36-ecec6c7a6242 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:26:55.064965 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc87628-747c-4e3e-8a36-ecec6c7a6242 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:26:55.110123 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-afc87628-747c-4e3e-8a36-ecec6c7a6242 None None] MFA Rules not processed for user `222b53cae3d64412b9b0a89d162311f4`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:26:55.113422 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-afc87628-747c-4e3e-8a36-ecec6c7a6242 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:26:55.345300 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11e539c-0c52-457e-9ad1-614a89a1b747 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:26:55.345300 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11e539c-0c52-457e-9ad1-614a89a1b747 admin admin] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:26:55.345300 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11e539c-0c52-457e-9ad1-614a89a1b747 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:26:55.345300 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11e539c-0c52-457e-9ad1-614a89a1b747 admin admin] PATH_INFO: `/v3/users` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:26:55.345702 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11e539c-0c52-457e-9ad1-614a89a1b747 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:26:55.356776 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 838/1690] 10.222.0.44 () {58 vars in 1009 bytes} [Thu Jun 16 12:26:55 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 294 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:26:55.360006 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11e539c-0c52-457e-9ad1-614a89a1b747 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:26:55.414459 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 853/1691] 10.222.0.44 () {60 vars in 1143 bytes} [Thu Jun 16 12:26:55 2022] POST /identity/v3/users => generated 293 bytes in 393 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 12:26:55.417367 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc87628-747c-4e3e-8a36-ecec6c7a6242 None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:26:55.444217 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc87628-747c-4e3e-8a36-ecec6c7a6242 None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:26:55.458038 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e606ac89-f547-4a53-b799-617cfcba2c41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:26:55.460724 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e606ac89-f547-4a53-b799-617cfcba2c41 admin admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:26:55.461280 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e606ac89-f547-4a53-b799-617cfcba2c41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:26:55.461562 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e606ac89-f547-4a53-b799-617cfcba2c41 admin admin] PATH_INFO: `/v3/roles` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:26:55.464562 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e606ac89-f547-4a53-b799-617cfcba2c41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:26:55.471870 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e606ac89-f547-4a53-b799-617cfcba2c41 admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:26:55.518581 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11e539c-0c52-457e-9ad1-614a89a1b747 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:26:55.520867 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-a11e539c-0c52-457e-9ad1-614a89a1b747 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:26:55.554668 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 839/1692] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 12:26:55 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 12:26:55.558057 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e606ac89-f547-4a53-b799-617cfcba2c41 admin admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:26:55.564589 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11e539c-0c52-457e-9ad1-614a89a1b747 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:26:55.594416 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b8d037-55e6-46f6-8f8b-534610f1234b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:26:55.598492 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b8d037-55e6-46f6-8f8b-534610f1234b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:26:55.598802 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b8d037-55e6-46f6-8f8b-534610f1234b admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:26:55.599079 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b8d037-55e6-46f6-8f8b-534610f1234b admin admin] PATH_INFO: `/v3/users/a070fcd6c4234ff293bcb548b087b7aa` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:26:55.601652 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e606ac89-f547-4a53-b799-617cfcba2c41 admin admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:26:55.603252 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b8d037-55e6-46f6-8f8b-534610f1234b admin admin] RBAC: Authorizing `identity:delete_user(user_id=a070fcd6c4234ff293bcb548b087b7aa)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:26:55.606799 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b8d037-55e6-46f6-8f8b-534610f1234b admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:26:55.615460 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a65874-54d8-415f-8ed0-b75441ff9a94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:26:55.617343 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a65874-54d8-415f-8ed0-b75441ff9a94 admin admin] REQUEST_METHOD: `PUT` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:26:55.618168 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a65874-54d8-415f-8ed0-b75441ff9a94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:26:55.618445 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a65874-54d8-415f-8ed0-b75441ff9a94 admin admin] PATH_INFO: `/v3/projects/0725ac1cb894453e9f62dca9f96b99e3/users/3e177f15797a45de88a9a91d28568f25/roles/0688968254744e3f9913653cafea3091` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:26:55.662573 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a65874-54d8-415f-8ed0-b75441ff9a94 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0725ac1cb894453e9f62dca9f96b99e3, user_id=3e177f15797a45de88a9a91d28568f25, role_id=0688968254744e3f9913653cafea3091)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:26:55.671974 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a65874-54d8-415f-8ed0-b75441ff9a94 admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:26:55.706853 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 840/1693] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 16 12:26:55 2022] PUT /identity/v3/projects/0725ac1cb894453e9f62dca9f96b99e3/users/3e177f15797a45de88a9a91d28568f25/roles/0688968254744e3f9913653cafea3091 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:26:55.710719 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a65874-54d8-415f-8ed0-b75441ff9a94 admin admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:26:55.716350 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-d9a65874-54d8-415f-8ed0-b75441ff9a94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:26:55.721742 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-10b8d037-55e6-46f6-8f8b-534610f1234b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a070fcd6c4234ff293bcb548b087b7aa'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:26:55.723450 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-10b8d037-55e6-46f6-8f8b-534610f1234b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a070fcd6c4234ff293bcb548b087b7aa'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:26:55.745875 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-10b8d037-55e6-46f6-8f8b-534610f1234b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a070fcd6c4234ff293bcb548b087b7aa'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:26:55.747432 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-10b8d037-55e6-46f6-8f8b-534610f1234b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a070fcd6c4234ff293bcb548b087b7aa'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:26:55.770339 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-10b8d037-55e6-46f6-8f8b-534610f1234b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a070fcd6c4234ff293bcb548b087b7aa'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:26:55.844156 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 854/1694] 10.222.0.44 () {58 vars in 1223 bytes} [Thu Jun 16 12:26:55 2022] DELETE /identity/v3/users/a070fcd6c4234ff293bcb548b087b7aa => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:26:55.863368 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b8d037-55e6-46f6-8f8b-534610f1234b admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:26:55.872611 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-10b8d037-55e6-46f6-8f8b-534610f1234b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:26:55.889834 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:26:55.900191 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:26:55.958285 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a65874-54d8-415f-8ed0-b75441ff9a94 admin admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:26:56.073390 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b8d037-55e6-46f6-8f8b-534610f1234b admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:26:56.080724 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e66b30b-62f9-426c-98f7-0c81f350ab7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:26:56.081775 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e66b30b-62f9-426c-98f7-0c81f350ab7a admin admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:26:56.082195 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e66b30b-62f9-426c-98f7-0c81f350ab7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:26:56.082646 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e66b30b-62f9-426c-98f7-0c81f350ab7a admin admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:26:56.083533 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e66b30b-62f9-426c-98f7-0c81f350ab7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:26:56.087723 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e66b30b-62f9-426c-98f7-0c81f350ab7a admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:26:56.144665 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 855/1695] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 12:26:55 2022] GET /identity/v3/roles => generated 1420 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 12:26:56.148249 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd3d616-509d-4be5-9884-ecfabedfeeb7 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:26:56.148470 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd3d616-509d-4be5-9884-ecfabedfeeb7 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:26:56.148798 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd3d616-509d-4be5-9884-ecfabedfeeb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:26:56.164327 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92a21fd-3343-42ef-9813-764da46bf136 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c159f79c1921496487101aac5d530ae5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '601361df39e34fcca71175aa94e425c4', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:26:56.165207 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92a21fd-3343-42ef-9813-764da46bf136 service swift] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:26:56.165497 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92a21fd-3343-42ef-9813-764da46bf136 service swift] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:26:56.166365 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92a21fd-3343-42ef-9813-764da46bf136 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:26:56.168410 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-f92a21fd-3343-42ef-9813-764da46bf136 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:26:56.208561 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-7bd3d616-509d-4be5-9884-ecfabedfeeb7 None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:26:56.209932 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-7bd3d616-509d-4be5-9884-ecfabedfeeb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:26:56.243988 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 856/1696] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 12:26:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:26:56.245584 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd3d616-509d-4be5-9884-ecfabedfeeb7 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:26:56.326605 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92a21fd-3343-42ef-9813-764da46bf136 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:26:56.328335 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92a21fd-3343-42ef-9813-764da46bf136 service swift] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:26:56.328906 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd3d616-509d-4be5-9884-ecfabedfeeb7 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:26:56.348883 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 841/1697] 10.222.0.44 () {60 vars in 1384 bytes} [Thu Jun 16 12:26:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 641 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 16 12:26:56.351471 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731fcb5f-d9b4-4d57-b307-b271d16b7855 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:26:56.352427 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731fcb5f-d9b4-4d57-b307-b271d16b7855 admin admin] REQUEST_METHOD: `PUT` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:26:56.352655 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731fcb5f-d9b4-4d57-b307-b271d16b7855 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:26:56.354359 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731fcb5f-d9b4-4d57-b307-b271d16b7855 admin admin] PATH_INFO: `/v3/projects/0725ac1cb894453e9f62dca9f96b99e3/users/3e177f15797a45de88a9a91d28568f25/roles/0688968254744e3f9913653cafea3091` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:26:56.363886 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731fcb5f-d9b4-4d57-b307-b271d16b7855 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0725ac1cb894453e9f62dca9f96b99e3, user_id=3e177f15797a45de88a9a91d28568f25, role_id=0688968254744e3f9913653cafea3091)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:26:56.370868 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731fcb5f-d9b4-4d57-b307-b271d16b7855 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:26:56.399398 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92a21fd-3343-42ef-9813-764da46bf136 service swift] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:26:56.401455 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-f92a21fd-3343-42ef-9813-764da46bf136 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:26:56.417164 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 857/1698] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 16 12:26:56 2022] PUT /identity/v3/projects/0725ac1cb894453e9f62dca9f96b99e3/users/3e177f15797a45de88a9a91d28568f25/roles/0688968254744e3f9913653cafea3091 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:26:56.428529 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064a75da-e6a7-4d91-b911-848a91d1d034 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:26:56.428844 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064a75da-e6a7-4d91-b911-848a91d1d034 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:26:56.429620 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064a75da-e6a7-4d91-b911-848a91d1d034 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:26:56.515878 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-064a75da-e6a7-4d91-b911-848a91d1d034 None None] MFA Rules not processed for user `3e177f15797a45de88a9a91d28568f25`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:26:56.517681 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-064a75da-e6a7-4d91-b911-848a91d1d034 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:26:56.615010 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92a21fd-3343-42ef-9813-764da46bf136 service swift] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:26:56.762406 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 858/1699] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 12:26:56 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 334 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:26:56.769294 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064a75da-e6a7-4d91-b911-848a91d1d034 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:26:56.775195 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-064a75da-e6a7-4d91-b911-848a91d1d034 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:26:56.797183 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:26:56.854187 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edfd779-99f9-4f64-9efc-248fc3f5f6be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1094729b25a4be7b0b394998c9ca681', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '601361df39e34fcca71175aa94e425c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:26:56.854904 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edfd779-99f9-4f64-9efc-248fc3f5f6be service neutron] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:26:56.855175 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edfd779-99f9-4f64-9efc-248fc3f5f6be service neutron] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:26:56.855449 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edfd779-99f9-4f64-9efc-248fc3f5f6be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:26:57.069736 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064a75da-e6a7-4d91-b911-848a91d1d034 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:26:57.093455 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54584a7d-8de8-4555-8148-c652e883fd2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:26:57.094424 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54584a7d-8de8-4555-8148-c652e883fd2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:26:57.094792 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54584a7d-8de8-4555-8148-c652e883fd2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:26:57.094963 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54584a7d-8de8-4555-8148-c652e883fd2e admin admin] PATH_INFO: `/v3/projects/03bcef899d464a9cb286f2b56b7b9ce4` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:26:57.104579 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54584a7d-8de8-4555-8148-c652e883fd2e admin admin] RBAC: Authorizing `identity:delete_project(project_id=03bcef899d464a9cb286f2b56b7b9ce4)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:26:57.106593 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54584a7d-8de8-4555-8148-c652e883fd2e admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:26:57.120434 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:26:57.250468 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-54584a7d-8de8-4555-8148-c652e883fd2e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '03bcef899d464a9cb286f2b56b7b9ce4', 'request_id': 'req-54584a7d-8de8-4555-8148-c652e883fd2e'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:26:57.256479 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edfd779-99f9-4f64-9efc-248fc3f5f6be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:26:57.259500 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edfd779-99f9-4f64-9efc-248fc3f5f6be service neutron] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:26:57.281792 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-54584a7d-8de8-4555-8148-c652e883fd2e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '03bcef899d464a9cb286f2b56b7b9ce4', 'request_id': 'req-54584a7d-8de8-4555-8148-c652e883fd2e'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:26:57.316721 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-54584a7d-8de8-4555-8148-c652e883fd2e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '03bcef899d464a9cb286f2b56b7b9ce4', 'request_id': 'req-54584a7d-8de8-4555-8148-c652e883fd2e'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:26:57.318203 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 842/1700] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 12:26:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 920 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 12:26:57.319042 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edfd779-99f9-4f64-9efc-248fc3f5f6be service neutron] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:26:57.338567 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-8edfd779-99f9-4f64-9efc-248fc3f5f6be service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:26:57.346653 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-54584a7d-8de8-4555-8148-c652e883fd2e admin admin] The token cache is being invalidate because project 03bcef899d464a9cb286f2b56b7b9ce4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 12:26:57.346994 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-54584a7d-8de8-4555-8148-c652e883fd2e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:26:57.348796 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-54584a7d-8de8-4555-8148-c652e883fd2e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:26:57.354444 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 859/1701] 10.222.0.44 () {58 vars in 1232 bytes} [Thu Jun 16 12:26:56 2022] DELETE /identity/v3/projects/03bcef899d464a9cb286f2b56b7b9ce4 => generated 0 bytes in 592 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:26:57.359075 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5235a09-1c70-49e0-963e-c6ba572a441b None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:26:57.359452 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5235a09-1c70-49e0-963e-c6ba572a441b None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:26:57.359699 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5235a09-1c70-49e0-963e-c6ba572a441b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:26:57.425873 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-a5235a09-1c70-49e0-963e-c6ba572a441b None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:26:57.427187 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-a5235a09-1c70-49e0-963e-c6ba572a441b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:26:57.501074 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edfd779-99f9-4f64-9efc-248fc3f5f6be service neutron] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:26:57.667835 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 860/1702] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 12:26:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 303 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:26:57.669554 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bb6b03-4f7c-4cab-9e34-71fc23de3e34 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:26:57.669843 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bb6b03-4f7c-4cab-9e34-71fc23de3e34 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:26:57.670124 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bb6b03-4f7c-4cab-9e34-71fc23de3e34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:26:57.680025 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2457808b-88eb-49de-9af3-ddd288b07c2b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f96fc14ed89478c8a8c2f11c87511e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '601361df39e34fcca71175aa94e425c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:26:57.681062 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2457808b-88eb-49de-9af3-ddd288b07c2b service cinder] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:26:57.681486 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2457808b-88eb-49de-9af3-ddd288b07c2b service cinder] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:26:57.681904 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2457808b-88eb-49de-9af3-ddd288b07c2b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:26:57.687762 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-2457808b-88eb-49de-9af3-ddd288b07c2b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:26:57.737364 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-78bb6b03-4f7c-4cab-9e34-71fc23de3e34 None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:26:57.738750 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-78bb6b03-4f7c-4cab-9e34-71fc23de3e34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:26:57.774548 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 861/1703] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 12:26:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:26:57.781814 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bb6b03-4f7c-4cab-9e34-71fc23de3e34 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:26:57.804768 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bb6b03-4f7c-4cab-9e34-71fc23de3e34 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:26:57.828011 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa174145-a23e-42e0-ba19-db26614483ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:26:57.828989 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa174145-a23e-42e0-ba19-db26614483ee admin admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:26:57.829407 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa174145-a23e-42e0-ba19-db26614483ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:26:57.829867 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa174145-a23e-42e0-ba19-db26614483ee admin admin] PATH_INFO: `/v3/domains` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:26:57.830807 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa174145-a23e-42e0-ba19-db26614483ee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:26:57.831266 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa174145-a23e-42e0-ba19-db26614483ee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:26:57.842711 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa174145-a23e-42e0-ba19-db26614483ee admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:26:57.876820 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 862/1704] 10.222.0.44 () {58 vars in 1152 bytes} [Thu Jun 16 12:26:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 12:26:57.880785 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2457808b-88eb-49de-9af3-ddd288b07c2b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:26:57.885220 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2457808b-88eb-49de-9af3-ddd288b07c2b service cinder] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:26:57.885744 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa174145-a23e-42e0-ba19-db26614483ee admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:26:57.901355 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:26:57.910958 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa174145-a23e-42e0-ba19-db26614483ee admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:26:57.928373 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 843/1705] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 12:26:57 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 610 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 12:26:57.946996 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6255474-e465-4be2-b213-d6f182d894c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:26:57.955338 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6255474-e465-4be2-b213-d6f182d894c6 admin admin] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:26:57.955922 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6255474-e465-4be2-b213-d6f182d894c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:26:57.956420 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6255474-e465-4be2-b213-d6f182d894c6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:26:57.957414 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6255474-e465-4be2-b213-d6f182d894c6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:26:57.959794 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6255474-e465-4be2-b213-d6f182d894c6 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:26:58.066524 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2457808b-88eb-49de-9af3-ddd288b07c2b service cinder] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:26:58.068041 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-2457808b-88eb-49de-9af3-ddd288b07c2b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:26:58.096786 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2457808b-88eb-49de-9af3-ddd288b07c2b service cinder] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:26:58.098559 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 863/1706] 10.222.0.44 () {60 vars in 1152 bytes} [Thu Jun 16 12:26:57 2022] POST /identity/v3/projects => generated 403 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 12:26:58.100472 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6255474-e465-4be2-b213-d6f182d894c6 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:26:58.291029 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d83e94-04c8-4098-ace5-f69755bd7c1f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f96fc14ed89478c8a8c2f11c87511e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '601361df39e34fcca71175aa94e425c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:26:58.291710 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d83e94-04c8-4098-ace5-f69755bd7c1f service cinder] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:26:58.291989 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d83e94-04c8-4098-ace5-f69755bd7c1f service cinder] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:26:58.292264 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d83e94-04c8-4098-ace5-f69755bd7c1f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:26:58.298299 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-21d83e94-04c8-4098-ace5-f69755bd7c1f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:26:58.328192 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:26:58.346024 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6255474-e465-4be2-b213-d6f182d894c6 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:26:58.372274 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affb2d9a-a25f-41b9-84c6-7484971c570a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:26:58.373103 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affb2d9a-a25f-41b9-84c6-7484971c570a admin admin] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:26:58.373456 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affb2d9a-a25f-41b9-84c6-7484971c570a admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:26:58.376716 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affb2d9a-a25f-41b9-84c6-7484971c570a admin admin] PATH_INFO: `/v3/users` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:26:58.379050 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affb2d9a-a25f-41b9-84c6-7484971c570a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:26:58.387368 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affb2d9a-a25f-41b9-84c6-7484971c570a admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:26:58.486730 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 864/1707] 10.222.0.44 () {60 vars in 1143 bytes} [Thu Jun 16 12:26:58 2022] POST /identity/v3/users => generated 302 bytes in 387 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 12:26:58.489595 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affb2d9a-a25f-41b9-84c6-7484971c570a admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:26:58.533343 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affb2d9a-a25f-41b9-84c6-7484971c570a admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:26:58.555672 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2e5fea-ca56-44be-a7d0-7267d082e31b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:26:58.557208 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2e5fea-ca56-44be-a7d0-7267d082e31b admin admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:26:58.562045 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2e5fea-ca56-44be-a7d0-7267d082e31b admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:26:58.562354 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2e5fea-ca56-44be-a7d0-7267d082e31b admin admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:26:58.563235 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2e5fea-ca56-44be-a7d0-7267d082e31b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:26:58.567854 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d83e94-04c8-4098-ace5-f69755bd7c1f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:26:58.569604 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d83e94-04c8-4098-ace5-f69755bd7c1f service cinder] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:26:58.583390 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2e5fea-ca56-44be-a7d0-7267d082e31b admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:26:58.595124 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 844/1708] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 12:26:58 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 529 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 12:26:58.653371 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 865/1709] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 12:26:58 2022] GET /identity/v3/roles => generated 1420 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 12:26:58.657508 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d83e94-04c8-4098-ace5-f69755bd7c1f service cinder] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:26:58.676988 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d83e94-04c8-4098-ace5-f69755bd7c1f service cinder] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:26:58.693146 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c619b8-d8ff-4854-8abc-e1cd3ef41e5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:26:58.694197 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c619b8-d8ff-4854-8abc-e1cd3ef41e5b admin admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:26:58.694629 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c619b8-d8ff-4854-8abc-e1cd3ef41e5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:26:58.695043 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c619b8-d8ff-4854-8abc-e1cd3ef41e5b admin admin] PATH_INFO: `/v3/roles` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:26:58.696720 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c619b8-d8ff-4854-8abc-e1cd3ef41e5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:26:58.701619 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c619b8-d8ff-4854-8abc-e1cd3ef41e5b admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:26:58.738304 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 845/1710] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 12:26:58 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 12:26:58.740513 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2e5fea-ca56-44be-a7d0-7267d082e31b admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:26:58.759817 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2e5fea-ca56-44be-a7d0-7267d082e31b admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:26:58.779074 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f5b12c-3a75-40fb-ae17-3f581b7e3718 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:26:58.780331 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f5b12c-3a75-40fb-ae17-3f581b7e3718 admin admin] REQUEST_METHOD: `PUT` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:26:58.780905 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f5b12c-3a75-40fb-ae17-3f581b7e3718 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:26:58.781333 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f5b12c-3a75-40fb-ae17-3f581b7e3718 admin admin] PATH_INFO: `/v3/projects/0f59fda8e45d4ff8b6ab57a59655b8b6/users/8d68e44571e24092ae2e48387be674a2/roles/c39882b202e942479a7cdac2fc6da72c` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:26:58.845412 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f5b12c-3a75-40fb-ae17-3f581b7e3718 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f59fda8e45d4ff8b6ab57a59655b8b6, user_id=8d68e44571e24092ae2e48387be674a2, role_id=c39882b202e942479a7cdac2fc6da72c)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:26:58.848022 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0144a7c6-e30d-4ce2-b723-234444b040b4 None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:26:58.848311 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0144a7c6-e30d-4ce2-b723-234444b040b4 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:26:58.848588 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0144a7c6-e30d-4ce2-b723-234444b040b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:26:58.852391 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f5b12c-3a75-40fb-ae17-3f581b7e3718 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:26:58.913682 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 866/1711] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 16 12:26:58 2022] PUT /identity/v3/projects/0f59fda8e45d4ff8b6ab57a59655b8b6/users/8d68e44571e24092ae2e48387be674a2/roles/c39882b202e942479a7cdac2fc6da72c => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:26:58.928963 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3574aad-e735-41bb-b9c7-9239da14fbc8 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:26:58.929252 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3574aad-e735-41bb-b9c7-9239da14fbc8 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:26:58.929534 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3574aad-e735-41bb-b9c7-9239da14fbc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:26:58.939295 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-0144a7c6-e30d-4ce2-b723-234444b040b4 None None] MFA Rules not processed for user `87dac0ae7de94c70bc05da592e4faa02`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:26:58.942878 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-0144a7c6-e30d-4ce2-b723-234444b040b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:26:59.009374 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-f3574aad-e735-41bb-b9c7-9239da14fbc8 None None] MFA Rules not processed for user `8d68e44571e24092ae2e48387be674a2`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:26:59.011761 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-f3574aad-e735-41bb-b9c7-9239da14fbc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:26:59.195279 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 867/1712] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 12:26:58 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:26:59.200556 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3574aad-e735-41bb-b9c7-9239da14fbc8 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:26:59.247139 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 846/1713] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 12:26:58 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 400 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:26:59.248234 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0144a7c6-e30d-4ce2-b723-234444b040b4 None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:26:59.258712 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-0144a7c6-e30d-4ce2-b723-234444b040b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:26:59.306479 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3574aad-e735-41bb-b9c7-9239da14fbc8 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:26:59.314347 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b842ff-efe9-411c-a6cd-36a061fedc6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:26:59.315542 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b842ff-efe9-411c-a6cd-36a061fedc6c admin admin] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:26:59.316072 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b842ff-efe9-411c-a6cd-36a061fedc6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:26:59.316612 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b842ff-efe9-411c-a6cd-36a061fedc6c admin admin] PATH_INFO: `/v3/projects` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:26:59.317526 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b842ff-efe9-411c-a6cd-36a061fedc6c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:26:59.321278 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b842ff-efe9-411c-a6cd-36a061fedc6c admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:26:59.388495 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 868/1714] 10.222.0.44 () {60 vars in 1152 bytes} [Thu Jun 16 12:26:59 2022] POST /identity/v3/projects => generated 401 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 12:26:59.389795 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:26:59.390378 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f2d4cb-4d9e-495d-bf00-032044cf6214 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:26:59.392458 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f2d4cb-4d9e-495d-bf00-032044cf6214 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:26:59.392959 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f2d4cb-4d9e-495d-bf00-032044cf6214 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:26:59.491691 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-f4f2d4cb-4d9e-495d-bf00-032044cf6214 None None] MFA Rules not processed for user `799308ced5f04bbba8e5e19cdd6acb1b`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:26:59.493292 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-f4f2d4cb-4d9e-495d-bf00-032044cf6214 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:26:59.501338 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0144a7c6-e30d-4ce2-b723-234444b040b4 None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:26:59.580425 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:26:59.620849 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2fec8f-a96f-46ac-ad38-4f410067099f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:26:59.621721 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2fec8f-a96f-46ac-ad38-4f410067099f admin admin] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:26:59.622957 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2fec8f-a96f-46ac-ad38-4f410067099f admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:26:59.623341 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2fec8f-a96f-46ac-ad38-4f410067099f admin admin] PATH_INFO: `/v3/projects` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:26:59.625973 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2fec8f-a96f-46ac-ad38-4f410067099f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:26:59.630865 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2fec8f-a96f-46ac-ad38-4f410067099f admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:26:59.714861 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 847/1715] 10.222.0.44 () {60 vars in 1152 bytes} [Thu Jun 16 12:26:59 2022] POST /identity/v3/projects => generated 403 bytes in 467 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 12:26:59.720112 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2fec8f-a96f-46ac-ad38-4f410067099f admin admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:26:59.784843 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 869/1716] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 12:26:59 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 388 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:26:59.784843 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f2d4cb-4d9e-495d-bf00-032044cf6214 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:26:59.806738 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f2d4cb-4d9e-495d-bf00-032044cf6214 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:26:59.893406 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2fec8f-a96f-46ac-ad38-4f410067099f admin admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:26:59.940866 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ceb1b1-0fa9-4b58-be0a-ad271b01e222 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:26:59.942330 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ceb1b1-0fa9-4b58-be0a-ad271b01e222 admin admin] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:26:59.942779 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ceb1b1-0fa9-4b58-be0a-ad271b01e222 admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:26:59.943214 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ceb1b1-0fa9-4b58-be0a-ad271b01e222 admin admin] PATH_INFO: `/v3/users` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:26:59.945022 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ceb1b1-0fa9-4b58-be0a-ad271b01e222 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:26:59.949198 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ceb1b1-0fa9-4b58-be0a-ad271b01e222 admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:27:00.020621 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 848/1717] 10.222.0.44 () {60 vars in 1143 bytes} [Thu Jun 16 12:26:59 2022] POST /identity/v3/users => generated 307 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 12:27:00.023049 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19a1cb0-a1ad-4e54-9fd6-3a93b7c2e249 None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:00.023346 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19a1cb0-a1ad-4e54-9fd6-3a93b7c2e249 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:00.023656 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19a1cb0-a1ad-4e54-9fd6-3a93b7c2e249 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:00.032781 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128df5e7-6c10-49bb-9468-dcd31e3ad7c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:27:00.034134 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128df5e7-6c10-49bb-9468-dcd31e3ad7c3 admin admin] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:00.034540 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128df5e7-6c10-49bb-9468-dcd31e3ad7c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:00.034989 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128df5e7-6c10-49bb-9468-dcd31e3ad7c3 admin admin] PATH_INFO: `/v3/users` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:00.036597 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128df5e7-6c10-49bb-9468-dcd31e3ad7c3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:27:00.054236 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128df5e7-6c10-49bb-9468-dcd31e3ad7c3 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:27:00.066456 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-d19a1cb0-a1ad-4e54-9fd6-3a93b7c2e249 None None] MFA Rules not processed for user `799308ced5f04bbba8e5e19cdd6acb1b`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:27:00.070170 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-d19a1cb0-a1ad-4e54-9fd6-3a93b7c2e249 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:27:00.098376 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 870/1718] 10.222.0.44 () {60 vars in 1143 bytes} [Thu Jun 16 12:26:59 2022] POST /identity/v3/users => generated 308 bytes in 322 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 12:27:00.099358 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128df5e7-6c10-49bb-9468-dcd31e3ad7c3 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:27:00.107071 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-128df5e7-6c10-49bb-9468-dcd31e3ad7c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:27:00.138744 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128df5e7-6c10-49bb-9468-dcd31e3ad7c3 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:27:00.155577 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eae5788-a074-4b11-b03b-3d6f8c27371f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:27:00.156828 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eae5788-a074-4b11-b03b-3d6f8c27371f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:00.157272 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eae5788-a074-4b11-b03b-3d6f8c27371f admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:00.157659 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eae5788-a074-4b11-b03b-3d6f8c27371f admin admin] PATH_INFO: `/v3/projects/66e5454e50a74221b0ec163094c0fd56` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:00.161678 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eae5788-a074-4b11-b03b-3d6f8c27371f admin admin] RBAC: Authorizing `identity:delete_project(project_id=66e5454e50a74221b0ec163094c0fd56)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:27:00.168079 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eae5788-a074-4b11-b03b-3d6f8c27371f admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:27:00.197294 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:27:00.212781 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 849/1719] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 12:27:00 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:27:00.223690 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19a1cb0-a1ad-4e54-9fd6-3a93b7c2e249 None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:27:00.244135 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19a1cb0-a1ad-4e54-9fd6-3a93b7c2e249 None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:27:00.280830 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-1eae5788-a074-4b11-b03b-3d6f8c27371f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '66e5454e50a74221b0ec163094c0fd56', 'request_id': 'req-1eae5788-a074-4b11-b03b-3d6f8c27371f'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:27:00.297831 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-1eae5788-a074-4b11-b03b-3d6f8c27371f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '66e5454e50a74221b0ec163094c0fd56', 'request_id': 'req-1eae5788-a074-4b11-b03b-3d6f8c27371f'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:27:00.323512 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-1eae5788-a074-4b11-b03b-3d6f8c27371f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '66e5454e50a74221b0ec163094c0fd56', 'request_id': 'req-1eae5788-a074-4b11-b03b-3d6f8c27371f'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:27:00.396738 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-1eae5788-a074-4b11-b03b-3d6f8c27371f admin admin] The token cache is being invalidate because project 66e5454e50a74221b0ec163094c0fd56 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 12:27:00.399428 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-1eae5788-a074-4b11-b03b-3d6f8c27371f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:27:00.403979 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-1eae5788-a074-4b11-b03b-3d6f8c27371f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:27:00.414929 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 871/1720] 10.222.0.44 () {58 vars in 1232 bytes} [Thu Jun 16 12:27:00 2022] DELETE /identity/v3/projects/66e5454e50a74221b0ec163094c0fd56 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:27:00.417542 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eae5788-a074-4b11-b03b-3d6f8c27371f admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:27:00.422999 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-1eae5788-a074-4b11-b03b-3d6f8c27371f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:27:00.441529 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd8b62f-38e2-4c20-9a10-280308a5c761 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:27:00.442270 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd8b62f-38e2-4c20-9a10-280308a5c761 admin admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:00.442574 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd8b62f-38e2-4c20-9a10-280308a5c761 admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:00.442839 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd8b62f-38e2-4c20-9a10-280308a5c761 admin admin] PATH_INFO: `/v3/roles` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:00.459797 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd8b62f-38e2-4c20-9a10-280308a5c761 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:27:00.463967 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd8b62f-38e2-4c20-9a10-280308a5c761 admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:27:00.470473 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:27:00.478000 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 850/1721] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 12:27:00 2022] GET /identity/v3/roles => generated 1420 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 12:27:00.478999 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd8b62f-38e2-4c20-9a10-280308a5c761 admin admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:27:00.481136 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-4cd8b62f-38e2-4c20-9a10-280308a5c761 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:27:00.603683 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd8b62f-38e2-4c20-9a10-280308a5c761 admin admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:27:00.613195 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21caa21f-5fef-4e14-b7cd-88fb2cd8c30d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edfb12d445e74136b90800e93941f468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '601361df39e34fcca71175aa94e425c4', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:27:00.613865 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21caa21f-5fef-4e14-b7cd-88fb2cd8c30d service nova] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:00.614150 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21caa21f-5fef-4e14-b7cd-88fb2cd8c30d service nova] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:00.614425 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21caa21f-5fef-4e14-b7cd-88fb2cd8c30d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:00.630290 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eae5788-a074-4b11-b03b-3d6f8c27371f admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:27:00.641422 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-21caa21f-5fef-4e14-b7cd-88fb2cd8c30d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:27:00.645915 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01233fa4-cf23-49e2-9df7-481a2e7f0d2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:27:00.646698 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01233fa4-cf23-49e2-9df7-481a2e7f0d2e admin admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:00.646977 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01233fa4-cf23-49e2-9df7-481a2e7f0d2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:00.647251 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01233fa4-cf23-49e2-9df7-481a2e7f0d2e admin admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:00.649770 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01233fa4-cf23-49e2-9df7-481a2e7f0d2e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:27:00.661651 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01233fa4-cf23-49e2-9df7-481a2e7f0d2e admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:27:00.691422 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 872/1722] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 12:27:00 2022] GET /identity/v3/roles => generated 1420 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 12:27:00.697484 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01233fa4-cf23-49e2-9df7-481a2e7f0d2e admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:27:00.700791 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-01233fa4-cf23-49e2-9df7-481a2e7f0d2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:27:00.735689 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01233fa4-cf23-49e2-9df7-481a2e7f0d2e admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:27:00.748873 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9526086f-8a75-4bb7-9d38-c962bfca371b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:27:00.751487 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9526086f-8a75-4bb7-9d38-c962bfca371b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:00.752459 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9526086f-8a75-4bb7-9d38-c962bfca371b admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:00.752848 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9526086f-8a75-4bb7-9d38-c962bfca371b admin admin] PATH_INFO: `/v3/users/d3028d4679034015bff663e2a03f3471` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:00.756934 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9526086f-8a75-4bb7-9d38-c962bfca371b admin admin] RBAC: Authorizing `identity:delete_user(user_id=d3028d4679034015bff663e2a03f3471)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:27:00.765352 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9526086f-8a75-4bb7-9d38-c962bfca371b admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:27:00.898166 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21caa21f-5fef-4e14-b7cd-88fb2cd8c30d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:27:00.901629 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-9526086f-8a75-4bb7-9d38-c962bfca371b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd3028d4679034015bff663e2a03f3471'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:27:00.902716 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-9526086f-8a75-4bb7-9d38-c962bfca371b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd3028d4679034015bff663e2a03f3471'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:27:00.903697 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21caa21f-5fef-4e14-b7cd-88fb2cd8c30d service nova] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:27:00.929133 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-9526086f-8a75-4bb7-9d38-c962bfca371b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd3028d4679034015bff663e2a03f3471'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:27:00.931881 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-9526086f-8a75-4bb7-9d38-c962bfca371b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd3028d4679034015bff663e2a03f3471'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:27:00.940735 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 851/1723] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 12:27:00 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 457 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 12:27:00.943559 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21caa21f-5fef-4e14-b7cd-88fb2cd8c30d service nova] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:27:00.949786 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-21caa21f-5fef-4e14-b7cd-88fb2cd8c30d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:27:00.957557 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-9526086f-8a75-4bb7-9d38-c962bfca371b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd3028d4679034015bff663e2a03f3471'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:27:00.989985 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 873/1724] 10.222.0.44 () {58 vars in 1223 bytes} [Thu Jun 16 12:27:00 2022] DELETE /identity/v3/users/d3028d4679034015bff663e2a03f3471 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:27:00.992081 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9526086f-8a75-4bb7-9d38-c962bfca371b admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:27:01.010685 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-9526086f-8a75-4bb7-9d38-c962bfca371b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:27:01.057447 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21caa21f-5fef-4e14-b7cd-88fb2cd8c30d service nova] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:27:01.244972 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:27:01.306168 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9526086f-8a75-4bb7-9d38-c962bfca371b admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:27:01.334456 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45fc52d-c43b-4fb2-adb7-078b8464a1e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:27:01.339864 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45fc52d-c43b-4fb2-adb7-078b8464a1e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:01.340145 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45fc52d-c43b-4fb2-adb7-078b8464a1e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:01.340420 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45fc52d-c43b-4fb2-adb7-078b8464a1e7 admin admin] PATH_INFO: `/v3/projects/2a0deeb191954e428f227c0c0433495b/users/3b88ab0f80564b4f921bac03bd86bca9/roles/0688968254744e3f9913653cafea3091` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:01.403660 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abb9d65-0222-4995-a4df-fecdc9ee73be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:27:01.406188 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abb9d65-0222-4995-a4df-fecdc9ee73be admin admin] REQUEST_METHOD: `PUT` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:01.407155 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45fc52d-c43b-4fb2-adb7-078b8464a1e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a0deeb191954e428f227c0c0433495b, user_id=3b88ab0f80564b4f921bac03bd86bca9, role_id=0688968254744e3f9913653cafea3091)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:27:01.407724 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abb9d65-0222-4995-a4df-fecdc9ee73be admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:01.411854 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abb9d65-0222-4995-a4df-fecdc9ee73be admin admin] PATH_INFO: `/v3/projects/10516712e25445489ebafe2fdda1741c/users/2796d696867b4b23a14dac5a688f08b5/roles/0688968254744e3f9913653cafea3091` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:01.414294 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45fc52d-c43b-4fb2-adb7-078b8464a1e7 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:27:01.442247 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 874/1725] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 16 12:27:00 2022] PUT /identity/v3/projects/2a0deeb191954e428f227c0c0433495b/users/3b88ab0f80564b4f921bac03bd86bca9/roles/0688968254744e3f9913653cafea3091 => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:27:01.447592 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45fc52d-c43b-4fb2-adb7-078b8464a1e7 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:27:01.494197 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abb9d65-0222-4995-a4df-fecdc9ee73be admin admin] RBAC: Authorizing `identity:create_grant(project_id=10516712e25445489ebafe2fdda1741c, user_id=2796d696867b4b23a14dac5a688f08b5, role_id=0688968254744e3f9913653cafea3091)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:27:01.506301 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:27:01.521049 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abb9d65-0222-4995-a4df-fecdc9ee73be admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:27:01.573124 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 852/1726] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 16 12:27:00 2022] PUT /identity/v3/projects/10516712e25445489ebafe2fdda1741c/users/2796d696867b4b23a14dac5a688f08b5/roles/0688968254744e3f9913653cafea3091 => generated 0 bytes in 632 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:27:01.577194 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abb9d65-0222-4995-a4df-fecdc9ee73be admin admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:27:01.583830 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-5abb9d65-0222-4995-a4df-fecdc9ee73be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:27:01.612283 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45fc52d-c43b-4fb2-adb7-078b8464a1e7 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:27:01.798465 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abb9d65-0222-4995-a4df-fecdc9ee73be admin admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:27:01.816328 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c329192-786d-4da4-b7f7-ba263de7fac2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:27:01.819834 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c329192-786d-4da4-b7f7-ba263de7fac2 admin admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:01.820183 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c329192-786d-4da4-b7f7-ba263de7fac2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:01.820506 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c329192-786d-4da4-b7f7-ba263de7fac2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:01.821321 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c329192-786d-4da4-b7f7-ba263de7fac2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:27:01.828706 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c329192-786d-4da4-b7f7-ba263de7fac2 admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:27:01.843347 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65bc856-4812-4456-be8d-ef04cf745517 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:27:01.845522 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65bc856-4812-4456-be8d-ef04cf745517 admin admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:01.849364 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65bc856-4812-4456-be8d-ef04cf745517 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:01.849653 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65bc856-4812-4456-be8d-ef04cf745517 admin admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:01.852131 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 853/1727] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 12:27:01 2022] GET /identity/v3/roles => generated 1420 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 12:27:01.854384 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65bc856-4812-4456-be8d-ef04cf745517 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:27:01.855451 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c329192-786d-4da4-b7f7-ba263de7fac2 admin admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:27:01.864121 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65bc856-4812-4456-be8d-ef04cf745517 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:27:01.879414 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c329192-786d-4da4-b7f7-ba263de7fac2 admin admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:27:01.896376 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1a9d47-ddb2-4b6c-893c-602bd6925b55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:27:01.898424 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1a9d47-ddb2-4b6c-893c-602bd6925b55 admin admin] REQUEST_METHOD: `PUT` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:01.900738 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1a9d47-ddb2-4b6c-893c-602bd6925b55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:01.901216 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1a9d47-ddb2-4b6c-893c-602bd6925b55 admin admin] PATH_INFO: `/v3/projects/10516712e25445489ebafe2fdda1741c/users/2796d696867b4b23a14dac5a688f08b5/roles/0688968254744e3f9913653cafea3091` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:01.903919 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1a9d47-ddb2-4b6c-893c-602bd6925b55 admin admin] RBAC: Authorizing `identity:create_grant(project_id=10516712e25445489ebafe2fdda1741c, user_id=2796d696867b4b23a14dac5a688f08b5, role_id=0688968254744e3f9913653cafea3091)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:27:01.908074 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1a9d47-ddb2-4b6c-893c-602bd6925b55 admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:27:01.925170 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 854/1728] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 16 12:27:01 2022] PUT /identity/v3/projects/10516712e25445489ebafe2fdda1741c/users/2796d696867b4b23a14dac5a688f08b5/roles/0688968254744e3f9913653cafea3091 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:27:01.926295 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1a9d47-ddb2-4b6c-893c-602bd6925b55 admin admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:27:01.928179 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-7f1a9d47-ddb2-4b6c-893c-602bd6925b55 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:27:01.935182 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 875/1729] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 12:27:01 2022] GET /identity/v3/roles => generated 1420 bytes in 489 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 12:27:01.937786 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf645202-0ed6-416f-98c7-1c26126d163b None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:01.946959 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf645202-0ed6-416f-98c7-1c26126d163b None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:01.947458 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf645202-0ed6-416f-98c7-1c26126d163b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:02.036931 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1a9d47-ddb2-4b6c-893c-602bd6925b55 admin admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:27:02.044109 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc6f340-c9a6-43c8-a4a5-6e46b382757d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:27:02.045254 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc6f340-c9a6-43c8-a4a5-6e46b382757d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:02.045680 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc6f340-c9a6-43c8-a4a5-6e46b382757d admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:02.046018 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc6f340-c9a6-43c8-a4a5-6e46b382757d admin admin] PATH_INFO: `/v3/projects/27abe244b0b44d84a3ed4144aecb6ada` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:02.047770 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc6f340-c9a6-43c8-a4a5-6e46b382757d admin admin] RBAC: Authorizing `identity:delete_project(project_id=27abe244b0b44d84a3ed4144aecb6ada)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:27:02.050175 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc6f340-c9a6-43c8-a4a5-6e46b382757d admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:27:02.099037 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-bf645202-0ed6-416f-98c7-1c26126d163b None None] MFA Rules not processed for user `2796d696867b4b23a14dac5a688f08b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:27:02.100436 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-bf645202-0ed6-416f-98c7-1c26126d163b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:27:02.138407 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:27:02.160503 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-5dc6f340-c9a6-43c8-a4a5-6e46b382757d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '27abe244b0b44d84a3ed4144aecb6ada', 'request_id': 'req-5dc6f340-c9a6-43c8-a4a5-6e46b382757d'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:27:02.180311 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-5dc6f340-c9a6-43c8-a4a5-6e46b382757d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '27abe244b0b44d84a3ed4144aecb6ada', 'request_id': 'req-5dc6f340-c9a6-43c8-a4a5-6e46b382757d'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:27:02.190074 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-5dc6f340-c9a6-43c8-a4a5-6e46b382757d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '27abe244b0b44d84a3ed4144aecb6ada', 'request_id': 'req-5dc6f340-c9a6-43c8-a4a5-6e46b382757d'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:27:02.213957 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-5dc6f340-c9a6-43c8-a4a5-6e46b382757d admin admin] The token cache is being invalidate because project 27abe244b0b44d84a3ed4144aecb6ada was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 12:27:02.214487 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-5dc6f340-c9a6-43c8-a4a5-6e46b382757d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:27:02.216618 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-5dc6f340-c9a6-43c8-a4a5-6e46b382757d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:27:02.224057 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 855/1730] 10.222.0.44 () {58 vars in 1232 bytes} [Thu Jun 16 12:27:01 2022] DELETE /identity/v3/projects/27abe244b0b44d84a3ed4144aecb6ada => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:27:02.225219 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc6f340-c9a6-43c8-a4a5-6e46b382757d admin admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:27:02.232464 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-5dc6f340-c9a6-43c8-a4a5-6e46b382757d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:27:02.355710 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 876/1731] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 12:27:01 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 419 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:27:02.359793 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7f1000-0aef-464b-ae5a-4dbf4dd29349 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:02.359793 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7f1000-0aef-464b-ae5a-4dbf4dd29349 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:02.359793 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7f1000-0aef-464b-ae5a-4dbf4dd29349 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:02.414836 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc6f340-c9a6-43c8-a4a5-6e46b382757d admin admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:27:02.423419 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f10659-0ffc-4ea6-b929-cd98f1b4087c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:27:02.425091 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f10659-0ffc-4ea6-b929-cd98f1b4087c admin admin] REQUEST_METHOD: `PUT` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:02.425708 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f10659-0ffc-4ea6-b929-cd98f1b4087c admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:02.427516 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f10659-0ffc-4ea6-b929-cd98f1b4087c admin admin] PATH_INFO: `/v3/projects/2a0deeb191954e428f227c0c0433495b/users/3b88ab0f80564b4f921bac03bd86bca9/roles/0688968254744e3f9913653cafea3091` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:02.438161 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f10659-0ffc-4ea6-b929-cd98f1b4087c admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a0deeb191954e428f227c0c0433495b, user_id=3b88ab0f80564b4f921bac03bd86bca9, role_id=0688968254744e3f9913653cafea3091)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:27:02.443264 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f10659-0ffc-4ea6-b929-cd98f1b4087c admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:27:02.447166 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-6b7f1000-0aef-464b-ae5a-4dbf4dd29349 None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:27:02.448388 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-6b7f1000-0aef-464b-ae5a-4dbf4dd29349 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:27:02.460386 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 856/1732] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 16 12:27:02 2022] PUT /identity/v3/projects/2a0deeb191954e428f227c0c0433495b/users/3b88ab0f80564b4f921bac03bd86bca9/roles/0688968254744e3f9913653cafea3091 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:27:02.462617 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5972eae-c65a-4eec-9899-4bc3b51418dd None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:02.463078 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5972eae-c65a-4eec-9899-4bc3b51418dd None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:02.463512 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5972eae-c65a-4eec-9899-4bc3b51418dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:02.494501 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-d5972eae-c65a-4eec-9899-4bc3b51418dd None None] MFA Rules not processed for user `e1094729b25a4be7b0b394998c9ca681`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:27:02.498508 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-d5972eae-c65a-4eec-9899-4bc3b51418dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:27:02.560994 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:27:02.614385 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 857/1733] 10.222.0.16 () {58 vars in 1015 bytes} [Thu Jun 16 12:27:02 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:27:02.615756 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414ae98b-3a60-4b2e-b1a7-4bafc1a523ee None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:02.616048 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414ae98b-3a60-4b2e-b1a7-4bafc1a523ee None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:02.616412 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414ae98b-3a60-4b2e-b1a7-4bafc1a523ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:02.629982 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 877/1734] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 12:27:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:27:02.630795 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7f1000-0aef-464b-ae5a-4dbf4dd29349 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:27:02.633441 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-6b7f1000-0aef-464b-ae5a-4dbf4dd29349 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:27:02.692449 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-414ae98b-3a60-4b2e-b1a7-4bafc1a523ee None None] MFA Rules not processed for user `dcb0b632b30649609216933c50f287b9`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:27:02.697364 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-414ae98b-3a60-4b2e-b1a7-4bafc1a523ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:27:02.842045 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7f1000-0aef-464b-ae5a-4dbf4dd29349 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:27:02.848076 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0cce30-7498-4b0e-a121-71f35977870a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f96fc14ed89478c8a8c2f11c87511e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '601361df39e34fcca71175aa94e425c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:27:02.849006 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0cce30-7498-4b0e-a121-71f35977870a service cinder] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:02.849378 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0cce30-7498-4b0e-a121-71f35977870a service cinder] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:02.849814 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0cce30-7498-4b0e-a121-71f35977870a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:02.979285 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0cce30-7498-4b0e-a121-71f35977870a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:27:02.985464 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0cce30-7498-4b0e-a121-71f35977870a service cinder] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:27:02.995548 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:27:03.026840 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 858/1735] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 12:27:02 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 409 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:27:03.026840 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf37534b-cef5-4af8-924a-c15b884eae48 None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:03.026840 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf37534b-cef5-4af8-924a-c15b884eae48 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:03.026840 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf37534b-cef5-4af8-924a-c15b884eae48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:03.036627 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 878/1736] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 12:27:02 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 12:27:03.039118 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0cce30-7498-4b0e-a121-71f35977870a service cinder] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:27:03.043011 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-fc0cce30-7498-4b0e-a121-71f35977870a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:27:03.093660 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0cce30-7498-4b0e-a121-71f35977870a service cinder] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:27:03.111548 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8caee51a-3b42-4e20-a328-57fcae32938d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1094729b25a4be7b0b394998c9ca681', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '601361df39e34fcca71175aa94e425c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:27:03.113485 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caee51a-3b42-4e20-a328-57fcae32938d service neutron] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:03.114282 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caee51a-3b42-4e20-a328-57fcae32938d service neutron] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:03.127104 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caee51a-3b42-4e20-a328-57fcae32938d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:03.137961 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-cf37534b-cef5-4af8-924a-c15b884eae48 None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:27:03.142920 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-cf37534b-cef5-4af8-924a-c15b884eae48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:27:03.156230 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8caee51a-3b42-4e20-a328-57fcae32938d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:27:03.159447 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8caee51a-3b42-4e20-a328-57fcae32938d service neutron] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:27:03.169059 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 859/1737] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 12:27:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:27:03.169059 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf37534b-cef5-4af8-924a-c15b884eae48 None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:27:03.173711 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-cf37534b-cef5-4af8-924a-c15b884eae48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:27:03.194597 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 879/1738] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 12:27:03 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 12:27:03.198380 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8caee51a-3b42-4e20-a328-57fcae32938d service neutron] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:27:03.262956 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8caee51a-3b42-4e20-a328-57fcae32938d service neutron] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:27:03.290903 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0093f6f8-86be-4e52-a658-4199b489bce7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:27:03.296536 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0093f6f8-86be-4e52-a658-4199b489bce7 admin admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:03.297977 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0093f6f8-86be-4e52-a658-4199b489bce7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:03.302701 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0093f6f8-86be-4e52-a658-4199b489bce7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:03.307434 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0093f6f8-86be-4e52-a658-4199b489bce7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:27:03.307784 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0093f6f8-86be-4e52-a658-4199b489bce7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:27:03.320644 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0093f6f8-86be-4e52-a658-4199b489bce7 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:27:03.390117 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 880/1739] 10.222.0.44 () {58 vars in 1152 bytes} [Thu Jun 16 12:27:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:27:03.394250 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0093f6f8-86be-4e52-a658-4199b489bce7 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:27:03.404173 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-0093f6f8-86be-4e52-a658-4199b489bce7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:27:03.458305 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0093f6f8-86be-4e52-a658-4199b489bce7 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:27:03.499112 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf520e2-1e33-4b2d-afde-7ed5b15c2643 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:27:03.500008 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf520e2-1e33-4b2d-afde-7ed5b15c2643 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:03.500280 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf520e2-1e33-4b2d-afde-7ed5b15c2643 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:03.500548 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf520e2-1e33-4b2d-afde-7ed5b15c2643 admin admin] PATH_INFO: `/v3/users/8d68e44571e24092ae2e48387be674a2` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:03.513916 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf520e2-1e33-4b2d-afde-7ed5b15c2643 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8d68e44571e24092ae2e48387be674a2)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:27:03.516052 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf520e2-1e33-4b2d-afde-7ed5b15c2643 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:27:03.605702 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf37534b-cef5-4af8-924a-c15b884eae48 None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:27:03.639355 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8006fc4f-1409-45fe-a36a-6d7b71ce74de service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edfb12d445e74136b90800e93941f468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '601361df39e34fcca71175aa94e425c4', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:27:03.642341 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8006fc4f-1409-45fe-a36a-6d7b71ce74de service nova] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:03.642933 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8006fc4f-1409-45fe-a36a-6d7b71ce74de service nova] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:03.643226 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8006fc4f-1409-45fe-a36a-6d7b71ce74de service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:03.684362 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-adf520e2-1e33-4b2d-afde-7ed5b15c2643 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8d68e44571e24092ae2e48387be674a2'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:27:03.685468 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-adf520e2-1e33-4b2d-afde-7ed5b15c2643 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8d68e44571e24092ae2e48387be674a2'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:27:03.706560 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-adf520e2-1e33-4b2d-afde-7ed5b15c2643 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8d68e44571e24092ae2e48387be674a2'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:27:03.707356 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-adf520e2-1e33-4b2d-afde-7ed5b15c2643 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8d68e44571e24092ae2e48387be674a2'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:27:03.708303 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8006fc4f-1409-45fe-a36a-6d7b71ce74de service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:27:03.716992 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8006fc4f-1409-45fe-a36a-6d7b71ce74de service nova] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:27:03.721943 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-adf520e2-1e33-4b2d-afde-7ed5b15c2643 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8d68e44571e24092ae2e48387be674a2'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:27:03.730368 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:27:03.740770 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 860/1740] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 12:27:03 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 574 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 12:27:03.761071 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8006fc4f-1409-45fe-a36a-6d7b71ce74de service nova] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:27:03.776446 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 881/1741] 10.222.0.44 () {58 vars in 1223 bytes} [Thu Jun 16 12:27:03 2022] DELETE /identity/v3/users/8d68e44571e24092ae2e48387be674a2 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:27:03.778475 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda8da54-0249-45ac-8713-fb1fb265479b None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:03.778907 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda8da54-0249-45ac-8713-fb1fb265479b None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:03.779361 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda8da54-0249-45ac-8713-fb1fb265479b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:03.826249 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8006fc4f-1409-45fe-a36a-6d7b71ce74de service nova] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:27:03.832700 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-fda8da54-0249-45ac-8713-fb1fb265479b None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:27:03.835591 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-fda8da54-0249-45ac-8713-fb1fb265479b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:27:04.052637 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080f35b8-834c-45bb-bb53-c1ecd31d97c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:27:04.055662 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080f35b8-834c-45bb-bb53-c1ecd31d97c0 admin admin] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:04.055949 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080f35b8-834c-45bb-bb53-c1ecd31d97c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:04.057233 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080f35b8-834c-45bb-bb53-c1ecd31d97c0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:04.057972 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080f35b8-834c-45bb-bb53-c1ecd31d97c0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:27:04.072232 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080f35b8-834c-45bb-bb53-c1ecd31d97c0 admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:27:04.096721 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 882/1742] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 12:27:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 319 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:27:04.193167 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda8da54-0249-45ac-8713-fb1fb265479b None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:27:04.193354 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 861/1743] 10.222.0.44 () {60 vars in 1152 bytes} [Thu Jun 16 12:27:03 2022] POST /identity/v3/projects => generated 385 bytes in 433 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 12:27:04.194793 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-fda8da54-0249-45ac-8713-fb1fb265479b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:27:04.225325 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda8da54-0249-45ac-8713-fb1fb265479b None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:27:04.228228 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080f35b8-834c-45bb-bb53-c1ecd31d97c0 admin admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:27:04.230137 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-080f35b8-834c-45bb-bb53-c1ecd31d97c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:27:04.521621 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080f35b8-834c-45bb-bb53-c1ecd31d97c0 admin admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:27:04.530869 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fca8869-801c-46c7-8ce6-f8555edfee01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:27:04.531571 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fca8869-801c-46c7-8ce6-f8555edfee01 admin admin] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:04.531842 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fca8869-801c-46c7-8ce6-f8555edfee01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:04.532116 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fca8869-801c-46c7-8ce6-f8555edfee01 admin admin] PATH_INFO: `/v3/users` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:04.535141 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c6939c-6340-4b8d-9eea-4d7201ecb24d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1094729b25a4be7b0b394998c9ca681', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '601361df39e34fcca71175aa94e425c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:27:04.535775 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c6939c-6340-4b8d-9eea-4d7201ecb24d service neutron] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:04.536321 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c6939c-6340-4b8d-9eea-4d7201ecb24d service neutron] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:04.538428 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fca8869-801c-46c7-8ce6-f8555edfee01 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:27:04.541011 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fca8869-801c-46c7-8ce6-f8555edfee01 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:27:04.545513 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c6939c-6340-4b8d-9eea-4d7201ecb24d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:04.577498 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c6939c-6340-4b8d-9eea-4d7201ecb24d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:27:04.582230 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c6939c-6340-4b8d-9eea-4d7201ecb24d service neutron] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:27:04.611177 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 883/1744] 10.222.0.44 () {60 vars in 1143 bytes} [Thu Jun 16 12:27:04 2022] POST /identity/v3/users => generated 293 bytes in 416 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 12:27:04.611374 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 862/1745] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 12:27:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 12:27:04.612852 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fca8869-801c-46c7-8ce6-f8555edfee01 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:27:04.650436 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fca8869-801c-46c7-8ce6-f8555edfee01 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:27:04.686335 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6299f3-bc79-46fd-b1b7-e6adca4d5bbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:27:04.689614 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6299f3-bc79-46fd-b1b7-e6adca4d5bbe admin admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:04.693834 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6299f3-bc79-46fd-b1b7-e6adca4d5bbe admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:04.694570 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6299f3-bc79-46fd-b1b7-e6adca4d5bbe admin admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:04.697185 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6299f3-bc79-46fd-b1b7-e6adca4d5bbe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:27:04.701660 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6299f3-bc79-46fd-b1b7-e6adca4d5bbe admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:27:04.729114 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 884/1746] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 12:27:04 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 12:27:04.733638 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c6939c-6340-4b8d-9eea-4d7201ecb24d service neutron] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:27:04.760569 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c6939c-6340-4b8d-9eea-4d7201ecb24d service neutron] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:27:04.791150 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91ed255-a9a0-41de-a40e-f950e8ecfe7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:27:04.792380 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91ed255-a9a0-41de-a40e-f950e8ecfe7d admin admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:04.792923 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91ed255-a9a0-41de-a40e-f950e8ecfe7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:04.794166 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91ed255-a9a0-41de-a40e-f950e8ecfe7d admin admin] PATH_INFO: `/v3/roles` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:04.795808 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91ed255-a9a0-41de-a40e-f950e8ecfe7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:27:04.804049 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91ed255-a9a0-41de-a40e-f950e8ecfe7d admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:27:04.807943 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:27:04.850334 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 863/1747] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 12:27:04 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 12:27:04.854176 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6299f3-bc79-46fd-b1b7-e6adca4d5bbe admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:27:04.874833 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6299f3-bc79-46fd-b1b7-e6adca4d5bbe admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:27:04.902585 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b157e80-097e-4711-88ef-18394dc453b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:27:04.904557 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b157e80-097e-4711-88ef-18394dc453b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:04.920108 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b157e80-097e-4711-88ef-18394dc453b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:04.920108 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b157e80-097e-4711-88ef-18394dc453b6 admin admin] PATH_INFO: `/v3/projects/f294dd1a62034cf685327ee304493851/users/b5515f2e0c834e8e9b1bb4eda07feb70/roles/c39882b202e942479a7cdac2fc6da72c` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:05.017218 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b157e80-097e-4711-88ef-18394dc453b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f294dd1a62034cf685327ee304493851, user_id=b5515f2e0c834e8e9b1bb4eda07feb70, role_id=c39882b202e942479a7cdac2fc6da72c)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:27:05.021211 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b157e80-097e-4711-88ef-18394dc453b6 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:27:05.090872 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 885/1748] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 16 12:27:04 2022] PUT /identity/v3/projects/f294dd1a62034cf685327ee304493851/users/b5515f2e0c834e8e9b1bb4eda07feb70/roles/c39882b202e942479a7cdac2fc6da72c => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:27:05.103022 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3341da-4b34-4560-9c8e-267b65be297e None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:05.103674 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3341da-4b34-4560-9c8e-267b65be297e None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:05.104252 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3341da-4b34-4560-9c8e-267b65be297e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:05.224416 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-1a3341da-4b34-4560-9c8e-267b65be297e None None] MFA Rules not processed for user `b5515f2e0c834e8e9b1bb4eda07feb70`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:27:05.227800 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-1a3341da-4b34-4560-9c8e-267b65be297e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:27:05.651926 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 864/1749] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 12:27:05 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 551 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:27:05.669974 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b157e80-097e-4711-88ef-18394dc453b6 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:27:05.826377 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:27:05.927885 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b157e80-097e-4711-88ef-18394dc453b6 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:27:05.939394 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8dc272-024f-4b2b-a75a-8b88a179d62c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:27:05.940738 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8dc272-024f-4b2b-a75a-8b88a179d62c admin admin] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:05.941984 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8dc272-024f-4b2b-a75a-8b88a179d62c admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:05.942679 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8dc272-024f-4b2b-a75a-8b88a179d62c admin admin] PATH_INFO: `/v3/projects` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:05.944399 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8dc272-024f-4b2b-a75a-8b88a179d62c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:27:05.947601 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8dc272-024f-4b2b-a75a-8b88a179d62c admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:27:06.129276 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 886/1750] 10.222.0.44 () {60 vars in 1152 bytes} [Thu Jun 16 12:27:05 2022] POST /identity/v3/projects => generated 387 bytes in 460 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 12:27:06.134087 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3341da-4b34-4560-9c8e-267b65be297e None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:27:06.171563 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3341da-4b34-4560-9c8e-267b65be297e None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:27:06.365316 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18a88f6-603f-4065-b301-a92b00cd3b2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:27:06.366123 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18a88f6-603f-4065-b301-a92b00cd3b2a admin admin] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:06.366512 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18a88f6-603f-4065-b301-a92b00cd3b2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:06.367040 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18a88f6-603f-4065-b301-a92b00cd3b2a admin admin] PATH_INFO: `/v3/users` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:06.367772 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18a88f6-603f-4065-b301-a92b00cd3b2a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:27:06.371446 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18a88f6-603f-4065-b301-a92b00cd3b2a admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:27:06.417217 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 865/1751] 10.222.0.44 () {60 vars in 1143 bytes} [Thu Jun 16 12:27:06 2022] POST /identity/v3/users => generated 300 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 12:27:06.421005 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8dc272-024f-4b2b-a75a-8b88a179d62c admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:27:06.444201 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8dc272-024f-4b2b-a75a-8b88a179d62c admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:27:06.459327 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0829f3d9-67f2-49ef-9d2c-e6d2845701a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:27:06.463078 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0829f3d9-67f2-49ef-9d2c-e6d2845701a9 admin admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:06.464079 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0829f3d9-67f2-49ef-9d2c-e6d2845701a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:06.464628 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0829f3d9-67f2-49ef-9d2c-e6d2845701a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:06.468148 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0829f3d9-67f2-49ef-9d2c-e6d2845701a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:27:06.472035 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0829f3d9-67f2-49ef-9d2c-e6d2845701a9 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:27:06.500679 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18a88f6-603f-4065-b301-a92b00cd3b2a admin admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:27:06.512568 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 887/1752] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 12:27:06 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 12:27:06.516152 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18a88f6-603f-4065-b301-a92b00cd3b2a admin admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:27:06.540798 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d758f572-0229-42da-ad83-f86ce0d177a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:27:06.542245 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d758f572-0229-42da-ad83-f86ce0d177a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:06.542771 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d758f572-0229-42da-ad83-f86ce0d177a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:06.543479 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d758f572-0229-42da-ad83-f86ce0d177a0 admin admin] PATH_INFO: `/v3/projects/547eb60b6b49482cad0fd3c1918bf897/users/50d419c587ce42f38bae2b2fefd99d8f/roles/0688968254744e3f9913653cafea3091` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:06.595070 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d758f572-0229-42da-ad83-f86ce0d177a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=547eb60b6b49482cad0fd3c1918bf897, user_id=50d419c587ce42f38bae2b2fefd99d8f, role_id=0688968254744e3f9913653cafea3091)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:27:06.598633 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d758f572-0229-42da-ad83-f86ce0d177a0 admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:27:06.623437 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 866/1753] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 16 12:27:06 2022] PUT /identity/v3/projects/547eb60b6b49482cad0fd3c1918bf897/users/50d419c587ce42f38bae2b2fefd99d8f/roles/0688968254744e3f9913653cafea3091 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 12:27:06.627122 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0829f3d9-67f2-49ef-9d2c-e6d2845701a9 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:27:06.649835 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0829f3d9-67f2-49ef-9d2c-e6d2845701a9 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:27:07.019660 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3f3671-886d-4225-86cc-f30aa1f9b1b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:27:07.020402 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3f3671-886d-4225-86cc-f30aa1f9b1b3 admin admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:07.020743 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3f3671-886d-4225-86cc-f30aa1f9b1b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:07.021101 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3f3671-886d-4225-86cc-f30aa1f9b1b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:07.035808 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3f3671-886d-4225-86cc-f30aa1f9b1b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:27:07.037859 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3f3671-886d-4225-86cc-f30aa1f9b1b3 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:27:07.094741 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d758f572-0229-42da-ad83-f86ce0d177a0 admin admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:27:07.103419 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 888/1754] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 12:27:06 2022] GET /identity/v3/roles => generated 1420 bytes in 477 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 12:27:07.116423 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d758f572-0229-42da-ad83-f86ce0d177a0 admin admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:27:07.150940 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452d00ed-b082-487d-98ec-5c3e00448b2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:27:07.153164 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452d00ed-b082-487d-98ec-5c3e00448b2d admin admin] REQUEST_METHOD: `PUT` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:07.153607 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452d00ed-b082-487d-98ec-5c3e00448b2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:07.154068 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452d00ed-b082-487d-98ec-5c3e00448b2d admin admin] PATH_INFO: `/v3/projects/547eb60b6b49482cad0fd3c1918bf897/users/50d419c587ce42f38bae2b2fefd99d8f/roles/0688968254744e3f9913653cafea3091` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:07.173373 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452d00ed-b082-487d-98ec-5c3e00448b2d admin admin] RBAC: Authorizing `identity:create_grant(project_id=547eb60b6b49482cad0fd3c1918bf897, user_id=50d419c587ce42f38bae2b2fefd99d8f, role_id=0688968254744e3f9913653cafea3091)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:27:07.176112 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452d00ed-b082-487d-98ec-5c3e00448b2d admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:27:07.221941 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 867/1755] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 16 12:27:07 2022] PUT /identity/v3/projects/547eb60b6b49482cad0fd3c1918bf897/users/50d419c587ce42f38bae2b2fefd99d8f/roles/0688968254744e3f9913653cafea3091 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:27:07.241573 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4098d82b-b8b9-4ae1-8d5b-54816c2a6777 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:07.242061 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4098d82b-b8b9-4ae1-8d5b-54816c2a6777 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:07.242167 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4098d82b-b8b9-4ae1-8d5b-54816c2a6777 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:07.333941 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-4098d82b-b8b9-4ae1-8d5b-54816c2a6777 None None] MFA Rules not processed for user `50d419c587ce42f38bae2b2fefd99d8f`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:27:07.337258 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-4098d82b-b8b9-4ae1-8d5b-54816c2a6777 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:27:07.490785 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f4436b-3bd2-4b3f-8bb9-00277ffc35d4 None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:07.491573 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f4436b-3bd2-4b3f-8bb9-00277ffc35d4 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:07.492584 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f4436b-3bd2-4b3f-8bb9-00277ffc35d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:07.568177 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-a2f4436b-3bd2-4b3f-8bb9-00277ffc35d4 None None] MFA Rules not processed for user `3b88ab0f80564b4f921bac03bd86bca9`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:27:07.570116 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-a2f4436b-3bd2-4b3f-8bb9-00277ffc35d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:27:07.651258 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:27:07.666279 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 889/1756] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 12:27:07 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 426 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:27:07.806354 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4098d82b-b8b9-4ae1-8d5b-54816c2a6777 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:27:07.806354 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-4098d82b-b8b9-4ae1-8d5b-54816c2a6777 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:27:07.911861 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 868/1757] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 12:27:07 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 417 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:27:07.947626 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:27:08.024483 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4098d82b-b8b9-4ae1-8d5b-54816c2a6777 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:27:08.037223 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9cfc17-f8a0-40ff-9505-fffbffcfb9ca service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f96fc14ed89478c8a8c2f11c87511e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '601361df39e34fcca71175aa94e425c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:27:08.037223 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9cfc17-f8a0-40ff-9505-fffbffcfb9ca service cinder] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:08.037670 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9cfc17-f8a0-40ff-9505-fffbffcfb9ca service cinder] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:08.038179 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9cfc17-f8a0-40ff-9505-fffbffcfb9ca service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:08.078153 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9cfc17-f8a0-40ff-9505-fffbffcfb9ca service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:27:08.082028 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9cfc17-f8a0-40ff-9505-fffbffcfb9ca service cinder] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:27:08.130209 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 890/1758] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 12:27:07 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 12:27:09.434241 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f4436b-3bd2-4b3f-8bb9-00277ffc35d4 None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:27:09.444047 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-a2f4436b-3bd2-4b3f-8bb9-00277ffc35d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:27:09.812192 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f4436b-3bd2-4b3f-8bb9-00277ffc35d4 None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:27:09.828276 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af58a23a-abdf-42b9-9d54-8e7932325e89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:27:09.829204 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af58a23a-abdf-42b9-9d54-8e7932325e89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:09.836357 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af58a23a-abdf-42b9-9d54-8e7932325e89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:09.836688 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af58a23a-abdf-42b9-9d54-8e7932325e89 admin admin] PATH_INFO: `/v3/projects/0f59fda8e45d4ff8b6ab57a59655b8b6` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:09.842484 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af58a23a-abdf-42b9-9d54-8e7932325e89 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0f59fda8e45d4ff8b6ab57a59655b8b6)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:27:09.852778 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af58a23a-abdf-42b9-9d54-8e7932325e89 admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:27:10.078598 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-af58a23a-abdf-42b9-9d54-8e7932325e89 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0f59fda8e45d4ff8b6ab57a59655b8b6', 'request_id': 'req-af58a23a-abdf-42b9-9d54-8e7932325e89'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:27:10.105356 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-af58a23a-abdf-42b9-9d54-8e7932325e89 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0f59fda8e45d4ff8b6ab57a59655b8b6', 'request_id': 'req-af58a23a-abdf-42b9-9d54-8e7932325e89'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:27:10.132969 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-af58a23a-abdf-42b9-9d54-8e7932325e89 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0f59fda8e45d4ff8b6ab57a59655b8b6', 'request_id': 'req-af58a23a-abdf-42b9-9d54-8e7932325e89'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:27:10.195843 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-af58a23a-abdf-42b9-9d54-8e7932325e89 admin admin] The token cache is being invalidate because project 0f59fda8e45d4ff8b6ab57a59655b8b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 12:27:10.205884 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-af58a23a-abdf-42b9-9d54-8e7932325e89 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:27:10.206896 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-af58a23a-abdf-42b9-9d54-8e7932325e89 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:27:10.216192 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 869/1759] 10.222.0.44 () {58 vars in 1232 bytes} [Thu Jun 16 12:27:09 2022] DELETE /identity/v3/projects/0f59fda8e45d4ff8b6ab57a59655b8b6 => generated 0 bytes in 779 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:27:10.217519 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9cfc17-f8a0-40ff-9505-fffbffcfb9ca service cinder] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:27:10.250542 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9cfc17-f8a0-40ff-9505-fffbffcfb9ca service cinder] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:27:10.296600 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af58a23a-abdf-42b9-9d54-8e7932325e89 admin admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:27:10.300963 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-af58a23a-abdf-42b9-9d54-8e7932325e89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:27:10.496842 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:27:10.500852 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de15cded-76f7-4338-9397-a784e0a94417 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:27:10.502040 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de15cded-76f7-4338-9397-a784e0a94417 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:10.503435 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de15cded-76f7-4338-9397-a784e0a94417 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:10.503989 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de15cded-76f7-4338-9397-a784e0a94417 admin admin] PATH_INFO: `/v3/users/2796d696867b4b23a14dac5a688f08b5` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:10.510165 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de15cded-76f7-4338-9397-a784e0a94417 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2796d696867b4b23a14dac5a688f08b5)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:27:10.512573 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de15cded-76f7-4338-9397-a784e0a94417 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:27:10.541804 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af58a23a-abdf-42b9-9d54-8e7932325e89 admin admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:27:10.557646 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552f6142-fbf1-4ca3-a646-26a48b03da20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:27:10.558746 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552f6142-fbf1-4ca3-a646-26a48b03da20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:10.559190 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552f6142-fbf1-4ca3-a646-26a48b03da20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:10.559757 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552f6142-fbf1-4ca3-a646-26a48b03da20 admin admin] PATH_INFO: `/v3/users/60837558214148d3ab487ea95b68e638` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:10.561697 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552f6142-fbf1-4ca3-a646-26a48b03da20 admin admin] RBAC: Authorizing `identity:delete_user(user_id=60837558214148d3ab487ea95b68e638)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:27:10.563975 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552f6142-fbf1-4ca3-a646-26a48b03da20 admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:27:10.624519 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-de15cded-76f7-4338-9397-a784e0a94417 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2796d696867b4b23a14dac5a688f08b5'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:27:10.624985 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-de15cded-76f7-4338-9397-a784e0a94417 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2796d696867b4b23a14dac5a688f08b5'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:27:10.648592 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-de15cded-76f7-4338-9397-a784e0a94417 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2796d696867b4b23a14dac5a688f08b5'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:27:10.649925 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-de15cded-76f7-4338-9397-a784e0a94417 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2796d696867b4b23a14dac5a688f08b5'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:27:10.668937 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-de15cded-76f7-4338-9397-a784e0a94417 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2796d696867b4b23a14dac5a688f08b5'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:27:10.718814 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 891/1760] 10.222.0.44 () {58 vars in 1223 bytes} [Thu Jun 16 12:27:10 2022] DELETE /identity/v3/users/2796d696867b4b23a14dac5a688f08b5 => generated 0 bytes in 498 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:27:10.724119 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-552f6142-fbf1-4ca3-a646-26a48b03da20 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '60837558214148d3ab487ea95b68e638'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:27:10.759888 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-552f6142-fbf1-4ca3-a646-26a48b03da20 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '60837558214148d3ab487ea95b68e638'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:27:10.784540 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-552f6142-fbf1-4ca3-a646-26a48b03da20 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '60837558214148d3ab487ea95b68e638'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:27:10.786968 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-552f6142-fbf1-4ca3-a646-26a48b03da20 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '60837558214148d3ab487ea95b68e638'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:27:10.788481 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-552f6142-fbf1-4ca3-a646-26a48b03da20 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '60837558214148d3ab487ea95b68e638'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:27:10.810847 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de15cded-76f7-4338-9397-a784e0a94417 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:27:10.813647 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-de15cded-76f7-4338-9397-a784e0a94417 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:27:10.829091 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 870/1761] 10.222.0.44 () {58 vars in 1223 bytes} [Thu Jun 16 12:27:10 2022] DELETE /identity/v3/users/60837558214148d3ab487ea95b68e638 => generated 0 bytes in 533 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:27:10.834289 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad665f7-d577-41cb-80af-629d210a3e36 None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:10.845790 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad665f7-d577-41cb-80af-629d210a3e36 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:10.846235 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad665f7-d577-41cb-80af-629d210a3e36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:10.886321 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-0ad665f7-d577-41cb-80af-629d210a3e36 None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:27:10.887793 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-0ad665f7-d577-41cb-80af-629d210a3e36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:27:11.042360 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:27:11.057178 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 871/1762] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 12:27:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:27:11.062707 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de15cded-76f7-4338-9397-a784e0a94417 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:27:11.078912 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cf6ea3-a604-40e1-8392-eb80aecab9b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:27:11.083800 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cf6ea3-a604-40e1-8392-eb80aecab9b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:11.084255 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cf6ea3-a604-40e1-8392-eb80aecab9b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:11.084615 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cf6ea3-a604-40e1-8392-eb80aecab9b1 admin admin] PATH_INFO: `/v3/users/b5515f2e0c834e8e9b1bb4eda07feb70` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:11.086786 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cf6ea3-a604-40e1-8392-eb80aecab9b1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b5515f2e0c834e8e9b1bb4eda07feb70)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:27:11.092290 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cf6ea3-a604-40e1-8392-eb80aecab9b1 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:27:11.155823 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad665f7-d577-41cb-80af-629d210a3e36 None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:27:11.157419 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-0ad665f7-d577-41cb-80af-629d210a3e36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:27:11.271613 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-e5cf6ea3-a604-40e1-8392-eb80aecab9b1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b5515f2e0c834e8e9b1bb4eda07feb70'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:27:11.285240 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-e5cf6ea3-a604-40e1-8392-eb80aecab9b1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b5515f2e0c834e8e9b1bb4eda07feb70'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:27:11.297813 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad665f7-d577-41cb-80af-629d210a3e36 None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:27:11.304695 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-e5cf6ea3-a604-40e1-8392-eb80aecab9b1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b5515f2e0c834e8e9b1bb4eda07feb70'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:27:11.308715 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-e5cf6ea3-a604-40e1-8392-eb80aecab9b1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b5515f2e0c834e8e9b1bb4eda07feb70'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:27:11.308968 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9851cefc-9b66-4fc7-a0cb-b7692c63311e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1094729b25a4be7b0b394998c9ca681', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '601361df39e34fcca71175aa94e425c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:27:11.309708 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9851cefc-9b66-4fc7-a0cb-b7692c63311e service neutron] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:11.309994 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9851cefc-9b66-4fc7-a0cb-b7692c63311e service neutron] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:11.310269 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9851cefc-9b66-4fc7-a0cb-b7692c63311e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:11.316949 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-9851cefc-9b66-4fc7-a0cb-b7692c63311e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:27:11.329345 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-e5cf6ea3-a604-40e1-8392-eb80aecab9b1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b5515f2e0c834e8e9b1bb4eda07feb70'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:27:11.348878 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9851cefc-9b66-4fc7-a0cb-b7692c63311e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:27:11.350914 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9851cefc-9b66-4fc7-a0cb-b7692c63311e service neutron] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:27:11.375290 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 872/1763] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 12:27:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 12:27:11.383724 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 892/1764] 10.222.0.44 () {58 vars in 1223 bytes} [Thu Jun 16 12:27:10 2022] DELETE /identity/v3/users/b5515f2e0c834e8e9b1bb4eda07feb70 => generated 0 bytes in 574 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 12:27:11.388735 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8653f624-e7cb-423b-8045-c3b7028df4ca None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:11.390071 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8653f624-e7cb-423b-8045-c3b7028df4ca None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:11.390071 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8653f624-e7cb-423b-8045-c3b7028df4ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:11.415675 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-8653f624-e7cb-423b-8045-c3b7028df4ca None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:27:11.417244 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-8653f624-e7cb-423b-8045-c3b7028df4ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:27:11.432592 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:27:11.624609 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 873/1765] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 12:27:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:27:11.661521 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cf6ea3-a604-40e1-8392-eb80aecab9b1 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:27:11.665310 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-e5cf6ea3-a604-40e1-8392-eb80aecab9b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:27:11.740711 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5d172e-4ba4-433c-a416-97a47c32b3cd None None] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:11.741352 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5d172e-4ba4-433c-a416-97a47c32b3cd None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:11.742458 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5d172e-4ba4-433c-a416-97a47c32b3cd None None] PATH_INFO: `/` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:11.744935 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 874/1766] 10.222.0.44 () {54 vars in 921 bytes} [Thu Jun 16 12:27:11 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 12:27:11.758758 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd3546d-9113-42a5-9e33-1f2b6cd43113 None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:11.759193 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd3546d-9113-42a5-9e33-1f2b6cd43113 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:11.759564 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd3546d-9113-42a5-9e33-1f2b6cd43113 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:11.802543 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cf6ea3-a604-40e1-8392-eb80aecab9b1 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:27:11.809467 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-ffd3546d-9113-42a5-9e33-1f2b6cd43113 None None] MFA Rules not processed for user `8bff8ccf460a403d993c39327bbcbd29`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:27:11.815086 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-ffd3546d-9113-42a5-9e33-1f2b6cd43113 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:27:11.815608 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d4dc9a-ab34-47b0-ae9d-60adc699b5df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1094729b25a4be7b0b394998c9ca681', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '601361df39e34fcca71175aa94e425c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:27:11.817661 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d4dc9a-ab34-47b0-ae9d-60adc699b5df service neutron] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:11.818344 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d4dc9a-ab34-47b0-ae9d-60adc699b5df service neutron] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:11.819511 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d4dc9a-ab34-47b0-ae9d-60adc699b5df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:11.849596 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d4dc9a-ab34-47b0-ae9d-60adc699b5df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:27:11.856259 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d4dc9a-ab34-47b0-ae9d-60adc699b5df service neutron] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:27:11.888044 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 893/1767] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 12:27:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 12:27:11.967884 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 875/1768] 10.222.0.44 () {58 vars in 1018 bytes} [Thu Jun 16 12:27:11 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:27:12.072667 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d4dc9a-ab34-47b0-ae9d-60adc699b5df service neutron] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:27:12.074411 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-70d4dc9a-ab34-47b0-ae9d-60adc699b5df service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:27:12.102950 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d4dc9a-ab34-47b0-ae9d-60adc699b5df service neutron] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:27:12.119011 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e717186f-5349-4bed-ab4a-ec5d2b4b95a3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8bff8ccf460a403d993c39327bbcbd29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '601361df39e34fcca71175aa94e425c4', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:27:12.119997 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e717186f-5349-4bed-ab4a-ec5d2b4b95a3 service placement] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:12.120436 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e717186f-5349-4bed-ab4a-ec5d2b4b95a3 service placement] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:12.120855 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e717186f-5349-4bed-ab4a-ec5d2b4b95a3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:12.134007 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e717186f-5349-4bed-ab4a-ec5d2b4b95a3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:27:12.138974 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e717186f-5349-4bed-ab4a-ec5d2b4b95a3 service placement] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:27:12.167820 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 894/1769] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 12:27:12 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 12:27:12.512400 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb63037-ae18-4e3c-8425-83bbe0849046 None None] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:12.513588 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb63037-ae18-4e3c-8425-83bbe0849046 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:12.514136 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb63037-ae18-4e3c-8425-83bbe0849046 None None] PATH_INFO: `/` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:12.516373 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 876/1770] 10.222.0.44 () {54 vars in 921 bytes} [Thu Jun 16 12:27:12 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 12:27:12.568709 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e717186f-5349-4bed-ab4a-ec5d2b4b95a3 service placement] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:27:12.571123 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-e717186f-5349-4bed-ab4a-ec5d2b4b95a3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:27:12.582643 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb63037-ae18-4e3c-8425-83bbe0849046 None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:27:12.584891 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-1bb63037-ae18-4e3c-8425-83bbe0849046 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:27:12.598547 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e717186f-5349-4bed-ab4a-ec5d2b4b95a3 service placement] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:27:12.604244 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26add034-8b2a-4b80-813c-bdcf70c553d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:27:12.605649 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26add034-8b2a-4b80-813c-bdcf70c553d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:12.605940 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26add034-8b2a-4b80-813c-bdcf70c553d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:12.606218 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26add034-8b2a-4b80-813c-bdcf70c553d4 admin admin] PATH_INFO: `/v3/projects/f294dd1a62034cf685327ee304493851` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:12.608636 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26add034-8b2a-4b80-813c-bdcf70c553d4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f294dd1a62034cf685327ee304493851)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:27:12.611058 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb63037-ae18-4e3c-8425-83bbe0849046 None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:27:12.611191 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26add034-8b2a-4b80-813c-bdcf70c553d4 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:27:12.619191 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edead0a9-bc8d-41e3-88a9-37cff9325032 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:27:12.621444 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edead0a9-bc8d-41e3-88a9-37cff9325032 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:12.621833 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edead0a9-bc8d-41e3-88a9-37cff9325032 admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:12.622884 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edead0a9-bc8d-41e3-88a9-37cff9325032 admin admin] PATH_INFO: `/v3/projects/18d1df990e2c44e7bf7161a00fcc8828` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:12.624770 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edead0a9-bc8d-41e3-88a9-37cff9325032 admin admin] RBAC: Authorizing `identity:delete_project(project_id=18d1df990e2c44e7bf7161a00fcc8828)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:27:12.628528 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edead0a9-bc8d-41e3-88a9-37cff9325032 admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:27:12.722562 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-26add034-8b2a-4b80-813c-bdcf70c553d4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f294dd1a62034cf685327ee304493851', 'request_id': 'req-26add034-8b2a-4b80-813c-bdcf70c553d4'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:27:12.724276 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-edead0a9-bc8d-41e3-88a9-37cff9325032 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '18d1df990e2c44e7bf7161a00fcc8828', 'request_id': 'req-edead0a9-bc8d-41e3-88a9-37cff9325032'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:27:12.738996 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-26add034-8b2a-4b80-813c-bdcf70c553d4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f294dd1a62034cf685327ee304493851', 'request_id': 'req-26add034-8b2a-4b80-813c-bdcf70c553d4'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:27:12.739277 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-edead0a9-bc8d-41e3-88a9-37cff9325032 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '18d1df990e2c44e7bf7161a00fcc8828', 'request_id': 'req-edead0a9-bc8d-41e3-88a9-37cff9325032'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:27:12.742805 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:27:12.750192 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-edead0a9-bc8d-41e3-88a9-37cff9325032 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '18d1df990e2c44e7bf7161a00fcc8828', 'request_id': 'req-edead0a9-bc8d-41e3-88a9-37cff9325032'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:27:12.758635 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-26add034-8b2a-4b80-813c-bdcf70c553d4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f294dd1a62034cf685327ee304493851', 'request_id': 'req-26add034-8b2a-4b80-813c-bdcf70c553d4'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:27:12.769542 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-edead0a9-bc8d-41e3-88a9-37cff9325032 admin admin] The token cache is being invalidate because project 18d1df990e2c44e7bf7161a00fcc8828 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 12:27:12.769843 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-edead0a9-bc8d-41e3-88a9-37cff9325032 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:27:12.770701 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-edead0a9-bc8d-41e3-88a9-37cff9325032 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:27:12.776372 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 877/1771] 10.222.0.44 () {58 vars in 1232 bytes} [Thu Jun 16 12:27:12 2022] DELETE /identity/v3/projects/18d1df990e2c44e7bf7161a00fcc8828 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:27:12.776372 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258001be-6cf3-4c1d-a1d0-143c5b1ffbd7 None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:12.776372 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258001be-6cf3-4c1d-a1d0-143c5b1ffbd7 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:12.776372 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258001be-6cf3-4c1d-a1d0-143c5b1ffbd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:12.780206 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-26add034-8b2a-4b80-813c-bdcf70c553d4 admin admin] The token cache is being invalidate because project f294dd1a62034cf685327ee304493851 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 12:27:12.781657 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-26add034-8b2a-4b80-813c-bdcf70c553d4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:27:12.782460 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-26add034-8b2a-4b80-813c-bdcf70c553d4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:27:12.785607 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 895/1772] 10.222.0.44 () {58 vars in 1232 bytes} [Thu Jun 16 12:27:12 2022] DELETE /identity/v3/projects/f294dd1a62034cf685327ee304493851 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:27:12.786781 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26add034-8b2a-4b80-813c-bdcf70c553d4 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:27:12.788338 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-26add034-8b2a-4b80-813c-bdcf70c553d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:27:12.799702 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-258001be-6cf3-4c1d-a1d0-143c5b1ffbd7 None None] MFA Rules not processed for user `edfb12d445e74136b90800e93941f468`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:27:12.801784 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-258001be-6cf3-4c1d-a1d0-143c5b1ffbd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:27:12.849545 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:27:12.896631 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26add034-8b2a-4b80-813c-bdcf70c553d4 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:27:12.900460 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 878/1773] 10.222.0.44 () {58 vars in 1018 bytes} [Thu Jun 16 12:27:12 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:27:12.901529 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258001be-6cf3-4c1d-a1d0-143c5b1ffbd7 None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:27:12.903060 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-258001be-6cf3-4c1d-a1d0-143c5b1ffbd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:27:12.990339 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258001be-6cf3-4c1d-a1d0-143c5b1ffbd7 None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:27:13.010236 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e08699-4efd-4c22-8e4b-3452114d3826 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:27:13.011119 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a2ca53-7743-4cfa-8f3a-d1d0781e45b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:27:13.012217 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a2ca53-7743-4cfa-8f3a-d1d0781e45b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:13.013106 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a2ca53-7743-4cfa-8f3a-d1d0781e45b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:13.013398 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a2ca53-7743-4cfa-8f3a-d1d0781e45b9 admin admin] PATH_INFO: `/v3/users/50d419c587ce42f38bae2b2fefd99d8f` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:13.013814 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e08699-4efd-4c22-8e4b-3452114d3826 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:13.014380 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e08699-4efd-4c22-8e4b-3452114d3826 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:13.014673 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e08699-4efd-4c22-8e4b-3452114d3826 admin admin] PATH_INFO: `/v3/users/7b39d7d4fe14491c957739cfb4fd523a` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:13.016185 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e08699-4efd-4c22-8e4b-3452114d3826 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7b39d7d4fe14491c957739cfb4fd523a)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:27:13.017809 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a2ca53-7743-4cfa-8f3a-d1d0781e45b9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=50d419c587ce42f38bae2b2fefd99d8f)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:27:13.019119 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e08699-4efd-4c22-8e4b-3452114d3826 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:27:13.022712 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a2ca53-7743-4cfa-8f3a-d1d0781e45b9 admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:27:13.091940 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-d1e08699-4efd-4c22-8e4b-3452114d3826 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7b39d7d4fe14491c957739cfb4fd523a'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:27:13.092975 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-d1e08699-4efd-4c22-8e4b-3452114d3826 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7b39d7d4fe14491c957739cfb4fd523a'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:27:13.105469 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-d1e08699-4efd-4c22-8e4b-3452114d3826 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7b39d7d4fe14491c957739cfb4fd523a'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:27:13.106430 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-d1e08699-4efd-4c22-8e4b-3452114d3826 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7b39d7d4fe14491c957739cfb4fd523a'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:27:13.118411 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-d1e08699-4efd-4c22-8e4b-3452114d3826 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7b39d7d4fe14491c957739cfb4fd523a'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:27:13.124310 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-f9a2ca53-7743-4cfa-8f3a-d1d0781e45b9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '50d419c587ce42f38bae2b2fefd99d8f'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:27:13.146218 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 896/1774] 10.222.0.44 () {58 vars in 1223 bytes} [Thu Jun 16 12:27:12 2022] DELETE /identity/v3/users/7b39d7d4fe14491c957739cfb4fd523a => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:27:13.147183 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e08699-4efd-4c22-8e4b-3452114d3826 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:27:13.149507 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-d1e08699-4efd-4c22-8e4b-3452114d3826 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:27:13.151919 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-f9a2ca53-7743-4cfa-8f3a-d1d0781e45b9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '50d419c587ce42f38bae2b2fefd99d8f'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:27:13.168484 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-f9a2ca53-7743-4cfa-8f3a-d1d0781e45b9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '50d419c587ce42f38bae2b2fefd99d8f'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:27:13.169284 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-f9a2ca53-7743-4cfa-8f3a-d1d0781e45b9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '50d419c587ce42f38bae2b2fefd99d8f'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:27:13.169749 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:27:13.169936 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-f9a2ca53-7743-4cfa-8f3a-d1d0781e45b9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '50d419c587ce42f38bae2b2fefd99d8f'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:27:13.189934 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 879/1775] 10.222.0.44 () {58 vars in 1223 bytes} [Thu Jun 16 12:27:12 2022] DELETE /identity/v3/users/50d419c587ce42f38bae2b2fefd99d8f => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:27:13.190794 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a2ca53-7743-4cfa-8f3a-d1d0781e45b9 admin admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:27:13.196227 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-f9a2ca53-7743-4cfa-8f3a-d1d0781e45b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:27:13.260220 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e08699-4efd-4c22-8e4b-3452114d3826 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:27:13.307442 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:27:13.377547 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a2ca53-7743-4cfa-8f3a-d1d0781e45b9 admin admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:27:13.381569 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385641ac-3083-4b81-b977-9fe326f1d007 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:27:13.384316 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385641ac-3083-4b81-b977-9fe326f1d007 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:13.384591 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9fc96d-609e-4e9d-92ed-4fa255dc076a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edfb12d445e74136b90800e93941f468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '601361df39e34fcca71175aa94e425c4', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:27:13.385581 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9fc96d-609e-4e9d-92ed-4fa255dc076a service nova] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:13.385858 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385641ac-3083-4b81-b977-9fe326f1d007 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:13.386287 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385641ac-3083-4b81-b977-9fe326f1d007 admin admin] PATH_INFO: `/v3/projects/10516712e25445489ebafe2fdda1741c` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:13.386396 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9fc96d-609e-4e9d-92ed-4fa255dc076a service nova] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:13.386669 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9fc96d-609e-4e9d-92ed-4fa255dc076a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:13.388555 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-ed9fc96d-609e-4e9d-92ed-4fa255dc076a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:27:13.390077 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385641ac-3083-4b81-b977-9fe326f1d007 admin admin] RBAC: Authorizing `identity:delete_project(project_id=10516712e25445489ebafe2fdda1741c)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:27:13.392787 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385641ac-3083-4b81-b977-9fe326f1d007 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:27:13.402678 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9fc96d-609e-4e9d-92ed-4fa255dc076a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:27:13.405201 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9fc96d-609e-4e9d-92ed-4fa255dc076a service nova] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:27:13.423954 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 880/1776] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 12:27:13 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 12:27:13.516118 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-385641ac-3083-4b81-b977-9fe326f1d007 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '10516712e25445489ebafe2fdda1741c', 'request_id': 'req-385641ac-3083-4b81-b977-9fe326f1d007'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:27:13.532141 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-385641ac-3083-4b81-b977-9fe326f1d007 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '10516712e25445489ebafe2fdda1741c', 'request_id': 'req-385641ac-3083-4b81-b977-9fe326f1d007'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:27:13.548668 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-385641ac-3083-4b81-b977-9fe326f1d007 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '10516712e25445489ebafe2fdda1741c', 'request_id': 'req-385641ac-3083-4b81-b977-9fe326f1d007'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:27:13.580298 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-385641ac-3083-4b81-b977-9fe326f1d007 admin admin] The token cache is being invalidate because project 10516712e25445489ebafe2fdda1741c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 12:27:13.580964 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-385641ac-3083-4b81-b977-9fe326f1d007 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:27:13.582495 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-385641ac-3083-4b81-b977-9fe326f1d007 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:27:13.586788 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 897/1777] 10.222.0.44 () {58 vars in 1232 bytes} [Thu Jun 16 12:27:13 2022] DELETE /identity/v3/projects/10516712e25445489ebafe2fdda1741c => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:27:13.591829 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d992ff6a-634a-4291-88d7-dfa7dded85d4 None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:13.592114 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d992ff6a-634a-4291-88d7-dfa7dded85d4 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:13.592472 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d992ff6a-634a-4291-88d7-dfa7dded85d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:13.627616 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-d992ff6a-634a-4291-88d7-dfa7dded85d4 None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:27:13.631473 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-d992ff6a-634a-4291-88d7-dfa7dded85d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:27:13.701083 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385641ac-3083-4b81-b977-9fe326f1d007 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:27:13.702912 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-385641ac-3083-4b81-b977-9fe326f1d007 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:27:13.818295 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 881/1778] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 12:27:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:27:13.820345 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160f4855-c56a-4cb9-91ee-f8bba4222c36 None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:13.820632 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160f4855-c56a-4cb9-91ee-f8bba4222c36 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:13.820954 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160f4855-c56a-4cb9-91ee-f8bba4222c36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:13.826361 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:27:13.854945 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-160f4855-c56a-4cb9-91ee-f8bba4222c36 None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:27:13.857018 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385641ac-3083-4b81-b977-9fe326f1d007 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:27:13.858314 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-160f4855-c56a-4cb9-91ee-f8bba4222c36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:27:13.864245 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc14c93-4fc4-4473-98b3-9e43cc5c0842 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:27:13.865175 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc14c93-4fc4-4473-98b3-9e43cc5c0842 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:13.865954 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc14c93-4fc4-4473-98b3-9e43cc5c0842 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:13.865954 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc14c93-4fc4-4473-98b3-9e43cc5c0842 admin admin] PATH_INFO: `/v3/projects/cd3610de98b54df7a459950de3cfe781` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:13.867835 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc14c93-4fc4-4473-98b3-9e43cc5c0842 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cd3610de98b54df7a459950de3cfe781)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:27:13.869920 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc14c93-4fc4-4473-98b3-9e43cc5c0842 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:27:13.887013 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 882/1779] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 12:27:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:27:13.888109 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160f4855-c56a-4cb9-91ee-f8bba4222c36 None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:27:13.902350 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160f4855-c56a-4cb9-91ee-f8bba4222c36 None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:27:13.908864 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c0e76f-0a34-4aba-af5f-088e1bd0a02c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:27:13.909534 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c0e76f-0a34-4aba-af5f-088e1bd0a02c admin admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:13.909934 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c0e76f-0a34-4aba-af5f-088e1bd0a02c admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:13.910279 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c0e76f-0a34-4aba-af5f-088e1bd0a02c admin admin] PATH_INFO: `/v3/domains` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:13.912141 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c0e76f-0a34-4aba-af5f-088e1bd0a02c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:27:13.912585 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c0e76f-0a34-4aba-af5f-088e1bd0a02c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:27:13.915580 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c0e76f-0a34-4aba-af5f-088e1bd0a02c admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:27:13.950230 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 883/1780] 10.222.0.44 () {58 vars in 1152 bytes} [Thu Jun 16 12:27:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:27:13.958713 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c0e76f-0a34-4aba-af5f-088e1bd0a02c admin admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:27:13.972509 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-0cc14c93-4fc4-4473-98b3-9e43cc5c0842 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cd3610de98b54df7a459950de3cfe781', 'request_id': 'req-0cc14c93-4fc4-4473-98b3-9e43cc5c0842'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:27:13.978503 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c0e76f-0a34-4aba-af5f-088e1bd0a02c admin admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:27:13.992403 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-0cc14c93-4fc4-4473-98b3-9e43cc5c0842 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cd3610de98b54df7a459950de3cfe781', 'request_id': 'req-0cc14c93-4fc4-4473-98b3-9e43cc5c0842'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:27:13.999952 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-0cc14c93-4fc4-4473-98b3-9e43cc5c0842 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cd3610de98b54df7a459950de3cfe781', 'request_id': 'req-0cc14c93-4fc4-4473-98b3-9e43cc5c0842'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:27:14.026440 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-0cc14c93-4fc4-4473-98b3-9e43cc5c0842 admin admin] The token cache is being invalidate because project cd3610de98b54df7a459950de3cfe781 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 12:27:14.026859 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-0cc14c93-4fc4-4473-98b3-9e43cc5c0842 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:27:14.027738 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-0cc14c93-4fc4-4473-98b3-9e43cc5c0842 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:27:14.033414 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 898/1781] 10.222.0.44 () {58 vars in 1232 bytes} [Thu Jun 16 12:27:13 2022] DELETE /identity/v3/projects/cd3610de98b54df7a459950de3cfe781 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:27:14.034983 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1d3089-b981-4925-9d75-89b052e27055 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:14.035495 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1d3089-b981-4925-9d75-89b052e27055 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:14.036119 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1d3089-b981-4925-9d75-89b052e27055 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:14.064621 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-8a1d3089-b981-4925-9d75-89b052e27055 None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:27:14.066369 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-8a1d3089-b981-4925-9d75-89b052e27055 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:27:14.093995 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd1c3ca-bbf1-49bd-9ff3-2c364af70724 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:27:14.095083 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd1c3ca-bbf1-49bd-9ff3-2c364af70724 admin admin] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:14.095376 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd1c3ca-bbf1-49bd-9ff3-2c364af70724 admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:14.095665 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd1c3ca-bbf1-49bd-9ff3-2c364af70724 admin admin] PATH_INFO: `/v3/projects` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:14.097072 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd1c3ca-bbf1-49bd-9ff3-2c364af70724 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:27:14.105924 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd1c3ca-bbf1-49bd-9ff3-2c364af70724 admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:27:14.162214 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 884/1782] 10.222.0.44 () {60 vars in 1152 bytes} [Thu Jun 16 12:27:13 2022] POST /identity/v3/projects => generated 365 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 12:27:14.163005 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd1c3ca-bbf1-49bd-9ff3-2c364af70724 admin admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:27:14.165445 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-7bd1c3ca-bbf1-49bd-9ff3-2c364af70724 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:27:14.189526 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 899/1783] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 12:27:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:27:14.191383 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04222bff-18b6-415f-b3d1-b777f2e461da None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:14.191671 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04222bff-18b6-415f-b3d1-b777f2e461da None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:14.191950 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04222bff-18b6-415f-b3d1-b777f2e461da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:14.216142 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-04222bff-18b6-415f-b3d1-b777f2e461da None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:27:14.217228 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-04222bff-18b6-415f-b3d1-b777f2e461da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:27:14.257262 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:27:14.307336 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd1c3ca-bbf1-49bd-9ff3-2c364af70724 admin admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:27:14.319672 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97be8ffc-92b0-4db1-b22f-831bcde7b63f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:27:14.320369 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97be8ffc-92b0-4db1-b22f-831bcde7b63f admin admin] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:14.320901 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97be8ffc-92b0-4db1-b22f-831bcde7b63f admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:14.321238 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97be8ffc-92b0-4db1-b22f-831bcde7b63f admin admin] PATH_INFO: `/v3/users` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:14.322167 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97be8ffc-92b0-4db1-b22f-831bcde7b63f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:27:14.327870 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97be8ffc-92b0-4db1-b22f-831bcde7b63f admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:27:14.366534 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 900/1784] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 12:27:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:27:14.369176 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04222bff-18b6-415f-b3d1-b777f2e461da None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:27:14.379771 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 885/1785] 10.222.0.44 () {60 vars in 1143 bytes} [Thu Jun 16 12:27:14 2022] POST /identity/v3/users => generated 283 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 12:27:14.380703 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97be8ffc-92b0-4db1-b22f-831bcde7b63f admin admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:27:14.381930 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04222bff-18b6-415f-b3d1-b777f2e461da None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:27:14.389283 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e16795-ef34-4586-8e3b-69abb3480537 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:27:14.390108 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e16795-ef34-4586-8e3b-69abb3480537 admin admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:14.390496 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e16795-ef34-4586-8e3b-69abb3480537 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:14.390916 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e16795-ef34-4586-8e3b-69abb3480537 admin admin] PATH_INFO: `/v3/domains` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:14.392100 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e16795-ef34-4586-8e3b-69abb3480537 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:27:14.392597 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e16795-ef34-4586-8e3b-69abb3480537 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:27:14.395330 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e16795-ef34-4586-8e3b-69abb3480537 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:27:14.415440 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97be8ffc-92b0-4db1-b22f-831bcde7b63f admin admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:27:14.416825 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 901/1786] 10.222.0.44 () {58 vars in 1152 bytes} [Thu Jun 16 12:27:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:27:14.421764 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060f82d6-bde4-4483-82b4-5f0d01207e44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:27:14.422492 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060f82d6-bde4-4483-82b4-5f0d01207e44 admin admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:14.422932 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e16795-ef34-4586-8e3b-69abb3480537 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:27:14.424325 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060f82d6-bde4-4483-82b4-5f0d01207e44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:14.424575 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060f82d6-bde4-4483-82b4-5f0d01207e44 admin admin] PATH_INFO: `/v3/roles` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:14.425366 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060f82d6-bde4-4483-82b4-5f0d01207e44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:27:14.436476 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e16795-ef34-4586-8e3b-69abb3480537 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:27:14.453700 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060f82d6-bde4-4483-82b4-5f0d01207e44 admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:27:14.458258 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e87bf4-bc4d-4d58-bf37-72dcc4fe7d45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:27:14.459029 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e87bf4-bc4d-4d58-bf37-72dcc4fe7d45 admin admin] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:14.459194 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e87bf4-bc4d-4d58-bf37-72dcc4fe7d45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:14.459479 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e87bf4-bc4d-4d58-bf37-72dcc4fe7d45 admin admin] PATH_INFO: `/v3/projects` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:14.460974 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e87bf4-bc4d-4d58-bf37-72dcc4fe7d45 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:27:14.469986 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e87bf4-bc4d-4d58-bf37-72dcc4fe7d45 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:27:14.483803 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 886/1787] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 12:27:14 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 12:27:14.485084 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060f82d6-bde4-4483-82b4-5f0d01207e44 admin admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:27:14.489619 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:27:14.513224 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060f82d6-bde4-4483-82b4-5f0d01207e44 admin admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:27:14.526857 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1099abcb-78e9-4c48-b919-f6f925dfe34d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:27:14.528401 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1099abcb-78e9-4c48-b919-f6f925dfe34d admin admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:14.528995 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1099abcb-78e9-4c48-b919-f6f925dfe34d admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:14.529583 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1099abcb-78e9-4c48-b919-f6f925dfe34d admin admin] PATH_INFO: `/v3/roles` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:14.536774 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1099abcb-78e9-4c48-b919-f6f925dfe34d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:27:14.540514 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1099abcb-78e9-4c48-b919-f6f925dfe34d admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:27:14.551601 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 902/1788] 10.222.0.44 () {60 vars in 1152 bytes} [Thu Jun 16 12:27:14 2022] POST /identity/v3/projects => generated 377 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 12:27:14.552535 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e87bf4-bc4d-4d58-bf37-72dcc4fe7d45 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:27:14.569452 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 887/1789] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 12:27:14 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 12:27:14.571630 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1099abcb-78e9-4c48-b919-f6f925dfe34d admin admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:27:14.592028 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1099abcb-78e9-4c48-b919-f6f925dfe34d admin admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:27:14.679793 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e87bf4-bc4d-4d58-bf37-72dcc4fe7d45 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:27:14.695498 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750e121b-4e50-4b44-8c40-6043206cc335 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:27:14.696194 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750e121b-4e50-4b44-8c40-6043206cc335 admin admin] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:14.696483 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750e121b-4e50-4b44-8c40-6043206cc335 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:14.696822 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750e121b-4e50-4b44-8c40-6043206cc335 admin admin] PATH_INFO: `/v3/users` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:14.697538 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750e121b-4e50-4b44-8c40-6043206cc335 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:27:14.701689 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750e121b-4e50-4b44-8c40-6043206cc335 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:27:14.703484 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ee3e83-2f75-4c96-a316-18a558ac6713 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:27:14.704392 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ee3e83-2f75-4c96-a316-18a558ac6713 admin admin] REQUEST_METHOD: `PUT` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:14.704666 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ee3e83-2f75-4c96-a316-18a558ac6713 admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:14.704963 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ee3e83-2f75-4c96-a316-18a558ac6713 admin admin] PATH_INFO: `/v3/projects/1603fcfe8a7d4879853b20f84a079948/users/1e19c90825ed497abfd25712db76a922/roles/c39882b202e942479a7cdac2fc6da72c` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:14.745279 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ee3e83-2f75-4c96-a316-18a558ac6713 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1603fcfe8a7d4879853b20f84a079948, user_id=1e19c90825ed497abfd25712db76a922, role_id=c39882b202e942479a7cdac2fc6da72c)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:27:14.746277 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 903/1790] 10.222.0.44 () {60 vars in 1143 bytes} [Thu Jun 16 12:27:14 2022] POST /identity/v3/users => generated 289 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 12:27:14.750336 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750e121b-4e50-4b44-8c40-6043206cc335 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:27:14.751385 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ee3e83-2f75-4c96-a316-18a558ac6713 admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:27:14.772023 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750e121b-4e50-4b44-8c40-6043206cc335 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:27:14.778581 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 888/1791] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 16 12:27:14 2022] PUT /identity/v3/projects/1603fcfe8a7d4879853b20f84a079948/users/1e19c90825ed497abfd25712db76a922/roles/c39882b202e942479a7cdac2fc6da72c => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 12:27:14.797842 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59819ba-69ed-4761-a9cc-14fa65a66437 None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:14.798129 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59819ba-69ed-4761-a9cc-14fa65a66437 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:14.798407 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59819ba-69ed-4761-a9cc-14fa65a66437 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:14.870808 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-d59819ba-69ed-4761-a9cc-14fa65a66437 None None] MFA Rules not processed for user `1e19c90825ed497abfd25712db76a922`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:27:14.878682 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-d59819ba-69ed-4761-a9cc-14fa65a66437 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:27:14.898809 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf666340-4c8a-445b-861a-cb44b5988b27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:27:14.902390 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf666340-4c8a-445b-861a-cb44b5988b27 admin admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:14.902802 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf666340-4c8a-445b-861a-cb44b5988b27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:14.903924 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf666340-4c8a-445b-861a-cb44b5988b27 admin admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:14.905497 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf666340-4c8a-445b-861a-cb44b5988b27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:27:14.925359 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf666340-4c8a-445b-861a-cb44b5988b27 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:27:14.947317 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 904/1792] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 12:27:14 2022] GET /identity/v3/roles => generated 1420 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 12:27:14.955678 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf666340-4c8a-445b-861a-cb44b5988b27 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:27:14.973668 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf666340-4c8a-445b-861a-cb44b5988b27 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:27:14.979593 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac46895b-c540-4c47-a100-ac67c839514e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:27:14.980562 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac46895b-c540-4c47-a100-ac67c839514e admin admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:14.981015 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac46895b-c540-4c47-a100-ac67c839514e admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:14.981374 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac46895b-c540-4c47-a100-ac67c839514e admin admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:14.982202 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac46895b-c540-4c47-a100-ac67c839514e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:27:14.984326 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac46895b-c540-4c47-a100-ac67c839514e admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:27:14.997493 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 905/1793] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 12:27:14 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 12:27:15.001203 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac46895b-c540-4c47-a100-ac67c839514e admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:27:15.003982 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 889/1794] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 12:27:14 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:27:15.009581 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59819ba-69ed-4761-a9cc-14fa65a66437 None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:27:15.013114 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac46895b-c540-4c47-a100-ac67c839514e admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:27:15.020718 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3527e1-370a-40bb-97b9-fd4ade431d71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:27:15.023113 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3527e1-370a-40bb-97b9-fd4ade431d71 admin admin] REQUEST_METHOD: `PUT` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:15.028454 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3527e1-370a-40bb-97b9-fd4ade431d71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:15.029041 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3527e1-370a-40bb-97b9-fd4ade431d71 admin admin] PATH_INFO: `/v3/projects/177d663a60ae431c83dd60c1e3902d61/users/6a047d2d2338406f909c7002b66b94af/roles/c39882b202e942479a7cdac2fc6da72c` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:15.032907 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59819ba-69ed-4761-a9cc-14fa65a66437 None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:27:15.048153 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88ea2e9-7508-4228-91fc-61b575c4fd8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:27:15.049341 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88ea2e9-7508-4228-91fc-61b575c4fd8b admin admin] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:15.049626 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88ea2e9-7508-4228-91fc-61b575c4fd8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:15.049906 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88ea2e9-7508-4228-91fc-61b575c4fd8b admin admin] PATH_INFO: `/v3/projects` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:15.052701 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88ea2e9-7508-4228-91fc-61b575c4fd8b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:27:15.064630 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88ea2e9-7508-4228-91fc-61b575c4fd8b admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:27:15.066901 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3527e1-370a-40bb-97b9-fd4ade431d71 admin admin] RBAC: Authorizing `identity:create_grant(project_id=177d663a60ae431c83dd60c1e3902d61, user_id=6a047d2d2338406f909c7002b66b94af, role_id=c39882b202e942479a7cdac2fc6da72c)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:27:15.073939 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3527e1-370a-40bb-97b9-fd4ade431d71 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:27:15.099798 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 906/1795] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 16 12:27:15 2022] PUT /identity/v3/projects/177d663a60ae431c83dd60c1e3902d61/users/6a047d2d2338406f909c7002b66b94af/roles/c39882b202e942479a7cdac2fc6da72c => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 12:27:15.112601 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4662e82-fa8b-4c78-bda7-5050706a5b58 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:15.113070 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4662e82-fa8b-4c78-bda7-5050706a5b58 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:15.113228 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:27:15.113537 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4662e82-fa8b-4c78-bda7-5050706a5b58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:15.134542 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 890/1796] 10.222.0.44 () {60 vars in 1152 bytes} [Thu Jun 16 12:27:15 2022] POST /identity/v3/projects => generated 363 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 12:27:15.142847 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88ea2e9-7508-4228-91fc-61b575c4fd8b admin admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:27:15.189906 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-a4662e82-fa8b-4c78-bda7-5050706a5b58 None None] MFA Rules not processed for user `6a047d2d2338406f909c7002b66b94af`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:27:15.191302 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-a4662e82-fa8b-4c78-bda7-5050706a5b58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:27:15.236184 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:27:15.295639 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88ea2e9-7508-4228-91fc-61b575c4fd8b admin admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:27:15.305996 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20935ee3-bdfb-49aa-a451-35b6f108d308 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:27:15.307941 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20935ee3-bdfb-49aa-a451-35b6f108d308 admin admin] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:15.308598 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20935ee3-bdfb-49aa-a451-35b6f108d308 admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:15.311419 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 907/1797] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 12:27:15 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:27:15.315971 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4662e82-fa8b-4c78-bda7-5050706a5b58 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:27:15.316927 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20935ee3-bdfb-49aa-a451-35b6f108d308 admin admin] PATH_INFO: `/v3/users` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:15.317548 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20935ee3-bdfb-49aa-a451-35b6f108d308 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:27:15.323801 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20935ee3-bdfb-49aa-a451-35b6f108d308 admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:27:15.365002 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4662e82-fa8b-4c78-bda7-5050706a5b58 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:27:15.368513 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 891/1798] 10.222.0.44 () {60 vars in 1143 bytes} [Thu Jun 16 12:27:15 2022] POST /identity/v3/users => generated 288 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 12:27:15.369646 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20935ee3-bdfb-49aa-a451-35b6f108d308 admin admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:27:15.372388 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-20935ee3-bdfb-49aa-a451-35b6f108d308 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:27:15.377964 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e93b313-82ee-4525-bdab-a33b9201104a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:27:15.378642 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e93b313-82ee-4525-bdab-a33b9201104a admin admin] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:15.379019 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e93b313-82ee-4525-bdab-a33b9201104a admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:15.379298 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e93b313-82ee-4525-bdab-a33b9201104a admin admin] PATH_INFO: `/v3/projects` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:15.380094 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e93b313-82ee-4525-bdab-a33b9201104a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:27:15.383795 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e93b313-82ee-4525-bdab-a33b9201104a admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:27:15.391964 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20935ee3-bdfb-49aa-a451-35b6f108d308 admin admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:27:15.400703 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df215cd1-f002-496d-bf93-8de09adb3320 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:27:15.402057 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df215cd1-f002-496d-bf93-8de09adb3320 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:15.402627 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df215cd1-f002-496d-bf93-8de09adb3320 admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:15.403619 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df215cd1-f002-496d-bf93-8de09adb3320 admin admin] PATH_INFO: `/v3/users/87dac0ae7de94c70bc05da592e4faa02` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:15.405218 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df215cd1-f002-496d-bf93-8de09adb3320 admin admin] RBAC: Authorizing `identity:delete_user(user_id=87dac0ae7de94c70bc05da592e4faa02)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:27:15.408070 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df215cd1-f002-496d-bf93-8de09adb3320 admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:27:15.442010 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 908/1799] 10.222.0.44 () {60 vars in 1152 bytes} [Thu Jun 16 12:27:15 2022] POST /identity/v3/projects => generated 377 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 12:27:15.445476 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e93b313-82ee-4525-bdab-a33b9201104a admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:27:15.533155 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-df215cd1-f002-496d-bf93-8de09adb3320 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '87dac0ae7de94c70bc05da592e4faa02'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:27:15.554929 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-df215cd1-f002-496d-bf93-8de09adb3320 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '87dac0ae7de94c70bc05da592e4faa02'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:27:15.566555 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-df215cd1-f002-496d-bf93-8de09adb3320 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '87dac0ae7de94c70bc05da592e4faa02'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:27:15.567794 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-df215cd1-f002-496d-bf93-8de09adb3320 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '87dac0ae7de94c70bc05da592e4faa02'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:27:15.573593 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-df215cd1-f002-496d-bf93-8de09adb3320 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '87dac0ae7de94c70bc05da592e4faa02'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:27:15.602318 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 892/1800] 10.222.0.44 () {58 vars in 1223 bytes} [Thu Jun 16 12:27:15 2022] DELETE /identity/v3/users/87dac0ae7de94c70bc05da592e4faa02 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:27:15.603313 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df215cd1-f002-496d-bf93-8de09adb3320 admin admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:27:15.608013 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-df215cd1-f002-496d-bf93-8de09adb3320 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:27:15.627539 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e93b313-82ee-4525-bdab-a33b9201104a admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:27:15.695878 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:27:15.702449 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df215cd1-f002-496d-bf93-8de09adb3320 admin admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:27:15.725445 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90d78be-026f-4940-a0c1-aa28952edc5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:27:15.726297 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90d78be-026f-4940-a0c1-aa28952edc5e admin admin] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:15.726860 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90d78be-026f-4940-a0c1-aa28952edc5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:15.727255 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90d78be-026f-4940-a0c1-aa28952edc5e admin admin] PATH_INFO: `/v3/users` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:15.728653 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90d78be-026f-4940-a0c1-aa28952edc5e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:27:15.730837 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90d78be-026f-4940-a0c1-aa28952edc5e admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:27:15.738782 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b1cbf4-9a7c-42d7-b125-1d539184270b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:27:15.739816 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b1cbf4-9a7c-42d7-b125-1d539184270b admin admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:15.740185 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b1cbf4-9a7c-42d7-b125-1d539184270b admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:15.740468 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b1cbf4-9a7c-42d7-b125-1d539184270b admin admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:15.742399 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b1cbf4-9a7c-42d7-b125-1d539184270b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:27:15.745004 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b1cbf4-9a7c-42d7-b125-1d539184270b admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:27:15.758124 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 893/1801] 10.222.0.44 () {60 vars in 1143 bytes} [Thu Jun 16 12:27:15 2022] POST /identity/v3/users => generated 295 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 12:27:15.761714 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 909/1802] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 12:27:15 2022] GET /identity/v3/roles => generated 1420 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 12:27:15.763080 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90d78be-026f-4940-a0c1-aa28952edc5e admin admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:27:15.763200 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b1cbf4-9a7c-42d7-b125-1d539184270b admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:27:15.765697 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-25b1cbf4-9a7c-42d7-b125-1d539184270b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:27:15.779286 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90d78be-026f-4940-a0c1-aa28952edc5e admin admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:27:15.783730 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b1cbf4-9a7c-42d7-b125-1d539184270b admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:27:15.786867 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b744fc4a-f9e9-44a4-8eb7-ee86552630d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:27:15.787817 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b744fc4a-f9e9-44a4-8eb7-ee86552630d8 admin admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:15.788101 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b744fc4a-f9e9-44a4-8eb7-ee86552630d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:15.788395 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b744fc4a-f9e9-44a4-8eb7-ee86552630d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:15.789224 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b744fc4a-f9e9-44a4-8eb7-ee86552630d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:27:15.791101 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b744fc4a-f9e9-44a4-8eb7-ee86552630d8 admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:27:15.793147 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71302e30-8390-4840-8319-400e4937c1a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:27:15.794557 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71302e30-8390-4840-8319-400e4937c1a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:15.794926 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71302e30-8390-4840-8319-400e4937c1a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:15.795307 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71302e30-8390-4840-8319-400e4937c1a3 admin admin] PATH_INFO: `/v3/projects/8521f66c75444da7929ffd0f2eaf6bff/users/d14ac3be4bfe497096baf7deca18a0f2/roles/0688968254744e3f9913653cafea3091` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:15.803481 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 894/1803] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 12:27:15 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 12:27:15.807725 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b744fc4a-f9e9-44a4-8eb7-ee86552630d8 admin admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:27:15.817308 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71302e30-8390-4840-8319-400e4937c1a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8521f66c75444da7929ffd0f2eaf6bff, user_id=d14ac3be4bfe497096baf7deca18a0f2, role_id=0688968254744e3f9913653cafea3091)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:27:15.818790 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b744fc4a-f9e9-44a4-8eb7-ee86552630d8 admin admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:27:15.821485 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71302e30-8390-4840-8319-400e4937c1a3 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:27:15.825529 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a2c76b-add1-4f1a-bfae-0f8dd689b920 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:27:15.826613 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a2c76b-add1-4f1a-bfae-0f8dd689b920 admin admin] REQUEST_METHOD: `PUT` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:15.827024 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a2c76b-add1-4f1a-bfae-0f8dd689b920 admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:15.827615 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a2c76b-add1-4f1a-bfae-0f8dd689b920 admin admin] PATH_INFO: `/v3/projects/6ec034919daa4325b34e9a4338d94a35/users/452aef527028426385b9f7d3d9ad56fc/roles/0688968254744e3f9913653cafea3091` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:15.842927 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 910/1804] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 16 12:27:15 2022] PUT /identity/v3/projects/8521f66c75444da7929ffd0f2eaf6bff/users/d14ac3be4bfe497096baf7deca18a0f2/roles/0688968254744e3f9913653cafea3091 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:27:15.843971 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71302e30-8390-4840-8319-400e4937c1a3 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:27:15.854357 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a2c76b-add1-4f1a-bfae-0f8dd689b920 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ec034919daa4325b34e9a4338d94a35, user_id=452aef527028426385b9f7d3d9ad56fc, role_id=0688968254744e3f9913653cafea3091)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:27:15.858236 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a2c76b-add1-4f1a-bfae-0f8dd689b920 admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:27:15.889141 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 895/1805] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 16 12:27:15 2022] PUT /identity/v3/projects/6ec034919daa4325b34e9a4338d94a35/users/452aef527028426385b9f7d3d9ad56fc/roles/0688968254744e3f9913653cafea3091 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 12:27:15.894068 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a2c76b-add1-4f1a-bfae-0f8dd689b920 admin admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:27:15.905992 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:27:15.983941 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71302e30-8390-4840-8319-400e4937c1a3 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:27:16.024149 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a2c76b-add1-4f1a-bfae-0f8dd689b920 admin admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:27:16.029309 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266be84b-ad25-498e-9907-69c85811fa70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:27:16.030338 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266be84b-ad25-498e-9907-69c85811fa70 admin admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:16.030984 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266be84b-ad25-498e-9907-69c85811fa70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:16.031420 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266be84b-ad25-498e-9907-69c85811fa70 admin admin] PATH_INFO: `/v3/roles` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:16.032639 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266be84b-ad25-498e-9907-69c85811fa70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:27:16.034649 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266be84b-ad25-498e-9907-69c85811fa70 admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:27:16.047971 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 896/1806] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 12:27:15 2022] GET /identity/v3/roles => generated 1420 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 12:27:16.052012 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266be84b-ad25-498e-9907-69c85811fa70 admin admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:27:16.066349 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266be84b-ad25-498e-9907-69c85811fa70 admin admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:27:16.091606 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea686215-4ce2-47bc-bf62-03b02c9fa9a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:27:16.092704 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea686215-4ce2-47bc-bf62-03b02c9fa9a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:16.093016 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea686215-4ce2-47bc-bf62-03b02c9fa9a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:16.093438 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea686215-4ce2-47bc-bf62-03b02c9fa9a3 admin admin] PATH_INFO: `/v3/projects/6ec034919daa4325b34e9a4338d94a35/users/452aef527028426385b9f7d3d9ad56fc/roles/0688968254744e3f9913653cafea3091` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:16.098928 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea686215-4ce2-47bc-bf62-03b02c9fa9a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ec034919daa4325b34e9a4338d94a35, user_id=452aef527028426385b9f7d3d9ad56fc, role_id=0688968254744e3f9913653cafea3091)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:27:16.102791 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea686215-4ce2-47bc-bf62-03b02c9fa9a3 admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:27:16.114105 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ad640f-c415-4801-87d2-d4d7c0dcb9a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:27:16.114794 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ad640f-c415-4801-87d2-d4d7c0dcb9a6 admin admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:16.115077 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ad640f-c415-4801-87d2-d4d7c0dcb9a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:16.115354 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ad640f-c415-4801-87d2-d4d7c0dcb9a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:16.116113 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ad640f-c415-4801-87d2-d4d7c0dcb9a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:27:16.120982 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ad640f-c415-4801-87d2-d4d7c0dcb9a6 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:27:16.149198 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 911/1808] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 12:27:15 2022] GET /identity/v3/roles => generated 1420 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 12:27:16.150180 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 897/1808] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 16 12:27:16 2022] PUT /identity/v3/projects/6ec034919daa4325b34e9a4338d94a35/users/452aef527028426385b9f7d3d9ad56fc/roles/0688968254744e3f9913653cafea3091 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:27:16.150724 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ad640f-c415-4801-87d2-d4d7c0dcb9a6 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:27:16.151162 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea686215-4ce2-47bc-bf62-03b02c9fa9a3 admin admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:27:16.152809 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-96ad640f-c415-4801-87d2-d4d7c0dcb9a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:27:16.174948 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ad640f-c415-4801-87d2-d4d7c0dcb9a6 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:27:16.246971 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea686215-4ce2-47bc-bf62-03b02c9fa9a3 admin admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:27:16.252932 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a168e326-038f-453b-bbe6-a27a8bc25dcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:27:16.253916 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a168e326-038f-453b-bbe6-a27a8bc25dcf admin admin] REQUEST_METHOD: `PUT` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:16.254257 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a168e326-038f-453b-bbe6-a27a8bc25dcf admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:16.254597 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a168e326-038f-453b-bbe6-a27a8bc25dcf admin admin] PATH_INFO: `/v3/projects/8521f66c75444da7929ffd0f2eaf6bff/users/d14ac3be4bfe497096baf7deca18a0f2/roles/0688968254744e3f9913653cafea3091` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:16.257536 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a168e326-038f-453b-bbe6-a27a8bc25dcf admin admin] RBAC: Authorizing `identity:create_grant(project_id=8521f66c75444da7929ffd0f2eaf6bff, user_id=d14ac3be4bfe497096baf7deca18a0f2, role_id=0688968254744e3f9913653cafea3091)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:27:16.260815 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a168e326-038f-453b-bbe6-a27a8bc25dcf admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:27:16.281371 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 898/1809] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 16 12:27:16 2022] PUT /identity/v3/projects/8521f66c75444da7929ffd0f2eaf6bff/users/d14ac3be4bfe497096baf7deca18a0f2/roles/0688968254744e3f9913653cafea3091 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:27:16.281371 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e19000-8930-4e0a-9729-7bd27d782c2b None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:16.281371 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e19000-8930-4e0a-9729-7bd27d782c2b None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:16.281371 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e19000-8930-4e0a-9729-7bd27d782c2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:16.281751 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df5836a-fb83-4dee-ae74-94657ec44c40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:27:16.281850 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df5836a-fb83-4dee-ae74-94657ec44c40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:16.282247 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df5836a-fb83-4dee-ae74-94657ec44c40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:16.282395 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df5836a-fb83-4dee-ae74-94657ec44c40 admin admin] PATH_INFO: `/v3/projects/547eb60b6b49482cad0fd3c1918bf897` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:16.283659 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df5836a-fb83-4dee-ae74-94657ec44c40 admin admin] RBAC: Authorizing `identity:delete_project(project_id=547eb60b6b49482cad0fd3c1918bf897)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:27:16.286754 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df5836a-fb83-4dee-ae74-94657ec44c40 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:27:16.348801 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-51e19000-8930-4e0a-9729-7bd27d782c2b None None] MFA Rules not processed for user `452aef527028426385b9f7d3d9ad56fc`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:27:16.356948 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-51e19000-8930-4e0a-9729-7bd27d782c2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:27:16.381299 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:27:16.402430 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-3df5836a-fb83-4dee-ae74-94657ec44c40 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '547eb60b6b49482cad0fd3c1918bf897', 'request_id': 'req-3df5836a-fb83-4dee-ae74-94657ec44c40'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:27:16.421713 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-3df5836a-fb83-4dee-ae74-94657ec44c40 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '547eb60b6b49482cad0fd3c1918bf897', 'request_id': 'req-3df5836a-fb83-4dee-ae74-94657ec44c40'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:27:16.442797 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-3df5836a-fb83-4dee-ae74-94657ec44c40 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '547eb60b6b49482cad0fd3c1918bf897', 'request_id': 'req-3df5836a-fb83-4dee-ae74-94657ec44c40'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:27:16.451004 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 899/1810] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 12:27:16 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:27:16.453678 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b503b7bd-fdfc-4e7f-b465-b768e1ea0665 None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:16.454861 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b503b7bd-fdfc-4e7f-b465-b768e1ea0665 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:16.455568 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b503b7bd-fdfc-4e7f-b465-b768e1ea0665 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:16.458931 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:27:16.472037 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-3df5836a-fb83-4dee-ae74-94657ec44c40 admin admin] The token cache is being invalidate because project 547eb60b6b49482cad0fd3c1918bf897 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 12:27:16.472545 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-3df5836a-fb83-4dee-ae74-94657ec44c40 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:27:16.474310 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-3df5836a-fb83-4dee-ae74-94657ec44c40 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:27:16.488046 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 912/1811] 10.222.0.44 () {58 vars in 1232 bytes} [Thu Jun 16 12:27:16 2022] DELETE /identity/v3/projects/547eb60b6b49482cad0fd3c1918bf897 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:27:16.489572 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df5836a-fb83-4dee-ae74-94657ec44c40 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:27:16.492646 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-3df5836a-fb83-4dee-ae74-94657ec44c40 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:27:16.547726 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-b503b7bd-fdfc-4e7f-b465-b768e1ea0665 None None] MFA Rules not processed for user `d14ac3be4bfe497096baf7deca18a0f2`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:27:16.549154 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-b503b7bd-fdfc-4e7f-b465-b768e1ea0665 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:27:16.578750 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df5836a-fb83-4dee-ae74-94657ec44c40 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:27:16.591525 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec7dfd5-9fa0-4f48-a4d2-0777a119388d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:27:16.592427 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec7dfd5-9fa0-4f48-a4d2-0777a119388d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:16.592705 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec7dfd5-9fa0-4f48-a4d2-0777a119388d admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:16.594315 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec7dfd5-9fa0-4f48-a4d2-0777a119388d admin admin] PATH_INFO: `/v3/projects/da9ef7b61aec49df9ed74e2f30d7dfcb` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:16.596886 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec7dfd5-9fa0-4f48-a4d2-0777a119388d admin admin] RBAC: Authorizing `identity:delete_project(project_id=da9ef7b61aec49df9ed74e2f30d7dfcb)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:27:16.602454 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec7dfd5-9fa0-4f48-a4d2-0777a119388d admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:27:16.756122 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-bec7dfd5-9fa0-4f48-a4d2-0777a119388d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da9ef7b61aec49df9ed74e2f30d7dfcb', 'request_id': 'req-bec7dfd5-9fa0-4f48-a4d2-0777a119388d'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:27:16.763872 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 900/1812] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 12:27:16 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 312 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:27:16.764662 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b503b7bd-fdfc-4e7f-b465-b768e1ea0665 None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:27:16.770841 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-b503b7bd-fdfc-4e7f-b465-b768e1ea0665 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:27:16.774759 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-bec7dfd5-9fa0-4f48-a4d2-0777a119388d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da9ef7b61aec49df9ed74e2f30d7dfcb', 'request_id': 'req-bec7dfd5-9fa0-4f48-a4d2-0777a119388d'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:27:16.791236 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-bec7dfd5-9fa0-4f48-a4d2-0777a119388d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da9ef7b61aec49df9ed74e2f30d7dfcb', 'request_id': 'req-bec7dfd5-9fa0-4f48-a4d2-0777a119388d'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:27:16.805127 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-bec7dfd5-9fa0-4f48-a4d2-0777a119388d admin admin] The token cache is being invalidate because project da9ef7b61aec49df9ed74e2f30d7dfcb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 12:27:16.805653 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-bec7dfd5-9fa0-4f48-a4d2-0777a119388d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:27:16.806528 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-bec7dfd5-9fa0-4f48-a4d2-0777a119388d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:27:16.808333 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 913/1813] 10.222.0.44 () {58 vars in 1232 bytes} [Thu Jun 16 12:27:16 2022] DELETE /identity/v3/projects/da9ef7b61aec49df9ed74e2f30d7dfcb => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:27:16.814029 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebdfe31-7412-4d28-96ca-9eb04926e9c2 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:16.814355 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebdfe31-7412-4d28-96ca-9eb04926e9c2 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:16.814640 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebdfe31-7412-4d28-96ca-9eb04926e9c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:16.840457 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-4ebdfe31-7412-4d28-96ca-9eb04926e9c2 None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:27:16.841804 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-4ebdfe31-7412-4d28-96ca-9eb04926e9c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:27:16.882940 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b503b7bd-fdfc-4e7f-b465-b768e1ea0665 None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:27:16.915994 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 914/1814] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 12:27:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:27:16.917568 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebdfe31-7412-4d28-96ca-9eb04926e9c2 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:27:16.923092 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-4ebdfe31-7412-4d28-96ca-9eb04926e9c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:27:16.952553 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebdfe31-7412-4d28-96ca-9eb04926e9c2 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:27:16.958077 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ec84ad-5985-4d1a-b4eb-437133a2f2cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:27:16.958544 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a340e9-e80d-4872-a4ce-84efb1f0176a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f96fc14ed89478c8a8c2f11c87511e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '601361df39e34fcca71175aa94e425c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:27:16.958976 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ec84ad-5985-4d1a-b4eb-437133a2f2cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:16.959266 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ec84ad-5985-4d1a-b4eb-437133a2f2cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:16.959467 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a340e9-e80d-4872-a4ce-84efb1f0176a service cinder] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:16.959572 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ec84ad-5985-4d1a-b4eb-437133a2f2cf admin admin] PATH_INFO: `/v3/users/3b88ab0f80564b4f921bac03bd86bca9` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:16.959768 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a340e9-e80d-4872-a4ce-84efb1f0176a service cinder] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:16.960951 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a340e9-e80d-4872-a4ce-84efb1f0176a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:16.961372 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ec84ad-5985-4d1a-b4eb-437133a2f2cf admin admin] RBAC: Authorizing `identity:delete_user(user_id=3b88ab0f80564b4f921bac03bd86bca9)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:27:16.962844 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-65a340e9-e80d-4872-a4ce-84efb1f0176a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:27:16.963350 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ec84ad-5985-4d1a-b4eb-437133a2f2cf admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:27:16.976990 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:27:16.992793 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:27:17.025011 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-a2ec84ad-5985-4d1a-b4eb-437133a2f2cf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3b88ab0f80564b4f921bac03bd86bca9'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:27:17.026068 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-a2ec84ad-5985-4d1a-b4eb-437133a2f2cf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3b88ab0f80564b4f921bac03bd86bca9'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:27:17.034046 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-a2ec84ad-5985-4d1a-b4eb-437133a2f2cf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3b88ab0f80564b4f921bac03bd86bca9'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:27:17.034757 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-a2ec84ad-5985-4d1a-b4eb-437133a2f2cf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3b88ab0f80564b4f921bac03bd86bca9'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:27:17.042387 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a340e9-e80d-4872-a4ce-84efb1f0176a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:27:17.044242 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a340e9-e80d-4872-a4ce-84efb1f0176a service cinder] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:27:17.044648 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-a2ec84ad-5985-4d1a-b4eb-437133a2f2cf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3b88ab0f80564b4f921bac03bd86bca9'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:27:17.054856 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 901/1815] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 12:27:16 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 12:27:17.055656 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a340e9-e80d-4872-a4ce-84efb1f0176a service cinder] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:27:17.057071 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-65a340e9-e80d-4872-a4ce-84efb1f0176a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:27:17.071698 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 915/1816] 10.222.0.44 () {58 vars in 1223 bytes} [Thu Jun 16 12:27:16 2022] DELETE /identity/v3/users/3b88ab0f80564b4f921bac03bd86bca9 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:27:17.071892 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a340e9-e80d-4872-a4ce-84efb1f0176a service cinder] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:27:17.071997 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71309321-f9ec-4c43-9642-e1b63a0a0847 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:17.071997 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71309321-f9ec-4c43-9642-e1b63a0a0847 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:17.071997 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71309321-f9ec-4c43-9642-e1b63a0a0847 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:17.100744 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-71309321-f9ec-4c43-9642-e1b63a0a0847 None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:27:17.102331 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-71309321-f9ec-4c43-9642-e1b63a0a0847 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:27:17.215891 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4b1120-4a16-48a0-ac05-d1e9d5dc05fe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f96fc14ed89478c8a8c2f11c87511e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '601361df39e34fcca71175aa94e425c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:27:17.217115 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4b1120-4a16-48a0-ac05-d1e9d5dc05fe service cinder] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:17.217489 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4b1120-4a16-48a0-ac05-d1e9d5dc05fe service cinder] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:17.217798 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4b1120-4a16-48a0-ac05-d1e9d5dc05fe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:17.236112 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-5f4b1120-4a16-48a0-ac05-d1e9d5dc05fe service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:27:17.329478 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 916/1817] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 12:27:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:27:17.335347 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f61442b-5864-4d0a-b312-f24b2e2095fb None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:17.335889 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f61442b-5864-4d0a-b312-f24b2e2095fb None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:17.337033 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f61442b-5864-4d0a-b312-f24b2e2095fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:17.387329 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-9f61442b-5864-4d0a-b312-f24b2e2095fb None None] MFA Rules not processed for user `dcb0b632b30649609216933c50f287b9`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:27:17.398824 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4b1120-4a16-48a0-ac05-d1e9d5dc05fe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:27:17.401162 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-9f61442b-5864-4d0a-b312-f24b2e2095fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:27:17.403531 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4b1120-4a16-48a0-ac05-d1e9d5dc05fe service cinder] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:27:17.483421 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 902/1818] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 12:27:17 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 12:27:17.490682 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 917/1819] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 12:27:17 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:27:17.490682 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f61442b-5864-4d0a-b312-f24b2e2095fb None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:27:17.491902 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4b1120-4a16-48a0-ac05-d1e9d5dc05fe service cinder] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:27:17.493147 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-9f61442b-5864-4d0a-b312-f24b2e2095fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:27:17.511179 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4b1120-4a16-48a0-ac05-d1e9d5dc05fe service cinder] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:27:17.515485 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f61442b-5864-4d0a-b312-f24b2e2095fb None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:27:17.521757 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd1d28c-d1dc-4cc7-9507-a130af64c87d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:27:17.522603 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd1d28c-d1dc-4cc7-9507-a130af64c87d admin admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:17.522887 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd1d28c-d1dc-4cc7-9507-a130af64c87d admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:17.524443 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd1d28c-d1dc-4cc7-9507-a130af64c87d admin admin] PATH_INFO: `/v3/domains` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:17.524653 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd1d28c-d1dc-4cc7-9507-a130af64c87d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:27:17.524990 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd1d28c-d1dc-4cc7-9507-a130af64c87d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:27:17.527973 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd1d28c-d1dc-4cc7-9507-a130af64c87d admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:27:17.529820 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cefc39-94a1-4d0a-a9e9-62d74fd6edc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:27:17.530867 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cefc39-94a1-4d0a-a9e9-62d74fd6edc0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:17.531295 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cefc39-94a1-4d0a-a9e9-62d74fd6edc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:17.531406 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cefc39-94a1-4d0a-a9e9-62d74fd6edc0 admin admin] PATH_INFO: `/v3/projects/2a0deeb191954e428f227c0c0433495b` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:17.532681 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cefc39-94a1-4d0a-a9e9-62d74fd6edc0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2a0deeb191954e428f227c0c0433495b)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:27:17.534625 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cefc39-94a1-4d0a-a9e9-62d74fd6edc0 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:27:17.559149 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 903/1820] 10.222.0.44 () {58 vars in 1152 bytes} [Thu Jun 16 12:27:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:27:17.563712 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd1d28c-d1dc-4cc7-9507-a130af64c87d admin admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:27:17.598590 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd1d28c-d1dc-4cc7-9507-a130af64c87d admin admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:27:17.615461 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dee576b-3ce4-4adf-ad27-8a69542dd1fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:27:17.617287 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dee576b-3ce4-4adf-ad27-8a69542dd1fc admin admin] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:17.618672 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dee576b-3ce4-4adf-ad27-8a69542dd1fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:17.621210 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dee576b-3ce4-4adf-ad27-8a69542dd1fc admin admin] PATH_INFO: `/v3/projects` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:17.622885 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dee576b-3ce4-4adf-ad27-8a69542dd1fc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:27:17.626973 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dee576b-3ce4-4adf-ad27-8a69542dd1fc admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:27:17.645191 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:27:17.654402 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-a6cefc39-94a1-4d0a-a9e9-62d74fd6edc0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2a0deeb191954e428f227c0c0433495b', 'request_id': 'req-a6cefc39-94a1-4d0a-a9e9-62d74fd6edc0'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:27:17.664664 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-a6cefc39-94a1-4d0a-a9e9-62d74fd6edc0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2a0deeb191954e428f227c0c0433495b', 'request_id': 'req-a6cefc39-94a1-4d0a-a9e9-62d74fd6edc0'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:27:17.672159 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-a6cefc39-94a1-4d0a-a9e9-62d74fd6edc0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2a0deeb191954e428f227c0c0433495b', 'request_id': 'req-a6cefc39-94a1-4d0a-a9e9-62d74fd6edc0'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:27:17.686523 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-a6cefc39-94a1-4d0a-a9e9-62d74fd6edc0 admin admin] The token cache is being invalidate because project 2a0deeb191954e428f227c0c0433495b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 12:27:17.686934 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-a6cefc39-94a1-4d0a-a9e9-62d74fd6edc0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:27:17.688239 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-a6cefc39-94a1-4d0a-a9e9-62d74fd6edc0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:27:17.695906 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 918/1821] 10.222.0.44 () {58 vars in 1232 bytes} [Thu Jun 16 12:27:17 2022] DELETE /identity/v3/projects/2a0deeb191954e428f227c0c0433495b => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:27:17.697543 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1e58c1-7451-470a-9473-8f9ee80760f0 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:17.697839 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1e58c1-7451-470a-9473-8f9ee80760f0 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:17.698124 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1e58c1-7451-470a-9473-8f9ee80760f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:17.701570 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 904/1822] 10.222.0.44 () {60 vars in 1152 bytes} [Thu Jun 16 12:27:17 2022] POST /identity/v3/projects => generated 381 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 12:27:17.707884 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dee576b-3ce4-4adf-ad27-8a69542dd1fc admin admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:27:17.714391 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-2dee576b-3ce4-4adf-ad27-8a69542dd1fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:27:17.721196 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-ca1e58c1-7451-470a-9473-8f9ee80760f0 None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:27:17.727496 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-ca1e58c1-7451-470a-9473-8f9ee80760f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:27:17.790450 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:27:17.864558 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dee576b-3ce4-4adf-ad27-8a69542dd1fc admin admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:27:17.874902 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ddb698-3394-454d-bf07-f1a86e95eafd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:27:17.875599 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ddb698-3394-454d-bf07-f1a86e95eafd admin admin] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:17.875882 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ddb698-3394-454d-bf07-f1a86e95eafd admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:17.876161 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ddb698-3394-454d-bf07-f1a86e95eafd admin admin] PATH_INFO: `/v3/users` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:17.876905 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ddb698-3394-454d-bf07-f1a86e95eafd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:27:17.878878 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ddb698-3394-454d-bf07-f1a86e95eafd admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:27:17.896803 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 919/1823] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 12:27:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:27:17.906980 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd82510-656b-4c1f-874c-a0c6654f3d28 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:17.908863 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd82510-656b-4c1f-874c-a0c6654f3d28 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:17.908863 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd82510-656b-4c1f-874c-a0c6654f3d28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:17.945284 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 905/1824] 10.222.0.44 () {60 vars in 1143 bytes} [Thu Jun 16 12:27:17 2022] POST /identity/v3/users => generated 291 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 12:27:17.960208 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ddb698-3394-454d-bf07-f1a86e95eafd admin admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:27:17.974568 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-4cd82510-656b-4c1f-874c-a0c6654f3d28 None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:27:17.982639 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-4cd82510-656b-4c1f-874c-a0c6654f3d28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:27:17.988677 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ddb698-3394-454d-bf07-f1a86e95eafd admin admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:27:17.996668 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a20fec-c681-466d-95b4-3f3ce7bcd0af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:27:17.997517 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a20fec-c681-466d-95b4-3f3ce7bcd0af admin admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:17.997941 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a20fec-c681-466d-95b4-3f3ce7bcd0af admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:17.998362 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a20fec-c681-466d-95b4-3f3ce7bcd0af admin admin] PATH_INFO: `/v3/roles` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:18.000726 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a20fec-c681-466d-95b4-3f3ce7bcd0af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:27:18.002212 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a20fec-c681-466d-95b4-3f3ce7bcd0af admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:27:18.012451 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 920/1825] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 12:27:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:27:18.019122 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd82510-656b-4c1f-874c-a0c6654f3d28 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:27:18.029695 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 906/1826] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 12:27:17 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 12:27:18.031175 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a20fec-c681-466d-95b4-3f3ce7bcd0af admin admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:27:18.037911 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd82510-656b-4c1f-874c-a0c6654f3d28 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:27:18.044081 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a20fec-c681-466d-95b4-3f3ce7bcd0af admin admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:27:18.046777 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61119c2d-cec7-41f8-82a5-a5f9e2d11f83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:27:18.047451 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61119c2d-cec7-41f8-82a5-a5f9e2d11f83 admin admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:18.047766 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61119c2d-cec7-41f8-82a5-a5f9e2d11f83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:18.048037 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61119c2d-cec7-41f8-82a5-a5f9e2d11f83 admin admin] PATH_INFO: `/v3/domains` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:18.048788 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61119c2d-cec7-41f8-82a5-a5f9e2d11f83 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:27:18.049269 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61119c2d-cec7-41f8-82a5-a5f9e2d11f83 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:27:18.050680 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a60853e-4649-4d42-9c48-0feb7536efa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:27:18.051502 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61119c2d-cec7-41f8-82a5-a5f9e2d11f83 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:27:18.051759 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a60853e-4649-4d42-9c48-0feb7536efa0 admin admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:18.052171 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a60853e-4649-4d42-9c48-0feb7536efa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:18.052623 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a60853e-4649-4d42-9c48-0feb7536efa0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:18.054517 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a60853e-4649-4d42-9c48-0feb7536efa0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:27:18.057306 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a60853e-4649-4d42-9c48-0feb7536efa0 admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:27:18.075317 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 907/1827] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 12:27:18 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 12:27:18.082985 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a60853e-4649-4d42-9c48-0feb7536efa0 admin admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:27:18.084419 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 921/1828] 10.222.0.44 () {58 vars in 1152 bytes} [Thu Jun 16 12:27:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 12:27:18.088998 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61119c2d-cec7-41f8-82a5-a5f9e2d11f83 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:27:18.104034 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a60853e-4649-4d42-9c48-0feb7536efa0 admin admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:27:18.114014 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e100c9-5a5f-4044-a07e-6580f05226a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:27:18.116736 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e100c9-5a5f-4044-a07e-6580f05226a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:18.116941 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61119c2d-cec7-41f8-82a5-a5f9e2d11f83 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:27:18.118017 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e100c9-5a5f-4044-a07e-6580f05226a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:18.118436 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e100c9-5a5f-4044-a07e-6580f05226a9 admin admin] PATH_INFO: `/v3/projects/ea0afb32985a4773bcbb4891cf13e252/users/2010e2a9e69342678c2ad441cf4577f6/roles/c39882b202e942479a7cdac2fc6da72c` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:18.126815 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85fe937-8f01-410f-9c1e-132b91b1996f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:27:18.128783 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85fe937-8f01-410f-9c1e-132b91b1996f admin admin] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:18.129414 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85fe937-8f01-410f-9c1e-132b91b1996f admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:18.129414 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85fe937-8f01-410f-9c1e-132b91b1996f admin admin] PATH_INFO: `/v3/projects` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:18.130027 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85fe937-8f01-410f-9c1e-132b91b1996f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:27:18.151435 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85fe937-8f01-410f-9c1e-132b91b1996f admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:27:18.164976 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e100c9-5a5f-4044-a07e-6580f05226a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea0afb32985a4773bcbb4891cf13e252, user_id=2010e2a9e69342678c2ad441cf4577f6, role_id=c39882b202e942479a7cdac2fc6da72c)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:27:18.171084 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e100c9-5a5f-4044-a07e-6580f05226a9 admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:27:18.200544 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 908/1829] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 16 12:27:18 2022] PUT /identity/v3/projects/ea0afb32985a4773bcbb4891cf13e252/users/2010e2a9e69342678c2ad441cf4577f6/roles/c39882b202e942479a7cdac2fc6da72c => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:27:18.212367 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1be9f1-d2ab-465e-9be8-cf0b23778cdc None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:18.212659 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1be9f1-d2ab-465e-9be8-cf0b23778cdc None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:18.212968 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1be9f1-d2ab-465e-9be8-cf0b23778cdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:18.239334 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 922/1830] 10.222.0.44 () {60 vars in 1152 bytes} [Thu Jun 16 12:27:18 2022] POST /identity/v3/projects => generated 371 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 12:27:18.242067 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85fe937-8f01-410f-9c1e-132b91b1996f admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:27:18.254267 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-9b1be9f1-d2ab-465e-9be8-cf0b23778cdc None None] MFA Rules not processed for user `2010e2a9e69342678c2ad441cf4577f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:27:18.256139 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-9b1be9f1-d2ab-465e-9be8-cf0b23778cdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:27:18.373399 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 909/1831] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 12:27:18 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 12:27:18.381402 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1be9f1-d2ab-465e-9be8-cf0b23778cdc None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:27:18.395074 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85fe937-8f01-410f-9c1e-132b91b1996f admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:27:18.403593 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1be9f1-d2ab-465e-9be8-cf0b23778cdc None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:27:18.410373 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737e22c3-2072-4282-8b1f-3b29488ed470 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:27:18.412016 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb68186-deea-49f3-a8ff-11cb22d7263a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:27:18.412511 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737e22c3-2072-4282-8b1f-3b29488ed470 admin admin] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:18.412973 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737e22c3-2072-4282-8b1f-3b29488ed470 admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:18.413655 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb68186-deea-49f3-a8ff-11cb22d7263a admin admin] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:18.413944 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb68186-deea-49f3-a8ff-11cb22d7263a admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:18.414060 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737e22c3-2072-4282-8b1f-3b29488ed470 admin admin] PATH_INFO: `/v3/projects` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:18.414221 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb68186-deea-49f3-a8ff-11cb22d7263a admin admin] PATH_INFO: `/v3/users` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:18.414921 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb68186-deea-49f3-a8ff-11cb22d7263a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:27:18.415026 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737e22c3-2072-4282-8b1f-3b29488ed470 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:27:18.417119 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb68186-deea-49f3-a8ff-11cb22d7263a admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:27:18.417643 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737e22c3-2072-4282-8b1f-3b29488ed470 admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:27:18.457026 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 910/1832] 10.222.0.44 () {60 vars in 1152 bytes} [Thu Jun 16 12:27:18 2022] POST /identity/v3/projects => generated 381 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 12:27:18.457026 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737e22c3-2072-4282-8b1f-3b29488ed470 admin admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:27:18.457308 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 923/1833] 10.222.0.44 () {60 vars in 1143 bytes} [Thu Jun 16 12:27:18 2022] POST /identity/v3/users => generated 286 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 12:27:18.457753 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb68186-deea-49f3-a8ff-11cb22d7263a admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:27:18.458956 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-737e22c3-2072-4282-8b1f-3b29488ed470 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:27:18.469872 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb68186-deea-49f3-a8ff-11cb22d7263a admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:27:18.486105 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=91,keystone:DELETE=4,keystone:INSERT=5 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:27:18.533083 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:27:18.550696 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1b6b4d-367b-4938-ae71-006abf34c52e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:27:18.551807 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1b6b4d-367b-4938-ae71-006abf34c52e admin admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:18.552230 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1b6b4d-367b-4938-ae71-006abf34c52e admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:18.552511 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1b6b4d-367b-4938-ae71-006abf34c52e admin admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:18.553554 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1b6b4d-367b-4938-ae71-006abf34c52e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:27:18.555912 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1b6b4d-367b-4938-ae71-006abf34c52e admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:27:18.570333 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 924/1834] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 12:27:18 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 12:27:18.571396 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1b6b4d-367b-4938-ae71-006abf34c52e admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:27:18.572571 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737e22c3-2072-4282-8b1f-3b29488ed470 admin admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:27:18.580670 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5cdaec-f0c0-494b-adad-106427b229f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:27:18.581861 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5cdaec-f0c0-494b-adad-106427b229f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:18.582312 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5cdaec-f0c0-494b-adad-106427b229f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:18.582661 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5cdaec-f0c0-494b-adad-106427b229f3 admin admin] PATH_INFO: `/v3/users/1e19c90825ed497abfd25712db76a922` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:18.583966 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5cdaec-f0c0-494b-adad-106427b229f3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1e19c90825ed497abfd25712db76a922)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:27:18.584180 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1b6b4d-367b-4938-ae71-006abf34c52e admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:27:18.586923 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5cdaec-f0c0-494b-adad-106427b229f3 admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:27:18.590638 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3331f4c3-982f-4b08-a921-0b574358d3c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:27:18.591588 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3331f4c3-982f-4b08-a921-0b574358d3c0 admin admin] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:18.591879 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3331f4c3-982f-4b08-a921-0b574358d3c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:18.592158 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3331f4c3-982f-4b08-a921-0b574358d3c0 admin admin] PATH_INFO: `/v3/users` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:18.593215 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3331f4c3-982f-4b08-a921-0b574358d3c0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:27:18.596187 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3331f4c3-982f-4b08-a921-0b574358d3c0 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:27:18.630463 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 925/1835] 10.222.0.44 () {60 vars in 1143 bytes} [Thu Jun 16 12:27:18 2022] POST /identity/v3/users => generated 297 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 12:27:18.630463 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3331f4c3-982f-4b08-a921-0b574358d3c0 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:27:18.643136 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3331f4c3-982f-4b08-a921-0b574358d3c0 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:27:18.649033 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80454551-c4d4-4e43-adea-ced47bb70226 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:27:18.649871 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80454551-c4d4-4e43-adea-ced47bb70226 admin admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:18.650158 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80454551-c4d4-4e43-adea-ced47bb70226 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:18.650435 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80454551-c4d4-4e43-adea-ced47bb70226 admin admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:18.651173 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80454551-c4d4-4e43-adea-ced47bb70226 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:27:18.653989 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80454551-c4d4-4e43-adea-ced47bb70226 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:27:18.672365 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 926/1836] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 12:27:18 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 12:27:18.672365 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80454551-c4d4-4e43-adea-ced47bb70226 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:27:18.683850 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80454551-c4d4-4e43-adea-ced47bb70226 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:27:18.690419 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e2a8b8-cb5f-446f-90f3-712f68ec5597 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:27:18.691562 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e2a8b8-cb5f-446f-90f3-712f68ec5597 admin admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:18.691851 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e2a8b8-cb5f-446f-90f3-712f68ec5597 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:18.692149 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e2a8b8-cb5f-446f-90f3-712f68ec5597 admin admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:18.693412 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e2a8b8-cb5f-446f-90f3-712f68ec5597 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:27:18.695442 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e2a8b8-cb5f-446f-90f3-712f68ec5597 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:27:18.696891 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-fb5cdaec-f0c0-494b-adad-106427b229f3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1e19c90825ed497abfd25712db76a922'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:27:18.710785 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 927/1837] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 12:27:18 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 12:27:18.711875 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e2a8b8-cb5f-446f-90f3-712f68ec5597 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:27:18.726897 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e2a8b8-cb5f-446f-90f3-712f68ec5597 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:27:18.727907 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-fb5cdaec-f0c0-494b-adad-106427b229f3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1e19c90825ed497abfd25712db76a922'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:27:18.733517 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1496b2-886c-4505-a54a-bd0c5dbb53bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:27:18.734669 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1496b2-886c-4505-a54a-bd0c5dbb53bb admin admin] REQUEST_METHOD: `PUT` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:18.735017 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1496b2-886c-4505-a54a-bd0c5dbb53bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:18.735534 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1496b2-886c-4505-a54a-bd0c5dbb53bb admin admin] PATH_INFO: `/v3/projects/0fb4209dd5124337bdc6b321dcf9c525/users/a6677ed4c76844c98dae15e875b564a7/roles/c39882b202e942479a7cdac2fc6da72c` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:18.743168 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-fb5cdaec-f0c0-494b-adad-106427b229f3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1e19c90825ed497abfd25712db76a922'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:27:18.743915 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-fb5cdaec-f0c0-494b-adad-106427b229f3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1e19c90825ed497abfd25712db76a922'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:27:18.744531 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-fb5cdaec-f0c0-494b-adad-106427b229f3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1e19c90825ed497abfd25712db76a922'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:27:18.760789 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 911/1838] 10.222.0.44 () {58 vars in 1223 bytes} [Thu Jun 16 12:27:18 2022] DELETE /identity/v3/users/1e19c90825ed497abfd25712db76a922 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:27:18.762626 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5cdaec-f0c0-494b-adad-106427b229f3 admin admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:27:18.764541 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-fb5cdaec-f0c0-494b-adad-106427b229f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:27:18.770384 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1496b2-886c-4505-a54a-bd0c5dbb53bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=0fb4209dd5124337bdc6b321dcf9c525, user_id=a6677ed4c76844c98dae15e875b564a7, role_id=c39882b202e942479a7cdac2fc6da72c)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:27:18.777344 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1496b2-886c-4505-a54a-bd0c5dbb53bb admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:27:18.821891 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 928/1839] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 16 12:27:18 2022] PUT /identity/v3/projects/0fb4209dd5124337bdc6b321dcf9c525/users/a6677ed4c76844c98dae15e875b564a7/roles/c39882b202e942479a7cdac2fc6da72c => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:27:18.823876 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3befdfc8-8fff-4f4f-b6b0-12106f28f3e8 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:18.823970 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3befdfc8-8fff-4f4f-b6b0-12106f28f3e8 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:18.824233 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3befdfc8-8fff-4f4f-b6b0-12106f28f3e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:18.859148 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-3befdfc8-8fff-4f4f-b6b0-12106f28f3e8 None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:27:18.859148 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-3befdfc8-8fff-4f4f-b6b0-12106f28f3e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:27:18.914824 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5cdaec-f0c0-494b-adad-106427b229f3 admin admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:27:18.970558 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 929/1840] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 12:27:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:27:18.986510 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46b92e4-e6f5-44c8-9889-b95182f76719 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:18.986821 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46b92e4-e6f5-44c8-9889-b95182f76719 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:18.987470 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46b92e4-e6f5-44c8-9889-b95182f76719 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:19.040117 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-f46b92e4-e6f5-44c8-9889-b95182f76719 None None] MFA Rules not processed for user `a6677ed4c76844c98dae15e875b564a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:27:19.041596 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-f46b92e4-e6f5-44c8-9889-b95182f76719 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:27:19.098287 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdea42f0-ccde-43da-aa77-b5fab5629b5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:27:19.099205 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdea42f0-ccde-43da-aa77-b5fab5629b5f admin admin] REQUEST_METHOD: `PUT` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:19.099593 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdea42f0-ccde-43da-aa77-b5fab5629b5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:19.099871 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdea42f0-ccde-43da-aa77-b5fab5629b5f admin admin] PATH_INFO: `/v3/projects/b7b3305c2ad741249e41b5fbff27dafd/users/70a96996d7e742dcbcd5ca9d3c3d5c21/roles/0688968254744e3f9913653cafea3091` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:19.109375 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:27:19.116178 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:27:19.132511 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdea42f0-ccde-43da-aa77-b5fab5629b5f admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7b3305c2ad741249e41b5fbff27dafd, user_id=70a96996d7e742dcbcd5ca9d3c3d5c21, role_id=0688968254744e3f9913653cafea3091)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:27:19.139694 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdea42f0-ccde-43da-aa77-b5fab5629b5f admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:27:19.176683 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 912/1841] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 16 12:27:18 2022] PUT /identity/v3/projects/b7b3305c2ad741249e41b5fbff27dafd/users/70a96996d7e742dcbcd5ca9d3c3d5c21/roles/0688968254744e3f9913653cafea3091 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:27:19.181916 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdea42f0-ccde-43da-aa77-b5fab5629b5f admin admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:27:19.187433 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-cdea42f0-ccde-43da-aa77-b5fab5629b5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:27:19.195391 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 930/1842] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 12:27:18 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:27:19.198223 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46b92e4-e6f5-44c8-9889-b95182f76719 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:27:19.232670 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46b92e4-e6f5-44c8-9889-b95182f76719 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:27:19.291093 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdea42f0-ccde-43da-aa77-b5fab5629b5f admin admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:27:19.298947 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff5c2ac-a23a-45e6-b9d1-a790243d4ff7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1094729b25a4be7b0b394998c9ca681', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '601361df39e34fcca71175aa94e425c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:27:19.300585 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff5c2ac-a23a-45e6-b9d1-a790243d4ff7 service neutron] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:19.301244 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff5c2ac-a23a-45e6-b9d1-a790243d4ff7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:19.301244 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff5c2ac-a23a-45e6-b9d1-a790243d4ff7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:19.366868 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe55644a-ace9-4977-a14f-b5e91128b701 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:27:19.368306 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe55644a-ace9-4977-a14f-b5e91128b701 admin admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:19.371578 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe55644a-ace9-4977-a14f-b5e91128b701 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:19.371986 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe55644a-ace9-4977-a14f-b5e91128b701 admin admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:19.373347 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe55644a-ace9-4977-a14f-b5e91128b701 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:27:19.375599 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe55644a-ace9-4977-a14f-b5e91128b701 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:27:19.391669 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 931/1843] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 12:27:19 2022] GET /identity/v3/roles => generated 1420 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 12:27:19.392645 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe55644a-ace9-4977-a14f-b5e91128b701 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:27:19.396878 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-fe55644a-ace9-4977-a14f-b5e91128b701 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:27:19.397702 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff5c2ac-a23a-45e6-b9d1-a790243d4ff7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:27:19.399847 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff5c2ac-a23a-45e6-b9d1-a790243d4ff7 service neutron] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:27:19.413396 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe55644a-ace9-4977-a14f-b5e91128b701 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:27:19.414900 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 913/1844] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 12:27:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 12:27:19.415692 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff5c2ac-a23a-45e6-b9d1-a790243d4ff7 service neutron] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:27:19.420449 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a057e3-d98d-4e76-b54d-8729535c205e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:27:19.421387 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a057e3-d98d-4e76-b54d-8729535c205e admin admin] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:19.421977 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a057e3-d98d-4e76-b54d-8729535c205e admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:19.422396 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a057e3-d98d-4e76-b54d-8729535c205e admin admin] PATH_INFO: `/v3/projects` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:19.423882 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a057e3-d98d-4e76-b54d-8729535c205e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:27:19.426317 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a057e3-d98d-4e76-b54d-8729535c205e admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:27:19.433295 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff5c2ac-a23a-45e6-b9d1-a790243d4ff7 service neutron] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:27:19.442288 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17451fad-062d-40e7-b6bf-825192f4df44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:27:19.443195 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17451fad-062d-40e7-b6bf-825192f4df44 admin admin] REQUEST_METHOD: `PUT` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:19.443851 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17451fad-062d-40e7-b6bf-825192f4df44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:19.443851 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17451fad-062d-40e7-b6bf-825192f4df44 admin admin] PATH_INFO: `/v3/projects/b7b3305c2ad741249e41b5fbff27dafd/users/70a96996d7e742dcbcd5ca9d3c3d5c21/roles/0688968254744e3f9913653cafea3091` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:19.446504 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17451fad-062d-40e7-b6bf-825192f4df44 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7b3305c2ad741249e41b5fbff27dafd, user_id=70a96996d7e742dcbcd5ca9d3c3d5c21, role_id=0688968254744e3f9913653cafea3091)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:27:19.449361 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17451fad-062d-40e7-b6bf-825192f4df44 admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:27:19.470970 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 914/1845] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 16 12:27:19 2022] PUT /identity/v3/projects/b7b3305c2ad741249e41b5fbff27dafd/users/70a96996d7e742dcbcd5ca9d3c3d5c21/roles/0688968254744e3f9913653cafea3091 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:27:19.473112 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c70ff4-b28b-4c07-b7a5-1d7aad0cf9ac None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:19.473424 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c70ff4-b28b-4c07-b7a5-1d7aad0cf9ac None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:19.473842 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c70ff4-b28b-4c07-b7a5-1d7aad0cf9ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:19.493257 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 932/1846] 10.222.0.44 () {60 vars in 1152 bytes} [Thu Jun 16 12:27:19 2022] POST /identity/v3/projects => generated 373 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 12:27:19.494291 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a057e3-d98d-4e76-b54d-8729535c205e admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:27:19.543462 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-83c70ff4-b28b-4c07-b7a5-1d7aad0cf9ac None None] MFA Rules not processed for user `70a96996d7e742dcbcd5ca9d3c3d5c21`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:27:19.545947 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-83c70ff4-b28b-4c07-b7a5-1d7aad0cf9ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:27:19.638346 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a057e3-d98d-4e76-b54d-8729535c205e admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:27:19.644126 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61dc8f0-e166-4ee6-87f7-b612b492e211 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:27:19.644841 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61dc8f0-e166-4ee6-87f7-b612b492e211 admin admin] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:19.645130 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61dc8f0-e166-4ee6-87f7-b612b492e211 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:19.645410 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61dc8f0-e166-4ee6-87f7-b612b492e211 admin admin] PATH_INFO: `/v3/users` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:19.647032 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61dc8f0-e166-4ee6-87f7-b612b492e211 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:27:19.651460 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61dc8f0-e166-4ee6-87f7-b612b492e211 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:27:19.693272 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 915/1847] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 12:27:19 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:27:19.704193 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 933/1848] 10.222.0.44 () {60 vars in 1143 bytes} [Thu Jun 16 12:27:19 2022] POST /identity/v3/users => generated 293 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 12:27:19.705324 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c70ff4-b28b-4c07-b7a5-1d7aad0cf9ac None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:27:19.706616 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-83c70ff4-b28b-4c07-b7a5-1d7aad0cf9ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:27:19.706733 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61dc8f0-e166-4ee6-87f7-b612b492e211 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:27:19.723455 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:27:19.724321 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61dc8f0-e166-4ee6-87f7-b612b492e211 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:27:19.734763 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6844bedb-845a-47e1-86f7-da48b6c1c2d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:27:19.735662 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6844bedb-845a-47e1-86f7-da48b6c1c2d0 admin admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:19.736058 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6844bedb-845a-47e1-86f7-da48b6c1c2d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:19.736314 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6844bedb-845a-47e1-86f7-da48b6c1c2d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:19.737030 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6844bedb-845a-47e1-86f7-da48b6c1c2d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:27:19.738648 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6844bedb-845a-47e1-86f7-da48b6c1c2d0 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:27:19.755018 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 934/1849] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 12:27:19 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 12:27:19.759713 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6844bedb-845a-47e1-86f7-da48b6c1c2d0 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:27:19.792852 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6844bedb-845a-47e1-86f7-da48b6c1c2d0 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:27:19.804653 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d88671-aa95-4ccd-ad51-cc31ecba8c52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:27:19.806618 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d88671-aa95-4ccd-ad51-cc31ecba8c52 admin admin] REQUEST_METHOD: `PUT` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:19.809024 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d88671-aa95-4ccd-ad51-cc31ecba8c52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:19.809399 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d88671-aa95-4ccd-ad51-cc31ecba8c52 admin admin] PATH_INFO: `/v3/projects/93c94348e0234467bec9236d7a54cef8/users/003b5ae25c3847358989e21c939dceef/roles/0688968254744e3f9913653cafea3091` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:19.838690 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d88671-aa95-4ccd-ad51-cc31ecba8c52 admin admin] RBAC: Authorizing `identity:create_grant(project_id=93c94348e0234467bec9236d7a54cef8, user_id=003b5ae25c3847358989e21c939dceef, role_id=0688968254744e3f9913653cafea3091)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:27:19.842698 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d88671-aa95-4ccd-ad51-cc31ecba8c52 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:27:19.844004 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c70ff4-b28b-4c07-b7a5-1d7aad0cf9ac None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:27:19.848058 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cada63-67a3-4cc9-8c0d-7da19cc312e6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f96fc14ed89478c8a8c2f11c87511e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '601361df39e34fcca71175aa94e425c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:27:19.848896 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cada63-67a3-4cc9-8c0d-7da19cc312e6 service cinder] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:19.849286 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cada63-67a3-4cc9-8c0d-7da19cc312e6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:19.849596 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cada63-67a3-4cc9-8c0d-7da19cc312e6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:19.868283 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 935/1850] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 16 12:27:19 2022] PUT /identity/v3/projects/93c94348e0234467bec9236d7a54cef8/users/003b5ae25c3847358989e21c939dceef/roles/0688968254744e3f9913653cafea3091 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:27:19.871594 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cada63-67a3-4cc9-8c0d-7da19cc312e6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:27:19.872203 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d88671-aa95-4ccd-ad51-cc31ecba8c52 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:27:19.873086 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cada63-67a3-4cc9-8c0d-7da19cc312e6 service cinder] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:27:19.890184 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:27:19.898441 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 916/1851] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 12:27:19 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 12:27:20.001305 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d88671-aa95-4ccd-ad51-cc31ecba8c52 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:27:20.008283 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b4134a-b830-40d3-a45d-2d974ede92ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:27:20.010217 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b4134a-b830-40d3-a45d-2d974ede92ef admin admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:20.010670 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b4134a-b830-40d3-a45d-2d974ede92ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:20.011112 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b4134a-b830-40d3-a45d-2d974ede92ef admin admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:20.012099 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b4134a-b830-40d3-a45d-2d974ede92ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:27:20.014294 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b4134a-b830-40d3-a45d-2d974ede92ef admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:27:20.032701 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 936/1852] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 12:27:19 2022] GET /identity/v3/roles => generated 1420 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 12:27:20.034908 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cada63-67a3-4cc9-8c0d-7da19cc312e6 service cinder] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:27:20.042591 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b4134a-b830-40d3-a45d-2d974ede92ef admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:27:20.055755 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cada63-67a3-4cc9-8c0d-7da19cc312e6 service cinder] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:27:20.057224 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-b5b4134a-b830-40d3-a45d-2d974ede92ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:27:20.070403 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a7b6a9-08d8-493b-96fa-8b1ffdbb432d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:27:20.071469 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a7b6a9-08d8-493b-96fa-8b1ffdbb432d admin admin] REQUEST_METHOD: `PUT` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:20.071653 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a7b6a9-08d8-493b-96fa-8b1ffdbb432d admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:20.071928 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a7b6a9-08d8-493b-96fa-8b1ffdbb432d admin admin] PATH_INFO: `/v3/projects/93c94348e0234467bec9236d7a54cef8/users/003b5ae25c3847358989e21c939dceef/roles/0688968254744e3f9913653cafea3091` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:20.075326 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a7b6a9-08d8-493b-96fa-8b1ffdbb432d admin admin] RBAC: Authorizing `identity:create_grant(project_id=93c94348e0234467bec9236d7a54cef8, user_id=003b5ae25c3847358989e21c939dceef, role_id=0688968254744e3f9913653cafea3091)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:27:20.093414 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b4134a-b830-40d3-a45d-2d974ede92ef admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:27:20.094433 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a7b6a9-08d8-493b-96fa-8b1ffdbb432d admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:27:20.106525 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82604fab-dd9c-4b59-9294-24c3814ae527 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:27:20.107419 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82604fab-dd9c-4b59-9294-24c3814ae527 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:20.109003 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82604fab-dd9c-4b59-9294-24c3814ae527 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:20.109298 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82604fab-dd9c-4b59-9294-24c3814ae527 admin admin] PATH_INFO: `/v3/projects/1603fcfe8a7d4879853b20f84a079948` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:20.111225 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82604fab-dd9c-4b59-9294-24c3814ae527 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1603fcfe8a7d4879853b20f84a079948)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:27:20.113104 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82604fab-dd9c-4b59-9294-24c3814ae527 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:27:20.127609 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 917/1853] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 16 12:27:20 2022] PUT /identity/v3/projects/93c94348e0234467bec9236d7a54cef8/users/003b5ae25c3847358989e21c939dceef/roles/0688968254744e3f9913653cafea3091 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:27:20.130480 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a68372-f7b4-4496-bbb7-503fa6b02c18 None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:20.130779 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a68372-f7b4-4496-bbb7-503fa6b02c18 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:20.131040 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a68372-f7b4-4496-bbb7-503fa6b02c18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:20.181810 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-79a68372-f7b4-4496-bbb7-503fa6b02c18 None None] MFA Rules not processed for user `003b5ae25c3847358989e21c939dceef`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:27:20.187830 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-79a68372-f7b4-4496-bbb7-503fa6b02c18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:27:20.227476 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-82604fab-dd9c-4b59-9294-24c3814ae527 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1603fcfe8a7d4879853b20f84a079948', 'request_id': 'req-82604fab-dd9c-4b59-9294-24c3814ae527'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:27:20.242296 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-82604fab-dd9c-4b59-9294-24c3814ae527 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1603fcfe8a7d4879853b20f84a079948', 'request_id': 'req-82604fab-dd9c-4b59-9294-24c3814ae527'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:27:20.254727 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-82604fab-dd9c-4b59-9294-24c3814ae527 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1603fcfe8a7d4879853b20f84a079948', 'request_id': 'req-82604fab-dd9c-4b59-9294-24c3814ae527'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:27:20.283860 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-82604fab-dd9c-4b59-9294-24c3814ae527 admin admin] The token cache is being invalidate because project 1603fcfe8a7d4879853b20f84a079948 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 12:27:20.285182 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-82604fab-dd9c-4b59-9294-24c3814ae527 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:27:20.288655 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-82604fab-dd9c-4b59-9294-24c3814ae527 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:27:20.300347 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 937/1854] 10.222.0.44 () {58 vars in 1232 bytes} [Thu Jun 16 12:27:20 2022] DELETE /identity/v3/projects/1603fcfe8a7d4879853b20f84a079948 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:27:20.304734 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82604fab-dd9c-4b59-9294-24c3814ae527 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:27:20.310102 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-82604fab-dd9c-4b59-9294-24c3814ae527 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:27:20.403964 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 918/1855] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 12:27:20 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:27:20.405011 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a68372-f7b4-4496-bbb7-503fa6b02c18 None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:27:20.409511 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-79a68372-f7b4-4496-bbb7-503fa6b02c18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:27:20.475198 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82604fab-dd9c-4b59-9294-24c3814ae527 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:27:20.490749 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec192fbb-a8b3-4a9d-92cc-9a18667b956e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:27:20.492681 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec192fbb-a8b3-4a9d-92cc-9a18667b956e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:20.493126 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec192fbb-a8b3-4a9d-92cc-9a18667b956e admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:20.493739 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec192fbb-a8b3-4a9d-92cc-9a18667b956e admin admin] PATH_INFO: `/v3/users/d14ac3be4bfe497096baf7deca18a0f2` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:20.495450 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec192fbb-a8b3-4a9d-92cc-9a18667b956e admin admin] RBAC: Authorizing `identity:delete_user(user_id=d14ac3be4bfe497096baf7deca18a0f2)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:27:20.509009 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec192fbb-a8b3-4a9d-92cc-9a18667b956e admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:27:20.577778 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a68372-f7b4-4496-bbb7-503fa6b02c18 None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:27:20.583045 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:27:20.589880 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dcf287-4402-4925-b0cc-4b536a1d3568 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f96fc14ed89478c8a8c2f11c87511e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '601361df39e34fcca71175aa94e425c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:27:20.592843 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dcf287-4402-4925-b0cc-4b536a1d3568 service cinder] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:20.593086 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dcf287-4402-4925-b0cc-4b536a1d3568 service cinder] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:20.593504 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dcf287-4402-4925-b0cc-4b536a1d3568 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:20.596826 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-67dcf287-4402-4925-b0cc-4b536a1d3568 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:27:20.604408 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-ec192fbb-a8b3-4a9d-92cc-9a18667b956e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd14ac3be4bfe497096baf7deca18a0f2'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:27:20.605553 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-ec192fbb-a8b3-4a9d-92cc-9a18667b956e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd14ac3be4bfe497096baf7deca18a0f2'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:27:20.617635 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-ec192fbb-a8b3-4a9d-92cc-9a18667b956e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd14ac3be4bfe497096baf7deca18a0f2'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:27:20.618390 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-ec192fbb-a8b3-4a9d-92cc-9a18667b956e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd14ac3be4bfe497096baf7deca18a0f2'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:27:20.628021 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-ec192fbb-a8b3-4a9d-92cc-9a18667b956e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd14ac3be4bfe497096baf7deca18a0f2'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:27:20.646460 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:27:20.656994 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 938/1856] 10.222.0.44 () {58 vars in 1223 bytes} [Thu Jun 16 12:27:20 2022] DELETE /identity/v3/users/d14ac3be4bfe497096baf7deca18a0f2 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:27:20.656994 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec192fbb-a8b3-4a9d-92cc-9a18667b956e admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:27:20.657926 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-ec192fbb-a8b3-4a9d-92cc-9a18667b956e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:27:20.686964 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67dcf287-4402-4925-b0cc-4b536a1d3568 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:27:20.688410 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67dcf287-4402-4925-b0cc-4b536a1d3568 service cinder] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:27:20.698993 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 919/1857] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 12:27:20 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 12:27:20.749895 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec192fbb-a8b3-4a9d-92cc-9a18667b956e admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:27:20.754263 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e704c4-8db3-492a-b699-225e46ec6bcf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f96fc14ed89478c8a8c2f11c87511e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '601361df39e34fcca71175aa94e425c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:27:20.754845 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e704c4-8db3-492a-b699-225e46ec6bcf service cinder] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:20.755133 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e704c4-8db3-492a-b699-225e46ec6bcf service cinder] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:20.755414 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e704c4-8db3-492a-b699-225e46ec6bcf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:20.757546 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-b1e704c4-8db3-492a-b699-225e46ec6bcf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:27:20.889746 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e704c4-8db3-492a-b699-225e46ec6bcf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:27:20.891717 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e704c4-8db3-492a-b699-225e46ec6bcf service cinder] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:27:20.907823 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 939/1858] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 12:27:20 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 12:27:21.109608 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dcf287-4402-4925-b0cc-4b536a1d3568 service cinder] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:27:21.119794 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-67dcf287-4402-4925-b0cc-4b536a1d3568 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:27:21.151561 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dcf287-4402-4925-b0cc-4b536a1d3568 service cinder] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:27:21.251970 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe13df9f-a90d-4a5a-9a86-d6d6c1ea0370 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:27:21.254003 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe13df9f-a90d-4a5a-9a86-d6d6c1ea0370 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:21.255068 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe13df9f-a90d-4a5a-9a86-d6d6c1ea0370 admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:21.255492 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe13df9f-a90d-4a5a-9a86-d6d6c1ea0370 admin admin] PATH_INFO: `/v3/users/2010e2a9e69342678c2ad441cf4577f6` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:21.261010 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe13df9f-a90d-4a5a-9a86-d6d6c1ea0370 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2010e2a9e69342678c2ad441cf4577f6)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:27:21.263956 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe13df9f-a90d-4a5a-9a86-d6d6c1ea0370 admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:27:21.338387 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e704c4-8db3-492a-b699-225e46ec6bcf service cinder] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:27:21.339984 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-b1e704c4-8db3-492a-b699-225e46ec6bcf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:27:21.355205 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-fe13df9f-a90d-4a5a-9a86-d6d6c1ea0370 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2010e2a9e69342678c2ad441cf4577f6'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:27:21.367454 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e704c4-8db3-492a-b699-225e46ec6bcf service cinder] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:27:21.390980 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beac47a0-585b-49df-9082-fe386588b124 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:27:21.392952 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beac47a0-585b-49df-9082-fe386588b124 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:21.393450 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beac47a0-585b-49df-9082-fe386588b124 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:21.394055 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beac47a0-585b-49df-9082-fe386588b124 admin admin] PATH_INFO: `/v3/projects/8521f66c75444da7929ffd0f2eaf6bff` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:21.395678 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beac47a0-585b-49df-9082-fe386588b124 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8521f66c75444da7929ffd0f2eaf6bff)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:27:21.401619 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beac47a0-585b-49df-9082-fe386588b124 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:27:21.406751 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-fe13df9f-a90d-4a5a-9a86-d6d6c1ea0370 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2010e2a9e69342678c2ad441cf4577f6'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:27:21.432922 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-fe13df9f-a90d-4a5a-9a86-d6d6c1ea0370 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2010e2a9e69342678c2ad441cf4577f6'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:27:21.433668 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-fe13df9f-a90d-4a5a-9a86-d6d6c1ea0370 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2010e2a9e69342678c2ad441cf4577f6'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:27:21.434899 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-fe13df9f-a90d-4a5a-9a86-d6d6c1ea0370 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2010e2a9e69342678c2ad441cf4577f6'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:27:21.497576 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 920/1859] 10.222.0.44 () {58 vars in 1223 bytes} [Thu Jun 16 12:27:21 2022] DELETE /identity/v3/users/2010e2a9e69342678c2ad441cf4577f6 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:27:21.502081 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba542e4-74fa-48e7-a87f-aad7d1a46f8c None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:21.502590 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba542e4-74fa-48e7-a87f-aad7d1a46f8c None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:21.504018 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba542e4-74fa-48e7-a87f-aad7d1a46f8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:21.513530 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-beac47a0-585b-49df-9082-fe386588b124 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8521f66c75444da7929ffd0f2eaf6bff', 'request_id': 'req-beac47a0-585b-49df-9082-fe386588b124'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:27:21.519664 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:27:21.532620 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-beac47a0-585b-49df-9082-fe386588b124 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8521f66c75444da7929ffd0f2eaf6bff', 'request_id': 'req-beac47a0-585b-49df-9082-fe386588b124'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:27:21.547140 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-beac47a0-585b-49df-9082-fe386588b124 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8521f66c75444da7929ffd0f2eaf6bff', 'request_id': 'req-beac47a0-585b-49df-9082-fe386588b124'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:27:21.549829 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-eba542e4-74fa-48e7-a87f-aad7d1a46f8c None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:27:21.552279 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-eba542e4-74fa-48e7-a87f-aad7d1a46f8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:27:21.578154 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-beac47a0-585b-49df-9082-fe386588b124 admin admin] The token cache is being invalidate because project 8521f66c75444da7929ffd0f2eaf6bff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 12:27:21.578675 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-beac47a0-585b-49df-9082-fe386588b124 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:27:21.581644 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-beac47a0-585b-49df-9082-fe386588b124 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:27:21.590970 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 940/1860] 10.222.0.44 () {58 vars in 1232 bytes} [Thu Jun 16 12:27:21 2022] DELETE /identity/v3/projects/8521f66c75444da7929ffd0f2eaf6bff => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:27:21.600124 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba47bb45-7ff6-4aef-9474-0de7316b8bf8 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:21.602061 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba47bb45-7ff6-4aef-9474-0de7316b8bf8 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:21.602061 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba47bb45-7ff6-4aef-9474-0de7316b8bf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:21.691566 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:27:21.741779 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 921/1861] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 12:27:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:27:21.744494 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba542e4-74fa-48e7-a87f-aad7d1a46f8c None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:27:21.746912 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-eba542e4-74fa-48e7-a87f-aad7d1a46f8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:27:21.870389 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba542e4-74fa-48e7-a87f-aad7d1a46f8c None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:27:21.874779 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d68fb4-49d1-4676-a67b-11c9ec6e7eea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1094729b25a4be7b0b394998c9ca681', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '601361df39e34fcca71175aa94e425c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:27:21.876473 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d68fb4-49d1-4676-a67b-11c9ec6e7eea service neutron] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:21.876959 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d68fb4-49d1-4676-a67b-11c9ec6e7eea service neutron] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:21.877341 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d68fb4-49d1-4676-a67b-11c9ec6e7eea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:21.898762 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d68fb4-49d1-4676-a67b-11c9ec6e7eea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:27:21.899650 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-ba47bb45-7ff6-4aef-9474-0de7316b8bf8 None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:27:21.901604 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d68fb4-49d1-4676-a67b-11c9ec6e7eea service neutron] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:27:21.902327 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-ba47bb45-7ff6-4aef-9474-0de7316b8bf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:27:21.917181 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 922/1862] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 12:27:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 12:27:21.920914 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 941/1863] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 12:27:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 329 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:27:21.924543 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d68fb4-49d1-4676-a67b-11c9ec6e7eea service neutron] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:27:21.925388 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8718fb6a-7840-4a17-bb60-f205b2150055 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:21.927936 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-68d68fb4-49d1-4676-a67b-11c9ec6e7eea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:27:21.928438 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8718fb6a-7840-4a17-bb60-f205b2150055 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:21.929457 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8718fb6a-7840-4a17-bb60-f205b2150055 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:21.962011 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d68fb4-49d1-4676-a67b-11c9ec6e7eea service neutron] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:27:21.966874 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-8718fb6a-7840-4a17-bb60-f205b2150055 None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:27:21.968108 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-8718fb6a-7840-4a17-bb60-f205b2150055 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:27:21.970505 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2569d924-c240-4d19-8cdf-be8bb16b1879 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:27:21.971651 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2569d924-c240-4d19-8cdf-be8bb16b1879 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:21.972025 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2569d924-c240-4d19-8cdf-be8bb16b1879 admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:21.972316 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2569d924-c240-4d19-8cdf-be8bb16b1879 admin admin] PATH_INFO: `/v3/users/a6677ed4c76844c98dae15e875b564a7` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:21.977570 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2569d924-c240-4d19-8cdf-be8bb16b1879 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a6677ed4c76844c98dae15e875b564a7)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:27:21.979927 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2569d924-c240-4d19-8cdf-be8bb16b1879 admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:27:21.984314 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 942/1864] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 12:27:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:27:21.985538 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8718fb6a-7840-4a17-bb60-f205b2150055 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:27:21.996615 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8718fb6a-7840-4a17-bb60-f205b2150055 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:27:22.002054 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eac9eea-3460-45f5-a78b-629deef0b15d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:27:22.002758 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eac9eea-3460-45f5-a78b-629deef0b15d admin admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:22.003044 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eac9eea-3460-45f5-a78b-629deef0b15d admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:22.003381 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eac9eea-3460-45f5-a78b-629deef0b15d admin admin] PATH_INFO: `/v3/domains` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:22.004646 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eac9eea-3460-45f5-a78b-629deef0b15d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:27:22.005039 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eac9eea-3460-45f5-a78b-629deef0b15d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:27:22.007530 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eac9eea-3460-45f5-a78b-629deef0b15d admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:27:22.028243 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 943/1865] 10.222.0.44 () {58 vars in 1152 bytes} [Thu Jun 16 12:27:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:27:22.029187 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eac9eea-3460-45f5-a78b-629deef0b15d admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:27:22.044270 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eac9eea-3460-45f5-a78b-629deef0b15d admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:27:22.050996 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d499d1f0-7430-427c-8d38-a386bbb456d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:27:22.051937 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d499d1f0-7430-427c-8d38-a386bbb456d6 admin admin] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:22.052266 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d499d1f0-7430-427c-8d38-a386bbb456d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:22.052548 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d499d1f0-7430-427c-8d38-a386bbb456d6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:22.053457 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d499d1f0-7430-427c-8d38-a386bbb456d6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:27:22.055969 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d499d1f0-7430-427c-8d38-a386bbb456d6 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:27:22.084007 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-2569d924-c240-4d19-8cdf-be8bb16b1879 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a6677ed4c76844c98dae15e875b564a7'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:27:22.107170 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 944/1866] 10.222.0.44 () {60 vars in 1152 bytes} [Thu Jun 16 12:27:22 2022] POST /identity/v3/projects => generated 361 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 12:27:22.111698 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c060b68f-7339-4ef9-ba92-caa5495fbb29 None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:22.111698 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c060b68f-7339-4ef9-ba92-caa5495fbb29 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:22.111939 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c060b68f-7339-4ef9-ba92-caa5495fbb29 None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:22.117366 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 945/1867] 10.222.0.44 () {54 vars in 921 bytes} [Thu Jun 16 12:27:22 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 12:27:22.118710 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c060b68f-7339-4ef9-ba92-caa5495fbb29 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:27:22.120874 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-2569d924-c240-4d19-8cdf-be8bb16b1879 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a6677ed4c76844c98dae15e875b564a7'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:27:22.139478 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-2569d924-c240-4d19-8cdf-be8bb16b1879 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a6677ed4c76844c98dae15e875b564a7'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:27:22.141713 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-2569d924-c240-4d19-8cdf-be8bb16b1879 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a6677ed4c76844c98dae15e875b564a7'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:27:22.143446 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-2569d924-c240-4d19-8cdf-be8bb16b1879 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a6677ed4c76844c98dae15e875b564a7'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:27:22.172529 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 923/1868] 10.222.0.44 () {58 vars in 1223 bytes} [Thu Jun 16 12:27:21 2022] DELETE /identity/v3/users/a6677ed4c76844c98dae15e875b564a7 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:27:22.180170 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135631c9-b272-448a-900c-471b89a3ea01 None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:22.180464 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135631c9-b272-448a-900c-471b89a3ea01 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:22.180763 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135631c9-b272-448a-900c-471b89a3ea01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:22.227711 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-135631c9-b272-448a-900c-471b89a3ea01 None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:27:22.231811 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-135631c9-b272-448a-900c-471b89a3ea01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:27:22.269322 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c060b68f-7339-4ef9-ba92-caa5495fbb29 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:27:22.325640 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 924/1869] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 12:27:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:27:22.327211 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafa3d10-cf8e-4fd4-b364-2b9f280ae159 None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:22.327552 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafa3d10-cf8e-4fd4-b364-2b9f280ae159 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:22.327840 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafa3d10-cf8e-4fd4-b364-2b9f280ae159 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:22.342779 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:27:22.351000 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-cafa3d10-cf8e-4fd4-b364-2b9f280ae159 None None] MFA Rules not processed for user `edfb12d445e74136b90800e93941f468`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:27:22.354066 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-cafa3d10-cf8e-4fd4-b364-2b9f280ae159 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:27:22.364040 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4699a450-dd9d-43e0-8bd3-f189a4d56726 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:27:22.364587 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4699a450-dd9d-43e0-8bd3-f189a4d56726 admin admin] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:22.364906 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4699a450-dd9d-43e0-8bd3-f189a4d56726 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:22.365334 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4699a450-dd9d-43e0-8bd3-f189a4d56726 admin admin] PATH_INFO: `/v3/users` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:22.366808 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4699a450-dd9d-43e0-8bd3-f189a4d56726 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:27:22.368781 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4699a450-dd9d-43e0-8bd3-f189a4d56726 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:27:22.402655 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 946/1870] 10.222.0.44 () {60 vars in 1143 bytes} [Thu Jun 16 12:27:22 2022] POST /identity/v3/users => generated 281 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 12:27:22.403645 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4699a450-dd9d-43e0-8bd3-f189a4d56726 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:27:22.407269 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-4699a450-dd9d-43e0-8bd3-f189a4d56726 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:27:22.453902 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:DELETE=3,keystone:SELECT=93,keystone:INSERT=4 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:27:22.465998 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 925/1871] 10.222.0.44 () {58 vars in 1018 bytes} [Thu Jun 16 12:27:22 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:27:22.467325 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafa3d10-cf8e-4fd4-b364-2b9f280ae159 None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:27:22.468767 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-cafa3d10-cf8e-4fd4-b364-2b9f280ae159 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:27:22.483418 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafa3d10-cf8e-4fd4-b364-2b9f280ae159 None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:27:22.490051 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4891f5-746c-4837-8391-bf1a73c02b2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:27:22.491491 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4891f5-746c-4837-8391-bf1a73c02b2a admin admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:22.491928 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4891f5-746c-4837-8391-bf1a73c02b2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:22.492428 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4891f5-746c-4837-8391-bf1a73c02b2a admin admin] PATH_INFO: `/v3/roles` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:22.500639 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4891f5-746c-4837-8391-bf1a73c02b2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:27:22.502319 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4891f5-746c-4837-8391-bf1a73c02b2a admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:27:22.505225 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4699a450-dd9d-43e0-8bd3-f189a4d56726 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:27:22.515481 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3399869-1899-4161-82e8-ee9e41ca37b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1094729b25a4be7b0b394998c9ca681', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '601361df39e34fcca71175aa94e425c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:27:22.515970 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 926/1872] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 12:27:22 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 12:27:22.516962 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4891f5-746c-4837-8391-bf1a73c02b2a admin admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:27:22.520372 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3399869-1899-4161-82e8-ee9e41ca37b6 service neutron] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:22.520904 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3399869-1899-4161-82e8-ee9e41ca37b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:22.521028 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3399869-1899-4161-82e8-ee9e41ca37b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:22.521776 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-fc4891f5-746c-4837-8391-bf1a73c02b2a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:27:22.542855 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3399869-1899-4161-82e8-ee9e41ca37b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:27:22.544319 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3399869-1899-4161-82e8-ee9e41ca37b6 service neutron] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:27:22.553099 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4891f5-746c-4837-8391-bf1a73c02b2a admin admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:27:22.563657 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 947/1873] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 12:27:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 12:27:22.564529 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3399869-1899-4161-82e8-ee9e41ca37b6 service neutron] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:27:22.568315 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3588a420-5cd3-4b5c-ac6f-a4d252f40d48 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edfb12d445e74136b90800e93941f468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '601361df39e34fcca71175aa94e425c4', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:27:22.570579 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3588a420-5cd3-4b5c-ac6f-a4d252f40d48 service nova] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:22.570868 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3588a420-5cd3-4b5c-ac6f-a4d252f40d48 service nova] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:22.571148 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3588a420-5cd3-4b5c-ac6f-a4d252f40d48 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:22.582677 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3588a420-5cd3-4b5c-ac6f-a4d252f40d48 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:27:22.584686 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3588a420-5cd3-4b5c-ac6f-a4d252f40d48 service nova] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:27:22.596391 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3399869-1899-4161-82e8-ee9e41ca37b6 service neutron] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:27:22.602939 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcdd8c5-4924-4701-a3ff-90b05501adb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:27:22.603820 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcdd8c5-4924-4701-a3ff-90b05501adb3 admin admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:22.604122 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcdd8c5-4924-4701-a3ff-90b05501adb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:22.604395 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcdd8c5-4924-4701-a3ff-90b05501adb3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:22.605705 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcdd8c5-4924-4701-a3ff-90b05501adb3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:27:22.607319 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcdd8c5-4924-4701-a3ff-90b05501adb3 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:27:22.607957 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 927/1874] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 12:27:22 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 12:27:22.623713 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 948/1875] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 12:27:22 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 12:27:22.625939 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3588a420-5cd3-4b5c-ac6f-a4d252f40d48 service nova] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:27:22.641063 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3588a420-5cd3-4b5c-ac6f-a4d252f40d48 service nova] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:27:22.645638 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ceb12d1-acb9-4084-ac37-95416ae67af7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:27:22.646664 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ceb12d1-acb9-4084-ac37-95416ae67af7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:22.647054 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ceb12d1-acb9-4084-ac37-95416ae67af7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:22.647610 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ceb12d1-acb9-4084-ac37-95416ae67af7 admin admin] PATH_INFO: `/v3/projects/f2073d45359e4252914f8a096a1f2aeb/users/e0ee617ac7174a20ac1f127bcce36d89/roles/c39882b202e942479a7cdac2fc6da72c` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:22.687677 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ceb12d1-acb9-4084-ac37-95416ae67af7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f2073d45359e4252914f8a096a1f2aeb, user_id=e0ee617ac7174a20ac1f127bcce36d89, role_id=c39882b202e942479a7cdac2fc6da72c)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:27:22.691833 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ceb12d1-acb9-4084-ac37-95416ae67af7 admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:27:22.720886 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 928/1876] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 16 12:27:22 2022] PUT /identity/v3/projects/f2073d45359e4252914f8a096a1f2aeb/users/e0ee617ac7174a20ac1f127bcce36d89/roles/c39882b202e942479a7cdac2fc6da72c => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:27:22.724923 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec2f123-6490-450d-af36-56ca70929f09 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:22.728783 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec2f123-6490-450d-af36-56ca70929f09 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:22.730357 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec2f123-6490-450d-af36-56ca70929f09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:22.771795 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-dec2f123-6490-450d-af36-56ca70929f09 None None] MFA Rules not processed for user `e0ee617ac7174a20ac1f127bcce36d89`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:27:22.773496 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-dec2f123-6490-450d-af36-56ca70929f09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:27:22.788469 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ceb12d1-acb9-4084-ac37-95416ae67af7 admin admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:27:22.790595 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-6ceb12d1-acb9-4084-ac37-95416ae67af7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:27:22.915431 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ceb12d1-acb9-4084-ac37-95416ae67af7 admin admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:27:22.928147 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835396a6-fcfd-4085-9acd-1f5eef4de559 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:27:22.929968 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835396a6-fcfd-4085-9acd-1f5eef4de559 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:22.930522 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835396a6-fcfd-4085-9acd-1f5eef4de559 admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:22.931052 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835396a6-fcfd-4085-9acd-1f5eef4de559 admin admin] PATH_INFO: `/v3/projects/ea0afb32985a4773bcbb4891cf13e252` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:22.936316 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835396a6-fcfd-4085-9acd-1f5eef4de559 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ea0afb32985a4773bcbb4891cf13e252)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:27:22.936316 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835396a6-fcfd-4085-9acd-1f5eef4de559 admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:27:22.947812 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 949/1877] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 12:27:22 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:27:22.984045 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec2f123-6490-450d-af36-56ca70929f09 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:27:22.987241 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-dec2f123-6490-450d-af36-56ca70929f09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:27:23.016689 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-835396a6-fcfd-4085-9acd-1f5eef4de559 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ea0afb32985a4773bcbb4891cf13e252', 'request_id': 'req-835396a6-fcfd-4085-9acd-1f5eef4de559'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:27:23.019870 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=94,keystone:INSERT=2,keystone:DELETE=4 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:27:23.029639 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-835396a6-fcfd-4085-9acd-1f5eef4de559 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ea0afb32985a4773bcbb4891cf13e252', 'request_id': 'req-835396a6-fcfd-4085-9acd-1f5eef4de559'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:27:23.064650 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-835396a6-fcfd-4085-9acd-1f5eef4de559 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ea0afb32985a4773bcbb4891cf13e252', 'request_id': 'req-835396a6-fcfd-4085-9acd-1f5eef4de559'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:27:23.089241 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-835396a6-fcfd-4085-9acd-1f5eef4de559 admin admin] The token cache is being invalidate because project ea0afb32985a4773bcbb4891cf13e252 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 12:27:23.090820 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-835396a6-fcfd-4085-9acd-1f5eef4de559 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:27:23.093096 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-835396a6-fcfd-4085-9acd-1f5eef4de559 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:27:23.098582 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 929/1878] 10.222.0.44 () {58 vars in 1232 bytes} [Thu Jun 16 12:27:22 2022] DELETE /identity/v3/projects/ea0afb32985a4773bcbb4891cf13e252 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 12:27:23.101766 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835396a6-fcfd-4085-9acd-1f5eef4de559 admin admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:27:23.106464 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-835396a6-fcfd-4085-9acd-1f5eef4de559 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:27:23.110109 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec2f123-6490-450d-af36-56ca70929f09 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:27:23.254506 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75d0aba-3e69-490d-8492-4db2f6589233 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f96fc14ed89478c8a8c2f11c87511e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '601361df39e34fcca71175aa94e425c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:27:23.255590 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75d0aba-3e69-490d-8492-4db2f6589233 service cinder] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:23.256034 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75d0aba-3e69-490d-8492-4db2f6589233 service cinder] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:23.256321 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75d0aba-3e69-490d-8492-4db2f6589233 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:23.259350 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-d75d0aba-3e69-490d-8492-4db2f6589233 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:27:23.279806 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835396a6-fcfd-4085-9acd-1f5eef4de559 admin admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:27:23.286553 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd459e18-61bb-4196-bfb0-66634dae51dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:27:23.287565 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd459e18-61bb-4196-bfb0-66634dae51dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:23.289473 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd459e18-61bb-4196-bfb0-66634dae51dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:23.289473 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd459e18-61bb-4196-bfb0-66634dae51dc admin admin] PATH_INFO: `/v3/users/70a96996d7e742dcbcd5ca9d3c3d5c21` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:23.290580 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd459e18-61bb-4196-bfb0-66634dae51dc admin admin] RBAC: Authorizing `identity:delete_user(user_id=70a96996d7e742dcbcd5ca9d3c3d5c21)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:27:23.292598 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd459e18-61bb-4196-bfb0-66634dae51dc admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:27:23.295833 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:27:23.377534 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-cd459e18-61bb-4196-bfb0-66634dae51dc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '70a96996d7e742dcbcd5ca9d3c3d5c21'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:27:23.402465 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75d0aba-3e69-490d-8492-4db2f6589233 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:27:23.405110 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75d0aba-3e69-490d-8492-4db2f6589233 service cinder] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:27:23.425809 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-cd459e18-61bb-4196-bfb0-66634dae51dc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '70a96996d7e742dcbcd5ca9d3c3d5c21'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:27:23.431056 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 950/1879] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 12:27:22 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 447 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 12:27:23.440709 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-cd459e18-61bb-4196-bfb0-66634dae51dc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '70a96996d7e742dcbcd5ca9d3c3d5c21'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:27:23.441781 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-cd459e18-61bb-4196-bfb0-66634dae51dc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '70a96996d7e742dcbcd5ca9d3c3d5c21'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:27:23.443107 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-cd459e18-61bb-4196-bfb0-66634dae51dc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '70a96996d7e742dcbcd5ca9d3c3d5c21'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:27:23.459009 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75d0aba-3e69-490d-8492-4db2f6589233 service cinder] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:27:23.460953 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-d75d0aba-3e69-490d-8492-4db2f6589233 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:27:23.471472 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 930/1880] 10.222.0.44 () {58 vars in 1223 bytes} [Thu Jun 16 12:27:23 2022] DELETE /identity/v3/users/70a96996d7e742dcbcd5ca9d3c3d5c21 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:27:23.482479 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75d0aba-3e69-490d-8492-4db2f6589233 service cinder] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:27:23.577895 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0509a7-67fd-41f5-835e-441f87ba4928 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:27:23.579155 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0509a7-67fd-41f5-835e-441f87ba4928 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:23.579500 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0509a7-67fd-41f5-835e-441f87ba4928 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:23.579925 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0509a7-67fd-41f5-835e-441f87ba4928 admin admin] PATH_INFO: `/v3/users/e0ee617ac7174a20ac1f127bcce36d89` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:23.584618 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0509a7-67fd-41f5-835e-441f87ba4928 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e0ee617ac7174a20ac1f127bcce36d89)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:27:23.594822 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0509a7-67fd-41f5-835e-441f87ba4928 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:27:23.615828 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd459e18-61bb-4196-bfb0-66634dae51dc admin admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:27:23.618214 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-cd459e18-61bb-4196-bfb0-66634dae51dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:27:23.641224 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd459e18-61bb-4196-bfb0-66634dae51dc admin admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:27:23.649719 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c67c2b-cf5e-4fa8-ab4e-2c86c467fdc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:27:23.651802 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c67c2b-cf5e-4fa8-ab4e-2c86c467fdc8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:23.651802 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c67c2b-cf5e-4fa8-ab4e-2c86c467fdc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:23.651802 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c67c2b-cf5e-4fa8-ab4e-2c86c467fdc8 admin admin] PATH_INFO: `/v3/projects/0fb4209dd5124337bdc6b321dcf9c525` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:23.653277 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c67c2b-cf5e-4fa8-ab4e-2c86c467fdc8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0fb4209dd5124337bdc6b321dcf9c525)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:27:23.656259 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c67c2b-cf5e-4fa8-ab4e-2c86c467fdc8 admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:27:23.717044 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-3a0509a7-67fd-41f5-835e-441f87ba4928 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e0ee617ac7174a20ac1f127bcce36d89'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:27:23.717819 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-3a0509a7-67fd-41f5-835e-441f87ba4928 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e0ee617ac7174a20ac1f127bcce36d89'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:27:23.735894 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-3a0509a7-67fd-41f5-835e-441f87ba4928 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e0ee617ac7174a20ac1f127bcce36d89'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:27:23.737557 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-3a0509a7-67fd-41f5-835e-441f87ba4928 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e0ee617ac7174a20ac1f127bcce36d89'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:27:23.745632 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-c6c67c2b-cf5e-4fa8-ab4e-2c86c467fdc8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0fb4209dd5124337bdc6b321dcf9c525', 'request_id': 'req-c6c67c2b-cf5e-4fa8-ab4e-2c86c467fdc8'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:27:23.753090 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:DELETE=18,keystone:SELECT=80,keystone:INSERT=2 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:27:23.757762 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-3a0509a7-67fd-41f5-835e-441f87ba4928 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e0ee617ac7174a20ac1f127bcce36d89'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:27:23.768394 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-c6c67c2b-cf5e-4fa8-ab4e-2c86c467fdc8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0fb4209dd5124337bdc6b321dcf9c525', 'request_id': 'req-c6c67c2b-cf5e-4fa8-ab4e-2c86c467fdc8'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:27:23.784915 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-c6c67c2b-cf5e-4fa8-ab4e-2c86c467fdc8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0fb4209dd5124337bdc6b321dcf9c525', 'request_id': 'req-c6c67c2b-cf5e-4fa8-ab4e-2c86c467fdc8'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:27:23.824349 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 951/1881] 10.222.0.44 () {58 vars in 1223 bytes} [Thu Jun 16 12:27:23 2022] DELETE /identity/v3/users/e0ee617ac7174a20ac1f127bcce36d89 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:27:23.828891 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afa0e75-89e9-4f03-889c-534b0ce30658 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:23.829507 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afa0e75-89e9-4f03-889c-534b0ce30658 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:23.830115 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afa0e75-89e9-4f03-889c-534b0ce30658 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:23.831497 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-c6c67c2b-cf5e-4fa8-ab4e-2c86c467fdc8 admin admin] The token cache is being invalidate because project 0fb4209dd5124337bdc6b321dcf9c525 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 12:27:23.831796 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-c6c67c2b-cf5e-4fa8-ab4e-2c86c467fdc8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:27:23.832745 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-c6c67c2b-cf5e-4fa8-ab4e-2c86c467fdc8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:27:23.838614 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 931/1882] 10.222.0.44 () {58 vars in 1232 bytes} [Thu Jun 16 12:27:23 2022] DELETE /identity/v3/projects/0fb4209dd5124337bdc6b321dcf9c525 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:27:23.839502 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c67c2b-cf5e-4fa8-ab4e-2c86c467fdc8 admin admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:27:23.841533 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-c6c67c2b-cf5e-4fa8-ab4e-2c86c467fdc8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:27:23.863686 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-9afa0e75-89e9-4f03-889c-534b0ce30658 None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:27:23.865223 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-9afa0e75-89e9-4f03-889c-534b0ce30658 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:27:23.932088 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c67c2b-cf5e-4fa8-ab4e-2c86c467fdc8 admin admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:27:23.952240 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:27:24.015454 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 952/1883] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 12:27:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 12:27:24.028054 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afa0e75-89e9-4f03-889c-534b0ce30658 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:27:24.029925 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-9afa0e75-89e9-4f03-889c-534b0ce30658 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:27:24.054071 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4944bc87-3801-44d7-af4b-53c76659a6ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:27:24.055000 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4944bc87-3801-44d7-af4b-53c76659a6ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:24.055275 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4944bc87-3801-44d7-af4b-53c76659a6ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:24.055548 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4944bc87-3801-44d7-af4b-53c76659a6ca admin admin] PATH_INFO: `/v3/users/003b5ae25c3847358989e21c939dceef` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:24.058432 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4944bc87-3801-44d7-af4b-53c76659a6ca admin admin] RBAC: Authorizing `identity:delete_user(user_id=003b5ae25c3847358989e21c939dceef)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:27:24.062025 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4944bc87-3801-44d7-af4b-53c76659a6ca admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:27:24.141301 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afa0e75-89e9-4f03-889c-534b0ce30658 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:27:24.150456 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23f244e-73f0-4e4f-9f16-9ffe81bec622 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1094729b25a4be7b0b394998c9ca681', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '601361df39e34fcca71175aa94e425c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:27:24.151124 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23f244e-73f0-4e4f-9f16-9ffe81bec622 service neutron] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:24.151403 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23f244e-73f0-4e4f-9f16-9ffe81bec622 service neutron] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:24.151677 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23f244e-73f0-4e4f-9f16-9ffe81bec622 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:24.153002 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-4944bc87-3801-44d7-af4b-53c76659a6ca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '003b5ae25c3847358989e21c939dceef'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:27:24.173899 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23f244e-73f0-4e4f-9f16-9ffe81bec622 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:27:24.175715 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23f244e-73f0-4e4f-9f16-9ffe81bec622 service neutron] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:27:24.177835 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-4944bc87-3801-44d7-af4b-53c76659a6ca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '003b5ae25c3847358989e21c939dceef'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:27:24.193195 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-4944bc87-3801-44d7-af4b-53c76659a6ca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '003b5ae25c3847358989e21c939dceef'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:27:24.195116 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-4944bc87-3801-44d7-af4b-53c76659a6ca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '003b5ae25c3847358989e21c939dceef'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:27:24.204261 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-4944bc87-3801-44d7-af4b-53c76659a6ca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '003b5ae25c3847358989e21c939dceef'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:27:24.205487 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 953/1884] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 12:27:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 12:27:24.228548 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 932/1885] 10.222.0.44 () {58 vars in 1223 bytes} [Thu Jun 16 12:27:23 2022] DELETE /identity/v3/users/003b5ae25c3847358989e21c939dceef => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:27:24.507736 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23f244e-73f0-4e4f-9f16-9ffe81bec622 service neutron] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:27:24.510726 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-b23f244e-73f0-4e4f-9f16-9ffe81bec622 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:27:24.543642 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23f244e-73f0-4e4f-9f16-9ffe81bec622 service neutron] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:27:24.678768 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806d5078-c55d-4bb1-bfd5-e1bfaab365b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:27:24.680090 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806d5078-c55d-4bb1-bfd5-e1bfaab365b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:24.680519 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806d5078-c55d-4bb1-bfd5-e1bfaab365b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:24.680907 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806d5078-c55d-4bb1-bfd5-e1bfaab365b2 admin admin] PATH_INFO: `/v3/projects/b7b3305c2ad741249e41b5fbff27dafd` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:24.683220 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806d5078-c55d-4bb1-bfd5-e1bfaab365b2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b7b3305c2ad741249e41b5fbff27dafd)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:27:24.686352 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806d5078-c55d-4bb1-bfd5-e1bfaab365b2 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:27:24.792533 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-806d5078-c55d-4bb1-bfd5-e1bfaab365b2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b7b3305c2ad741249e41b5fbff27dafd', 'request_id': 'req-806d5078-c55d-4bb1-bfd5-e1bfaab365b2'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:27:24.804874 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-806d5078-c55d-4bb1-bfd5-e1bfaab365b2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b7b3305c2ad741249e41b5fbff27dafd', 'request_id': 'req-806d5078-c55d-4bb1-bfd5-e1bfaab365b2'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:27:24.813680 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-806d5078-c55d-4bb1-bfd5-e1bfaab365b2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b7b3305c2ad741249e41b5fbff27dafd', 'request_id': 'req-806d5078-c55d-4bb1-bfd5-e1bfaab365b2'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:27:24.829920 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-806d5078-c55d-4bb1-bfd5-e1bfaab365b2 admin admin] The token cache is being invalidate because project b7b3305c2ad741249e41b5fbff27dafd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 12:27:24.830232 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-806d5078-c55d-4bb1-bfd5-e1bfaab365b2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:27:24.831247 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-806d5078-c55d-4bb1-bfd5-e1bfaab365b2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:27:24.834191 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 954/1886] 10.222.0.44 () {58 vars in 1232 bytes} [Thu Jun 16 12:27:24 2022] DELETE /identity/v3/projects/b7b3305c2ad741249e41b5fbff27dafd => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:27:24.841031 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e49f7b-7d88-4674-8d10-fdb30c91ec1f None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:24.841560 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e49f7b-7d88-4674-8d10-fdb30c91ec1f None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:24.841756 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e49f7b-7d88-4674-8d10-fdb30c91ec1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:24.870381 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-e1e49f7b-7d88-4674-8d10-fdb30c91ec1f None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:27:24.872167 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-e1e49f7b-7d88-4674-8d10-fdb30c91ec1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:27:24.878395 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:27:24.967055 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806d5078-c55d-4bb1-bfd5-e1bfaab365b2 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:27:24.969077 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-806d5078-c55d-4bb1-bfd5-e1bfaab365b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:27:24.984516 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 933/1887] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 12:27:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:27:24.993916 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07760b65-7d59-4472-864b-c6f728cff636 None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:24.995714 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:27:24.996159 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07760b65-7d59-4472-864b-c6f728cff636 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:24.996451 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07760b65-7d59-4472-864b-c6f728cff636 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:25.038087 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-07760b65-7d59-4472-864b-c6f728cff636 None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:27:25.040120 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-07760b65-7d59-4472-864b-c6f728cff636 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:27:25.053055 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 934/1888] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 12:27:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:27:25.057541 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07760b65-7d59-4472-864b-c6f728cff636 None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:27:25.075252 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07760b65-7d59-4472-864b-c6f728cff636 None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:27:25.088801 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06857baf-fcea-49ac-a41a-088f22a76a5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:27:25.090382 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06857baf-fcea-49ac-a41a-088f22a76a5e admin admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:25.091443 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06857baf-fcea-49ac-a41a-088f22a76a5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:25.091564 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06857baf-fcea-49ac-a41a-088f22a76a5e admin admin] PATH_INFO: `/v3/domains` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:25.095622 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06857baf-fcea-49ac-a41a-088f22a76a5e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:27:25.095771 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06857baf-fcea-49ac-a41a-088f22a76a5e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:27:25.097939 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06857baf-fcea-49ac-a41a-088f22a76a5e admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:27:25.099766 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806d5078-c55d-4bb1-bfd5-e1bfaab365b2 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:27:25.108490 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680c116d-6ff7-4e10-a124-baa0258306b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:27:25.109742 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680c116d-6ff7-4e10-a124-baa0258306b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:25.110070 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680c116d-6ff7-4e10-a124-baa0258306b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:25.110420 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680c116d-6ff7-4e10-a124-baa0258306b4 admin admin] PATH_INFO: `/v3/projects/93c94348e0234467bec9236d7a54cef8` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:25.112733 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680c116d-6ff7-4e10-a124-baa0258306b4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=93c94348e0234467bec9236d7a54cef8)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:27:25.113490 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 935/1889] 10.222.0.44 () {58 vars in 1152 bytes} [Thu Jun 16 12:27:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:27:25.115430 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680c116d-6ff7-4e10-a124-baa0258306b4 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:27:25.118074 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06857baf-fcea-49ac-a41a-088f22a76a5e admin admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:27:25.133001 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06857baf-fcea-49ac-a41a-088f22a76a5e admin admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:27:25.143511 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e5d6fa-ae0c-468a-b94c-74fd42b7b663 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:27:25.146382 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e5d6fa-ae0c-468a-b94c-74fd42b7b663 admin admin] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:25.146950 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e5d6fa-ae0c-468a-b94c-74fd42b7b663 admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:25.148299 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e5d6fa-ae0c-468a-b94c-74fd42b7b663 admin admin] PATH_INFO: `/v3/projects` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:25.148936 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e5d6fa-ae0c-468a-b94c-74fd42b7b663 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:27:25.152570 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e5d6fa-ae0c-468a-b94c-74fd42b7b663 admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:27:25.202603 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 936/1890] 10.222.0.44 () {60 vars in 1152 bytes} [Thu Jun 16 12:27:25 2022] POST /identity/v3/projects => generated 373 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 12:27:25.204245 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e5d6fa-ae0c-468a-b94c-74fd42b7b663 admin admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:27:25.229674 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-680c116d-6ff7-4e10-a124-baa0258306b4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '93c94348e0234467bec9236d7a54cef8', 'request_id': 'req-680c116d-6ff7-4e10-a124-baa0258306b4'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:27:25.252692 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-680c116d-6ff7-4e10-a124-baa0258306b4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '93c94348e0234467bec9236d7a54cef8', 'request_id': 'req-680c116d-6ff7-4e10-a124-baa0258306b4'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:27:25.264377 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-680c116d-6ff7-4e10-a124-baa0258306b4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '93c94348e0234467bec9236d7a54cef8', 'request_id': 'req-680c116d-6ff7-4e10-a124-baa0258306b4'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:27:25.296371 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-680c116d-6ff7-4e10-a124-baa0258306b4 admin admin] The token cache is being invalidate because project 93c94348e0234467bec9236d7a54cef8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 12:27:25.296673 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-680c116d-6ff7-4e10-a124-baa0258306b4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:27:25.299599 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-680c116d-6ff7-4e10-a124-baa0258306b4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:27:25.305143 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 955/1891] 10.222.0.44 () {58 vars in 1232 bytes} [Thu Jun 16 12:27:24 2022] DELETE /identity/v3/projects/93c94348e0234467bec9236d7a54cef8 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:27:25.305143 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680c116d-6ff7-4e10-a124-baa0258306b4 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:27:25.305143 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-680c116d-6ff7-4e10-a124-baa0258306b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:27:25.337009 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e5d6fa-ae0c-468a-b94c-74fd42b7b663 admin admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:27:25.346663 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9bc4ec-37d8-4693-bf6b-5b56f7a7f735 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:27:25.348505 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9bc4ec-37d8-4693-bf6b-5b56f7a7f735 admin admin] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:25.349130 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9bc4ec-37d8-4693-bf6b-5b56f7a7f735 admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:25.349713 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9bc4ec-37d8-4693-bf6b-5b56f7a7f735 admin admin] PATH_INFO: `/v3/users` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:25.350468 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9bc4ec-37d8-4693-bf6b-5b56f7a7f735 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:27:25.355838 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9bc4ec-37d8-4693-bf6b-5b56f7a7f735 admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:27:25.403909 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 937/1892] 10.222.0.44 () {60 vars in 1143 bytes} [Thu Jun 16 12:27:25 2022] POST /identity/v3/users => generated 287 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 12:27:25.408406 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa906b3d-ed07-4db1-aaa7-dac80b15c39e None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:25.408931 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa906b3d-ed07-4db1-aaa7-dac80b15c39e None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:25.409203 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa906b3d-ed07-4db1-aaa7-dac80b15c39e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:25.472622 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-aa906b3d-ed07-4db1-aaa7-dac80b15c39e None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:27:25.478349 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-aa906b3d-ed07-4db1-aaa7-dac80b15c39e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:27:25.488866 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680c116d-6ff7-4e10-a124-baa0258306b4 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:27:25.497983 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3d2dea-e408-42ec-ad3e-4cbeb970140a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:27:25.498491 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3d2dea-e408-42ec-ad3e-4cbeb970140a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:25.498717 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3d2dea-e408-42ec-ad3e-4cbeb970140a admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:25.498995 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3d2dea-e408-42ec-ad3e-4cbeb970140a admin admin] PATH_INFO: `/v3/projects/f2073d45359e4252914f8a096a1f2aeb` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:25.500296 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 938/1893] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 12:27:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:27:25.501412 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa906b3d-ed07-4db1-aaa7-dac80b15c39e None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:27:25.506217 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-aa906b3d-ed07-4db1-aaa7-dac80b15c39e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:27:25.514231 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3d2dea-e408-42ec-ad3e-4cbeb970140a admin admin] RBAC: Authorizing `identity:delete_project(project_id=f2073d45359e4252914f8a096a1f2aeb)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:27:25.518588 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3d2dea-e408-42ec-ad3e-4cbeb970140a admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:27:25.541802 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa906b3d-ed07-4db1-aaa7-dac80b15c39e None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:27:25.547465 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b62f5a-5f3c-4675-bc2f-c1e2290219e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:27:25.548420 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b62f5a-5f3c-4675-bc2f-c1e2290219e8 admin admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:25.549097 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b62f5a-5f3c-4675-bc2f-c1e2290219e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:25.549896 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b62f5a-5f3c-4675-bc2f-c1e2290219e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:25.551055 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b62f5a-5f3c-4675-bc2f-c1e2290219e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:27:25.552915 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b62f5a-5f3c-4675-bc2f-c1e2290219e8 admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:27:25.565834 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 939/1894] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 12:27:25 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 12:27:25.568375 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f8d616-6c30-4504-a778-1420e1b5298e None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:25.569549 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f8d616-6c30-4504-a778-1420e1b5298e None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:25.570156 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f8d616-6c30-4504-a778-1420e1b5298e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:25.599723 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-34f8d616-6c30-4504-a778-1420e1b5298e None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:27:25.601210 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-34f8d616-6c30-4504-a778-1420e1b5298e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:27:25.630693 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:27:25.636924 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-3c3d2dea-e408-42ec-ad3e-4cbeb970140a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f2073d45359e4252914f8a096a1f2aeb', 'request_id': 'req-3c3d2dea-e408-42ec-ad3e-4cbeb970140a'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:27:25.659632 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-3c3d2dea-e408-42ec-ad3e-4cbeb970140a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f2073d45359e4252914f8a096a1f2aeb', 'request_id': 'req-3c3d2dea-e408-42ec-ad3e-4cbeb970140a'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:27:25.670436 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:27:25.677796 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-3c3d2dea-e408-42ec-ad3e-4cbeb970140a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f2073d45359e4252914f8a096a1f2aeb', 'request_id': 'req-3c3d2dea-e408-42ec-ad3e-4cbeb970140a'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:27:25.699654 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-3c3d2dea-e408-42ec-ad3e-4cbeb970140a admin admin] The token cache is being invalidate because project f2073d45359e4252914f8a096a1f2aeb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 12:27:25.700093 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-3c3d2dea-e408-42ec-ad3e-4cbeb970140a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:27:25.700848 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-3c3d2dea-e408-42ec-ad3e-4cbeb970140a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:27:25.703370 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 956/1895] 10.222.0.44 () {58 vars in 1232 bytes} [Thu Jun 16 12:27:25 2022] DELETE /identity/v3/projects/f2073d45359e4252914f8a096a1f2aeb => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:27:25.710385 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3d2dea-e408-42ec-ad3e-4cbeb970140a admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:27:25.712168 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-3c3d2dea-e408-42ec-ad3e-4cbeb970140a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:27:25.742511 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 940/1896] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 12:27:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:27:25.743821 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fa3a37-1367-4fd8-9287-42c1a74a7514 None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:25.744110 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fa3a37-1367-4fd8-9287-42c1a74a7514 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:25.744383 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fa3a37-1367-4fd8-9287-42c1a74a7514 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:25.766882 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-a7fa3a37-1367-4fd8-9287-42c1a74a7514 None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:27:25.768120 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-a7fa3a37-1367-4fd8-9287-42c1a74a7514 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:27:25.777402 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 941/1897] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 12:27:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:27:25.778282 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fa3a37-1367-4fd8-9287-42c1a74a7514 None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:27:25.811477 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fa3a37-1367-4fd8-9287-42c1a74a7514 None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:27:25.817396 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd031ed9-10e8-4d76-bf86-f3648a338165 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:27:25.818212 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd031ed9-10e8-4d76-bf86-f3648a338165 admin admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:25.819074 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd031ed9-10e8-4d76-bf86-f3648a338165 admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:25.819074 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd031ed9-10e8-4d76-bf86-f3648a338165 admin admin] PATH_INFO: `/v3/domains` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:25.820131 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd031ed9-10e8-4d76-bf86-f3648a338165 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:27:25.821149 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd031ed9-10e8-4d76-bf86-f3648a338165 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:27:25.823524 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd031ed9-10e8-4d76-bf86-f3648a338165 admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:27:25.837218 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3d2dea-e408-42ec-ad3e-4cbeb970140a admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:27:25.841245 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 942/1898] 10.222.0.44 () {58 vars in 1152 bytes} [Thu Jun 16 12:27:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:27:25.843377 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11846828-7f24-4b1c-a076-f8325863c579 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:27:25.844111 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11846828-7f24-4b1c-a076-f8325863c579 admin admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:25.844389 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11846828-7f24-4b1c-a076-f8325863c579 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:25.844663 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11846828-7f24-4b1c-a076-f8325863c579 admin admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:25.845667 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11846828-7f24-4b1c-a076-f8325863c579 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:27:25.846949 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a393591-7b09-49dd-8e31-108804ed12ea None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:25.847167 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11846828-7f24-4b1c-a076-f8325863c579 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:27:25.847282 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a393591-7b09-49dd-8e31-108804ed12ea None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:25.847635 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a393591-7b09-49dd-8e31-108804ed12ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:25.861870 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 957/1899] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 12:27:25 2022] GET /identity/v3/roles => generated 1420 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 12:27:25.862932 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11846828-7f24-4b1c-a076-f8325863c579 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:27:25.878723 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11846828-7f24-4b1c-a076-f8325863c579 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:27:25.892597 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c609baeb-908d-497a-a922-9514fb544c08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:27:25.893806 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c609baeb-908d-497a-a922-9514fb544c08 admin admin] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:25.894140 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c609baeb-908d-497a-a922-9514fb544c08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:25.894462 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c609baeb-908d-497a-a922-9514fb544c08 admin admin] PATH_INFO: `/v3/projects` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:25.895608 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c609baeb-908d-497a-a922-9514fb544c08 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:27:25.898374 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-1a393591-7b09-49dd-8e31-108804ed12ea None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:27:25.900502 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c609baeb-908d-497a-a922-9514fb544c08 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:27:25.902666 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-1a393591-7b09-49dd-8e31-108804ed12ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:27:25.948447 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 943/1900] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 12:27:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:27:25.952797 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a393591-7b09-49dd-8e31-108804ed12ea None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:27:25.986112 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a393591-7b09-49dd-8e31-108804ed12ea None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:27:25.994518 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0557d63-d2f6-4453-8a8f-92a1a58dc130 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:27:25.995295 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0557d63-d2f6-4453-8a8f-92a1a58dc130 admin admin] REQUEST_METHOD: `PUT` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:25.995565 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0557d63-d2f6-4453-8a8f-92a1a58dc130 admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:25.995842 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0557d63-d2f6-4453-8a8f-92a1a58dc130 admin admin] PATH_INFO: `/v3/projects/2207e7e10f284e948c39f4c2b34f025b/users/96fa57e99d8a48c884b4ae37ee569390/roles/c39882b202e942479a7cdac2fc6da72c` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:26.002115 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 958/1901] 10.222.0.44 () {60 vars in 1152 bytes} [Thu Jun 16 12:27:25 2022] POST /identity/v3/projects => generated 367 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 12:27:26.004020 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c609baeb-908d-497a-a922-9514fb544c08 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:27:26.024580 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0557d63-d2f6-4453-8a8f-92a1a58dc130 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2207e7e10f284e948c39f4c2b34f025b, user_id=96fa57e99d8a48c884b4ae37ee569390, role_id=c39882b202e942479a7cdac2fc6da72c)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:27:26.027332 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0557d63-d2f6-4453-8a8f-92a1a58dc130 admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:27:26.061320 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 944/1902] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 16 12:27:25 2022] PUT /identity/v3/projects/2207e7e10f284e948c39f4c2b34f025b/users/96fa57e99d8a48c884b4ae37ee569390/roles/c39882b202e942479a7cdac2fc6da72c => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:27:26.063648 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0557d63-d2f6-4453-8a8f-92a1a58dc130 admin admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:27:26.105118 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c609baeb-908d-497a-a922-9514fb544c08 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:27:26.188479 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0557d63-d2f6-4453-8a8f-92a1a58dc130 admin admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:27:26.197029 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02daa9a-d77d-40b7-9550-a6291f6dfd73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:27:26.198253 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02daa9a-d77d-40b7-9550-a6291f6dfd73 admin admin] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:26.199135 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02daa9a-d77d-40b7-9550-a6291f6dfd73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:26.199587 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02daa9a-d77d-40b7-9550-a6291f6dfd73 admin admin] PATH_INFO: `/v3/users` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:26.200436 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02daa9a-d77d-40b7-9550-a6291f6dfd73 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:27:26.203344 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02daa9a-d77d-40b7-9550-a6291f6dfd73 admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:27:26.239485 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 945/1903] 10.222.0.44 () {60 vars in 1143 bytes} [Thu Jun 16 12:27:26 2022] POST /identity/v3/users => generated 284 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 12:27:26.243289 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca4c2e0-77fb-4822-94be-c93f6aeb26a1 None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:26.244279 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca4c2e0-77fb-4822-94be-c93f6aeb26a1 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:26.244578 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca4c2e0-77fb-4822-94be-c93f6aeb26a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:26.249734 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:DELETE=4,keystone:SELECT=94,keystone:INSERT=2 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:27:26.262355 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8158d3d3-682e-41ae-8c1c-03b55060bdb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:27:26.274109 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8158d3d3-682e-41ae-8c1c-03b55060bdb4 admin admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:26.274426 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8158d3d3-682e-41ae-8c1c-03b55060bdb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:26.274701 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8158d3d3-682e-41ae-8c1c-03b55060bdb4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:26.275477 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8158d3d3-682e-41ae-8c1c-03b55060bdb4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:27:26.277129 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-1ca4c2e0-77fb-4822-94be-c93f6aeb26a1 None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:27:26.278804 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-1ca4c2e0-77fb-4822-94be-c93f6aeb26a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:27:26.279263 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8158d3d3-682e-41ae-8c1c-03b55060bdb4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:27:26.281422 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8158d3d3-682e-41ae-8c1c-03b55060bdb4 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:27:26.288959 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 946/1904] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 12:27:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:27:26.290105 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca4c2e0-77fb-4822-94be-c93f6aeb26a1 None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:27:26.310269 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca4c2e0-77fb-4822-94be-c93f6aeb26a1 None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:27:26.321368 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f5477f-e0fb-4e49-a2ab-7ab6776a1486 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:27:26.322396 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f5477f-e0fb-4e49-a2ab-7ab6776a1486 admin admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:26.322684 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f5477f-e0fb-4e49-a2ab-7ab6776a1486 admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:26.323027 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f5477f-e0fb-4e49-a2ab-7ab6776a1486 admin admin] PATH_INFO: `/v3/roles` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:26.323682 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 959/1905] 10.222.0.44 () {58 vars in 1152 bytes} [Thu Jun 16 12:27:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:27:26.323937 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f5477f-e0fb-4e49-a2ab-7ab6776a1486 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:27:26.324934 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8158d3d3-682e-41ae-8c1c-03b55060bdb4 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:27:26.325658 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f5477f-e0fb-4e49-a2ab-7ab6776a1486 admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:27:26.332097 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-8158d3d3-682e-41ae-8c1c-03b55060bdb4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:27:26.340154 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 947/1906] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 12:27:26 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 12:27:26.340154 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f5477f-e0fb-4e49-a2ab-7ab6776a1486 admin admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:27:26.353218 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f5477f-e0fb-4e49-a2ab-7ab6776a1486 admin admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:27:26.358868 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17ad345-7d4b-4a1f-a23c-dec206b85202 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:27:26.359597 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17ad345-7d4b-4a1f-a23c-dec206b85202 admin admin] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:26.359879 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17ad345-7d4b-4a1f-a23c-dec206b85202 admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:26.360153 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17ad345-7d4b-4a1f-a23c-dec206b85202 admin admin] PATH_INFO: `/v3/projects` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:26.361363 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17ad345-7d4b-4a1f-a23c-dec206b85202 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:27:26.364342 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17ad345-7d4b-4a1f-a23c-dec206b85202 admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:27:26.395906 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 948/1907] 10.222.0.44 () {60 vars in 1152 bytes} [Thu Jun 16 12:27:26 2022] POST /identity/v3/projects => generated 371 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 12:27:26.397824 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17ad345-7d4b-4a1f-a23c-dec206b85202 admin admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:27:26.406752 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8158d3d3-682e-41ae-8c1c-03b55060bdb4 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:27:26.459991 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:27:26.468675 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707b2b9f-36e1-4bd2-8bed-c44c1b467a4a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1094729b25a4be7b0b394998c9ca681', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '601361df39e34fcca71175aa94e425c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:27:26.469541 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707b2b9f-36e1-4bd2-8bed-c44c1b467a4a service neutron] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:26.469963 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707b2b9f-36e1-4bd2-8bed-c44c1b467a4a service neutron] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:26.470409 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707b2b9f-36e1-4bd2-8bed-c44c1b467a4a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:26.503292 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17ad345-7d4b-4a1f-a23c-dec206b85202 admin admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:27:26.514413 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35114644-8be1-4b0f-9fc6-c414b265f52b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:27:26.516587 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35114644-8be1-4b0f-9fc6-c414b265f52b admin admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:26.516781 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35114644-8be1-4b0f-9fc6-c414b265f52b admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:26.517086 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35114644-8be1-4b0f-9fc6-c414b265f52b admin admin] PATH_INFO: `/v3/roles` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:26.517996 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35114644-8be1-4b0f-9fc6-c414b265f52b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:27:26.520467 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35114644-8be1-4b0f-9fc6-c414b265f52b admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:27:26.531750 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 949/1908] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 12:27:26 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 12:27:26.533049 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35114644-8be1-4b0f-9fc6-c414b265f52b admin admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:27:26.544880 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35114644-8be1-4b0f-9fc6-c414b265f52b admin admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:27:26.549645 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f16cc9-2bb3-4271-980d-a6c05021bbd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:27:26.550307 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f16cc9-2bb3-4271-980d-a6c05021bbd4 admin admin] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:26.550590 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f16cc9-2bb3-4271-980d-a6c05021bbd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:26.550867 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f16cc9-2bb3-4271-980d-a6c05021bbd4 admin admin] PATH_INFO: `/v3/users` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:26.551554 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f16cc9-2bb3-4271-980d-a6c05021bbd4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:27:26.553638 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f16cc9-2bb3-4271-980d-a6c05021bbd4 admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:27:26.557088 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707b2b9f-36e1-4bd2-8bed-c44c1b467a4a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:27:26.558580 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707b2b9f-36e1-4bd2-8bed-c44c1b467a4a service neutron] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:27:26.568555 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 960/1909] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 12:27:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 12:27:26.569746 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707b2b9f-36e1-4bd2-8bed-c44c1b467a4a service neutron] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:27:26.579349 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707b2b9f-36e1-4bd2-8bed-c44c1b467a4a service neutron] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:27:26.582942 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 950/1910] 10.222.0.44 () {60 vars in 1143 bytes} [Thu Jun 16 12:27:26 2022] POST /identity/v3/users => generated 286 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 12:27:26.587683 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f16cc9-2bb3-4271-980d-a6c05021bbd4 admin admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:27:26.588899 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ab1cb9-3bc3-4338-b848-8be613afe030 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:27:26.589858 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ab1cb9-3bc3-4338-b848-8be613afe030 admin admin] REQUEST_METHOD: `PUT` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:26.590146 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ab1cb9-3bc3-4338-b848-8be613afe030 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:26.590425 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ab1cb9-3bc3-4338-b848-8be613afe030 admin admin] PATH_INFO: `/v3/projects/494f9fc8a6e84d43849d002b83a2d498/users/3ee31db6831a4f068b191312d40df132/roles/c39882b202e942479a7cdac2fc6da72c` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:26.602423 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f16cc9-2bb3-4271-980d-a6c05021bbd4 admin admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:27:26.608830 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6cfb28-18fe-4209-9213-510e3231d663 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:27:26.609835 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ab1cb9-3bc3-4338-b848-8be613afe030 admin admin] RBAC: Authorizing `identity:create_grant(project_id=494f9fc8a6e84d43849d002b83a2d498, user_id=3ee31db6831a4f068b191312d40df132, role_id=c39882b202e942479a7cdac2fc6da72c)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:27:26.609980 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6cfb28-18fe-4209-9213-510e3231d663 admin admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:26.610395 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6cfb28-18fe-4209-9213-510e3231d663 admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:26.610685 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6cfb28-18fe-4209-9213-510e3231d663 admin admin] PATH_INFO: `/v3/roles` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:26.612143 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6cfb28-18fe-4209-9213-510e3231d663 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:27:26.612699 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ab1cb9-3bc3-4338-b848-8be613afe030 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:27:26.614029 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6cfb28-18fe-4209-9213-510e3231d663 admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:27:26.632415 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 951/1911] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 12:27:26 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 12:27:26.633444 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6cfb28-18fe-4209-9213-510e3231d663 admin admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:27:26.636743 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 961/1912] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 16 12:27:26 2022] PUT /identity/v3/projects/494f9fc8a6e84d43849d002b83a2d498/users/3ee31db6831a4f068b191312d40df132/roles/c39882b202e942479a7cdac2fc6da72c => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:27:26.650469 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6eba6c8-729a-4988-8482-19ecbad37f27 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:26.650761 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6eba6c8-729a-4988-8482-19ecbad37f27 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:26.651038 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6eba6c8-729a-4988-8482-19ecbad37f27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:26.671401 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6cfb28-18fe-4209-9213-510e3231d663 admin admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:27:26.702055 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-c6eba6c8-729a-4988-8482-19ecbad37f27 None None] MFA Rules not processed for user `3ee31db6831a4f068b191312d40df132`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:27:26.705051 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-c6eba6c8-729a-4988-8482-19ecbad37f27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:27:26.744430 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:27:26.757860 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13a1f2f-1da7-49e4-a9a4-a950cd60d8c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:27:26.758993 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13a1f2f-1da7-49e4-a9a4-a950cd60d8c6 admin admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:26.759629 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13a1f2f-1da7-49e4-a9a4-a950cd60d8c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:26.761221 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13a1f2f-1da7-49e4-a9a4-a950cd60d8c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:26.762588 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13a1f2f-1da7-49e4-a9a4-a950cd60d8c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:27:26.765756 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13a1f2f-1da7-49e4-a9a4-a950cd60d8c6 admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:27:26.786243 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 952/1913] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 12:27:26 2022] GET /identity/v3/roles => generated 1420 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 12:27:26.791434 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13a1f2f-1da7-49e4-a9a4-a950cd60d8c6 admin admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:27:26.804966 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13a1f2f-1da7-49e4-a9a4-a950cd60d8c6 admin admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:27:26.811489 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3b7b9b-5d19-4668-9481-2a607ccff9f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:27:26.812561 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3b7b9b-5d19-4668-9481-2a607ccff9f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:26.812934 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3b7b9b-5d19-4668-9481-2a607ccff9f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:26.813549 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3b7b9b-5d19-4668-9481-2a607ccff9f8 admin admin] PATH_INFO: `/v3/projects/5a7e55b1457447139259ebc371636d49/users/2767ec356c104276bbb4e7f7fa5d5563/roles/c39882b202e942479a7cdac2fc6da72c` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:26.819978 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 962/1914] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 12:27:26 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:27:26.825089 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6eba6c8-729a-4988-8482-19ecbad37f27 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:27:26.831803 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3b7b9b-5d19-4668-9481-2a607ccff9f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a7e55b1457447139259ebc371636d49, user_id=2767ec356c104276bbb4e7f7fa5d5563, role_id=c39882b202e942479a7cdac2fc6da72c)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:27:26.835173 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3b7b9b-5d19-4668-9481-2a607ccff9f8 admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:27:26.839028 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6eba6c8-729a-4988-8482-19ecbad37f27 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:27:26.844663 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cb1c21-555c-4bdf-a9fd-90b9193aad67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:27:26.845467 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cb1c21-555c-4bdf-a9fd-90b9193aad67 admin admin] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:26.845861 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cb1c21-555c-4bdf-a9fd-90b9193aad67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:26.846208 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cb1c21-555c-4bdf-a9fd-90b9193aad67 admin admin] PATH_INFO: `/v3/projects` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:26.847028 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5cb1c21-555c-4bdf-a9fd-90b9193aad67 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:27:26.849158 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5cb1c21-555c-4bdf-a9fd-90b9193aad67 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:27:26.851265 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 953/1915] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 16 12:27:26 2022] PUT /identity/v3/projects/5a7e55b1457447139259ebc371636d49/users/2767ec356c104276bbb4e7f7fa5d5563/roles/c39882b202e942479a7cdac2fc6da72c => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:27:26.862198 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d7c119-2609-4e4c-a12e-755d953be222 None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:26.863556 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d7c119-2609-4e4c-a12e-755d953be222 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:26.863894 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d7c119-2609-4e4c-a12e-755d953be222 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:26.886374 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 963/1916] 10.222.0.44 () {60 vars in 1152 bytes} [Thu Jun 16 12:27:26 2022] POST /identity/v3/projects => generated 369 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 12:27:26.891433 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cb1c21-555c-4bdf-a9fd-90b9193aad67 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:27:26.910473 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-f9d7c119-2609-4e4c-a12e-755d953be222 None None] MFA Rules not processed for user `2767ec356c104276bbb4e7f7fa5d5563`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:27:26.911444 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-f9d7c119-2609-4e4c-a12e-755d953be222 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:27:27.001599 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cb1c21-555c-4bdf-a9fd-90b9193aad67 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:27:27.029186 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb29fb4-f5fa-4e1e-a2ee-770cbaead428 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:27:27.030154 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb29fb4-f5fa-4e1e-a2ee-770cbaead428 admin admin] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:27.032796 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb29fb4-f5fa-4e1e-a2ee-770cbaead428 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:27.033256 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb29fb4-f5fa-4e1e-a2ee-770cbaead428 admin admin] PATH_INFO: `/v3/users` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:27.034174 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb29fb4-f5fa-4e1e-a2ee-770cbaead428 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:27:27.038740 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb29fb4-f5fa-4e1e-a2ee-770cbaead428 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:27:27.041815 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 954/1917] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 12:27:26 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 12:27:27.049457 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d7c119-2609-4e4c-a12e-755d953be222 None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:27:27.052368 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-f9d7c119-2609-4e4c-a12e-755d953be222 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:27:27.078780 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:27:27.088597 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 964/1918] 10.222.0.44 () {60 vars in 1143 bytes} [Thu Jun 16 12:27:26 2022] POST /identity/v3/users => generated 291 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 12:27:27.095466 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb29fb4-f5fa-4e1e-a2ee-770cbaead428 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:27:27.115763 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb29fb4-f5fa-4e1e-a2ee-770cbaead428 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:27:27.128307 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc39161-3626-4a6e-847b-2c29652f1552 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:27:27.129249 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc39161-3626-4a6e-847b-2c29652f1552 admin admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:27.129805 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc39161-3626-4a6e-847b-2c29652f1552 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:27.130489 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc39161-3626-4a6e-847b-2c29652f1552 admin admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:27.132562 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc39161-3626-4a6e-847b-2c29652f1552 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:27:27.133997 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc39161-3626-4a6e-847b-2c29652f1552 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:27:27.149358 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 965/1919] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 12:27:27 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 12:27:27.154865 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc39161-3626-4a6e-847b-2c29652f1552 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:27:27.182177 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc39161-3626-4a6e-847b-2c29652f1552 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:27:27.196377 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f59661-fc01-4b76-a51a-7b4f82fcc87d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:27:27.197312 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f59661-fc01-4b76-a51a-7b4f82fcc87d admin admin] REQUEST_METHOD: `PUT` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:27.197596 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f59661-fc01-4b76-a51a-7b4f82fcc87d admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:27.197873 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f59661-fc01-4b76-a51a-7b4f82fcc87d admin admin] PATH_INFO: `/v3/projects/0bf1a25cb7d2477d90758dfa291221ed/users/ae6c2b09593541809e674ea4784f8501/roles/0688968254744e3f9913653cafea3091` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:27.200257 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d7c119-2609-4e4c-a12e-755d953be222 None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:27:27.209094 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52dbec85-dc27-4248-beb4-7767cbfe04f1 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42dedbccc64747d581c862a69ae20941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '601361df39e34fcca71175aa94e425c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:27:27.210324 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dbec85-dc27-4248-beb4-7767cbfe04f1 service glance] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:27.210734 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dbec85-dc27-4248-beb4-7767cbfe04f1 service glance] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:27.211021 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dbec85-dc27-4248-beb4-7767cbfe04f1 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:27.221151 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f59661-fc01-4b76-a51a-7b4f82fcc87d admin admin] RBAC: Authorizing `identity:create_grant(project_id=0bf1a25cb7d2477d90758dfa291221ed, user_id=ae6c2b09593541809e674ea4784f8501, role_id=0688968254744e3f9913653cafea3091)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:27:27.224658 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f59661-fc01-4b76-a51a-7b4f82fcc87d admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:27:27.229881 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52dbec85-dc27-4248-beb4-7767cbfe04f1 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:27:27.231658 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52dbec85-dc27-4248-beb4-7767cbfe04f1 service glance] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:27:27.242793 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 955/1920] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 12:27:27 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 12:27:27.249125 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 966/1921] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 16 12:27:27 2022] PUT /identity/v3/projects/0bf1a25cb7d2477d90758dfa291221ed/users/ae6c2b09593541809e674ea4784f8501/roles/0688968254744e3f9913653cafea3091 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:27:27.253252 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52dbec85-dc27-4248-beb4-7767cbfe04f1 service glance] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:27:27.268568 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52dbec85-dc27-4248-beb4-7767cbfe04f1 service glance] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:27:27.367920 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b277ce56-9bb1-441b-ad7b-a53ac0dc0334 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:27:27.368610 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b277ce56-9bb1-441b-ad7b-a53ac0dc0334 admin admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:27.368932 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b277ce56-9bb1-441b-ad7b-a53ac0dc0334 admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:27.369208 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b277ce56-9bb1-441b-ad7b-a53ac0dc0334 admin admin] PATH_INFO: `/v3/roles` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:27.370077 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b277ce56-9bb1-441b-ad7b-a53ac0dc0334 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:27:27.372120 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b277ce56-9bb1-441b-ad7b-a53ac0dc0334 admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:27:27.385791 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 956/1922] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 12:27:27 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 12:27:27.390248 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f59661-fc01-4b76-a51a-7b4f82fcc87d admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:27:27.405877 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f59661-fc01-4b76-a51a-7b4f82fcc87d admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:27:27.419240 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7273abbb-799d-4bef-8d1e-4cc6814aeba7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:27:27.420450 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7273abbb-799d-4bef-8d1e-4cc6814aeba7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:27.421177 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7273abbb-799d-4bef-8d1e-4cc6814aeba7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:27.421177 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7273abbb-799d-4bef-8d1e-4cc6814aeba7 admin admin] PATH_INFO: `/v3/projects/0bf1a25cb7d2477d90758dfa291221ed/users/ae6c2b09593541809e674ea4784f8501/roles/0688968254744e3f9913653cafea3091` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:27.424514 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7273abbb-799d-4bef-8d1e-4cc6814aeba7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0bf1a25cb7d2477d90758dfa291221ed, user_id=ae6c2b09593541809e674ea4784f8501, role_id=0688968254744e3f9913653cafea3091)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:27:27.427735 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7273abbb-799d-4bef-8d1e-4cc6814aeba7 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:27:27.443228 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 967/1923] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 16 12:27:27 2022] PUT /identity/v3/projects/0bf1a25cb7d2477d90758dfa291221ed/users/ae6c2b09593541809e674ea4784f8501/roles/0688968254744e3f9913653cafea3091 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:27:27.456017 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02260f6-7dbf-40b9-aa36-931c4e866270 None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:27.457038 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02260f6-7dbf-40b9-aa36-931c4e866270 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:27.465389 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02260f6-7dbf-40b9-aa36-931c4e866270 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:27.539827 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ae1225-6baf-4145-96c6-0610ec453cf6 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:27.540728 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ae1225-6baf-4145-96c6-0610ec453cf6 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:27.541243 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ae1225-6baf-4145-96c6-0610ec453cf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:27.559842 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-e02260f6-7dbf-40b9-aa36-931c4e866270 None None] MFA Rules not processed for user `ae6c2b09593541809e674ea4784f8501`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:27:27.564411 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-e02260f6-7dbf-40b9-aa36-931c4e866270 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:27:27.627679 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-82ae1225-6baf-4145-96c6-0610ec453cf6 None None] MFA Rules not processed for user `96fa57e99d8a48c884b4ae37ee569390`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:27:27.629553 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-82ae1225-6baf-4145-96c6-0610ec453cf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:27:27.713541 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:27:27.768116 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 957/1924] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 12:27:27 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 313 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:27:27.794785 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 968/1925] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 12:27:27 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:27:27.795916 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02260f6-7dbf-40b9-aa36-931c4e866270 None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:27:27.872159 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:27:27.978669 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02260f6-7dbf-40b9-aa36-931c4e866270 None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:27:27.997624 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dffd1a9-2f6a-454d-ba05-b2806859f467 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:27:27.998420 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dffd1a9-2f6a-454d-ba05-b2806859f467 admin admin] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:27.998772 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dffd1a9-2f6a-454d-ba05-b2806859f467 admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:27.999122 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dffd1a9-2f6a-454d-ba05-b2806859f467 admin admin] PATH_INFO: `/v3/projects` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:28.000048 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dffd1a9-2f6a-454d-ba05-b2806859f467 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:27:28.002099 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dffd1a9-2f6a-454d-ba05-b2806859f467 admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:27:28.043237 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 958/1926] 10.222.0.44 () {60 vars in 1152 bytes} [Thu Jun 16 12:27:27 2022] POST /identity/v3/projects => generated 371 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 12:27:28.047781 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ae1225-6baf-4145-96c6-0610ec453cf6 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:27:28.059486 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ae1225-6baf-4145-96c6-0610ec453cf6 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:27:28.116894 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dffd1a9-2f6a-454d-ba05-b2806859f467 admin admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:27:28.118685 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-0dffd1a9-2f6a-454d-ba05-b2806859f467 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:27:28.157280 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338dc655-e94b-49d3-a257-b85cee1004fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:27:28.158022 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338dc655-e94b-49d3-a257-b85cee1004fb admin admin] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:28.158304 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338dc655-e94b-49d3-a257-b85cee1004fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:28.158588 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338dc655-e94b-49d3-a257-b85cee1004fb admin admin] PATH_INFO: `/v3/users` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:28.159275 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338dc655-e94b-49d3-a257-b85cee1004fb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:27:28.163422 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338dc655-e94b-49d3-a257-b85cee1004fb admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:27:28.204226 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 969/1927] 10.222.0.44 () {60 vars in 1143 bytes} [Thu Jun 16 12:27:28 2022] POST /identity/v3/users => generated 292 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 12:27:28.205624 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338dc655-e94b-49d3-a257-b85cee1004fb admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:27:28.220301 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338dc655-e94b-49d3-a257-b85cee1004fb admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:27:28.227141 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c558e2a-7861-4c4b-af98-8a30db58c810 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:27:28.227822 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c558e2a-7861-4c4b-af98-8a30db58c810 admin admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:28.228261 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c558e2a-7861-4c4b-af98-8a30db58c810 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:28.228539 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c558e2a-7861-4c4b-af98-8a30db58c810 admin admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:28.229208 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dffd1a9-2f6a-454d-ba05-b2806859f467 admin admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:27:28.229323 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c558e2a-7861-4c4b-af98-8a30db58c810 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:27:28.231245 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c558e2a-7861-4c4b-af98-8a30db58c810 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:27:28.244394 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68353076-0276-4efd-946d-7d3d6ba17934 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f96fc14ed89478c8a8c2f11c87511e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '601361df39e34fcca71175aa94e425c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:27:28.245120 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68353076-0276-4efd-946d-7d3d6ba17934 service cinder] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:28.245411 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68353076-0276-4efd-946d-7d3d6ba17934 service cinder] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:28.245685 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68353076-0276-4efd-946d-7d3d6ba17934 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:28.249216 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 970/1928] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 12:27:28 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 12:27:28.251644 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c558e2a-7861-4c4b-af98-8a30db58c810 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:27:28.279551 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c558e2a-7861-4c4b-af98-8a30db58c810 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:27:28.293302 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc9f287-fdeb-4f0b-aee6-061cb73d39fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:27:28.294384 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc9f287-fdeb-4f0b-aee6-061cb73d39fd admin admin] REQUEST_METHOD: `PUT` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:28.295005 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc9f287-fdeb-4f0b-aee6-061cb73d39fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:28.295381 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc9f287-fdeb-4f0b-aee6-061cb73d39fd admin admin] PATH_INFO: `/v3/projects/01a204ab334b454ab33b9a58fe17fcc4/users/03dece240692471fa539e9f104afbc29/roles/0688968254744e3f9913653cafea3091` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:28.324600 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc9f287-fdeb-4f0b-aee6-061cb73d39fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=01a204ab334b454ab33b9a58fe17fcc4, user_id=03dece240692471fa539e9f104afbc29, role_id=0688968254744e3f9913653cafea3091)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:27:28.324600 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc9f287-fdeb-4f0b-aee6-061cb73d39fd admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:27:28.349419 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 971/1929] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 16 12:27:28 2022] PUT /identity/v3/projects/01a204ab334b454ab33b9a58fe17fcc4/users/03dece240692471fa539e9f104afbc29/roles/0688968254744e3f9913653cafea3091 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 12:27:28.350872 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc9f287-fdeb-4f0b-aee6-061cb73d39fd admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:27:28.381257 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68353076-0276-4efd-946d-7d3d6ba17934 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:27:28.382898 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68353076-0276-4efd-946d-7d3d6ba17934 service cinder] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:27:28.395159 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 959/1930] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 12:27:28 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 12:27:28.442986 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc9f287-fdeb-4f0b-aee6-061cb73d39fd admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:27:28.448320 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c9f391-9691-4d8a-a60f-85ccfa1a8bb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:27:28.448495 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68353076-0276-4efd-946d-7d3d6ba17934 service cinder] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:27:28.449136 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c9f391-9691-4d8a-a60f-85ccfa1a8bb0 admin admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:28.449491 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c9f391-9691-4d8a-a60f-85ccfa1a8bb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:28.449842 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c9f391-9691-4d8a-a60f-85ccfa1a8bb0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:28.449940 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-68353076-0276-4efd-946d-7d3d6ba17934 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:27:28.450724 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c9f391-9691-4d8a-a60f-85ccfa1a8bb0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:27:28.452464 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c9f391-9691-4d8a-a60f-85ccfa1a8bb0 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:27:28.465009 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 972/1931] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 12:27:28 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 12:27:28.469914 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68353076-0276-4efd-946d-7d3d6ba17934 service cinder] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:27:28.477650 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c9f391-9691-4d8a-a60f-85ccfa1a8bb0 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:27:28.489845 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c9f391-9691-4d8a-a60f-85ccfa1a8bb0 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:27:28.497688 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a42688-8cdc-4f0c-ac7a-c46690aca82f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:27:28.498587 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a42688-8cdc-4f0c-ac7a-c46690aca82f admin admin] REQUEST_METHOD: `PUT` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:28.498870 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a42688-8cdc-4f0c-ac7a-c46690aca82f admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:28.499424 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a42688-8cdc-4f0c-ac7a-c46690aca82f admin admin] PATH_INFO: `/v3/projects/01a204ab334b454ab33b9a58fe17fcc4/users/03dece240692471fa539e9f104afbc29/roles/0688968254744e3f9913653cafea3091` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:28.501733 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a42688-8cdc-4f0c-ac7a-c46690aca82f admin admin] RBAC: Authorizing `identity:create_grant(project_id=01a204ab334b454ab33b9a58fe17fcc4, user_id=03dece240692471fa539e9f104afbc29, role_id=0688968254744e3f9913653cafea3091)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:27:28.504536 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a42688-8cdc-4f0c-ac7a-c46690aca82f admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:27:28.528550 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 973/1932] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 16 12:27:28 2022] PUT /identity/v3/projects/01a204ab334b454ab33b9a58fe17fcc4/users/03dece240692471fa539e9f104afbc29/roles/0688968254744e3f9913653cafea3091 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 12:27:28.556948 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a47b929-e4f5-4b35-b002-5c4ae498e436 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f96fc14ed89478c8a8c2f11c87511e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '601361df39e34fcca71175aa94e425c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:27:28.557635 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a47b929-e4f5-4b35-b002-5c4ae498e436 service cinder] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:28.558030 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a47b929-e4f5-4b35-b002-5c4ae498e436 service cinder] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:28.558314 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a47b929-e4f5-4b35-b002-5c4ae498e436 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:28.594649 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:27:28.638822 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a47b929-e4f5-4b35-b002-5c4ae498e436 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:27:28.640269 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a47b929-e4f5-4b35-b002-5c4ae498e436 service cinder] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:27:28.650522 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 960/1933] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 12:27:28 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 12:27:29.464701 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86effef7-8b36-4563-baf4-ea3c2ada6d4d None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:29.465290 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86effef7-8b36-4563-baf4-ea3c2ada6d4d None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:29.465290 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86effef7-8b36-4563-baf4-ea3c2ada6d4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:29.478680 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:27:29.497143 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-86effef7-8b36-4563-baf4-ea3c2ada6d4d None None] MFA Rules not processed for user `03dece240692471fa539e9f104afbc29`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:27:29.498559 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-86effef7-8b36-4563-baf4-ea3c2ada6d4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:27:29.604505 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 974/1934] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 12:27:29 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:27:29.616636 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041afd1a-b6b3-40ab-b85c-72d76b32619f None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:29.617215 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041afd1a-b6b3-40ab-b85c-72d76b32619f None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:29.617215 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041afd1a-b6b3-40ab-b85c-72d76b32619f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:29.655393 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-041afd1a-b6b3-40ab-b85c-72d76b32619f None None] MFA Rules not processed for user `96fa57e99d8a48c884b4ae37ee569390`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:27:29.663438 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-041afd1a-b6b3-40ab-b85c-72d76b32619f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:27:29.762754 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 961/1935] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 12:27:29 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:27:29.858159 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86effef7-8b36-4563-baf4-ea3c2ada6d4d None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:27:29.860167 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-86effef7-8b36-4563-baf4-ea3c2ada6d4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:27:29.968469 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86effef7-8b36-4563-baf4-ea3c2ada6d4d None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:27:29.974598 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9498e5-6fab-47e4-a0cc-3155692fc088 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edfb12d445e74136b90800e93941f468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '601361df39e34fcca71175aa94e425c4', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:27:29.975816 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9498e5-6fab-47e4-a0cc-3155692fc088 service nova] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:29.975816 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9498e5-6fab-47e4-a0cc-3155692fc088 service nova] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:29.975999 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9498e5-6fab-47e4-a0cc-3155692fc088 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:29.991452 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9498e5-6fab-47e4-a0cc-3155692fc088 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:27:29.993102 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9498e5-6fab-47e4-a0cc-3155692fc088 service nova] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:27:30.004316 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 975/1936] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 12:27:29 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 12:27:32.707775 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041afd1a-b6b3-40ab-b85c-72d76b32619f None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:27:32.845681 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041afd1a-b6b3-40ab-b85c-72d76b32619f None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:27:32.857930 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0ecdbb-2717-4913-92de-d67bb38ae428 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:27:32.862295 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0ecdbb-2717-4913-92de-d67bb38ae428 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:32.864857 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0ecdbb-2717-4913-92de-d67bb38ae428 admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:32.865588 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0ecdbb-2717-4913-92de-d67bb38ae428 admin admin] PATH_INFO: `/v3/users/3ee31db6831a4f068b191312d40df132` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:32.870259 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0ecdbb-2717-4913-92de-d67bb38ae428 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3ee31db6831a4f068b191312d40df132)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:27:32.875864 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0ecdbb-2717-4913-92de-d67bb38ae428 admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:27:32.992909 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-6a0ecdbb-2717-4913-92de-d67bb38ae428 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3ee31db6831a4f068b191312d40df132'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:27:33.023294 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-6a0ecdbb-2717-4913-92de-d67bb38ae428 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3ee31db6831a4f068b191312d40df132'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:27:33.032719 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:27:33.043230 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-6a0ecdbb-2717-4913-92de-d67bb38ae428 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3ee31db6831a4f068b191312d40df132'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:27:33.044891 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-6a0ecdbb-2717-4913-92de-d67bb38ae428 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3ee31db6831a4f068b191312d40df132'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:27:33.050452 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-6a0ecdbb-2717-4913-92de-d67bb38ae428 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3ee31db6831a4f068b191312d40df132'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:27:33.101341 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 962/1937] 10.222.0.44 () {58 vars in 1223 bytes} [Thu Jun 16 12:27:32 2022] DELETE /identity/v3/users/3ee31db6831a4f068b191312d40df132 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:27:33.106022 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3695bd-fd27-4099-a368-326dc05fb58e None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:33.106538 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3695bd-fd27-4099-a368-326dc05fb58e None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:33.106631 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3695bd-fd27-4099-a368-326dc05fb58e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:33.145246 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-ce3695bd-fd27-4099-a368-326dc05fb58e None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:27:33.147590 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-ce3695bd-fd27-4099-a368-326dc05fb58e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:27:33.266293 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 976/1938] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 12:27:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:27:33.298954 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0ecdbb-2717-4913-92de-d67bb38ae428 admin admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:27:33.304946 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-6a0ecdbb-2717-4913-92de-d67bb38ae428 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:27:33.400635 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0ecdbb-2717-4913-92de-d67bb38ae428 admin admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:27:33.406161 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346d4fe2-ca7c-4a5c-b304-08a429f5dfad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1094729b25a4be7b0b394998c9ca681', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '601361df39e34fcca71175aa94e425c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:27:33.407478 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346d4fe2-ca7c-4a5c-b304-08a429f5dfad service neutron] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:33.407478 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346d4fe2-ca7c-4a5c-b304-08a429f5dfad service neutron] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:33.407662 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346d4fe2-ca7c-4a5c-b304-08a429f5dfad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:33.422193 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346d4fe2-ca7c-4a5c-b304-08a429f5dfad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:27:33.426302 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346d4fe2-ca7c-4a5c-b304-08a429f5dfad service neutron] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:27:33.443126 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 963/1939] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 12:27:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 12:27:33.900805 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3695bd-fd27-4099-a368-326dc05fb58e None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:27:33.903198 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-ce3695bd-fd27-4099-a368-326dc05fb58e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:27:33.930820 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3695bd-fd27-4099-a368-326dc05fb58e None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:27:33.936252 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0a8d81-5a97-449a-a0f4-4cb840e77f18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:27:33.936723 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0a8d81-5a97-449a-a0f4-4cb840e77f18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:33.937043 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0a8d81-5a97-449a-a0f4-4cb840e77f18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:33.937321 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0a8d81-5a97-449a-a0f4-4cb840e77f18 admin admin] PATH_INFO: `/v3/projects/494f9fc8a6e84d43849d002b83a2d498` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:33.938707 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0a8d81-5a97-449a-a0f4-4cb840e77f18 admin admin] RBAC: Authorizing `identity:delete_project(project_id=494f9fc8a6e84d43849d002b83a2d498)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:27:33.941396 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0a8d81-5a97-449a-a0f4-4cb840e77f18 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:27:33.958176 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:27:34.005837 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-aa0a8d81-5a97-449a-a0f4-4cb840e77f18 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '494f9fc8a6e84d43849d002b83a2d498', 'request_id': 'req-aa0a8d81-5a97-449a-a0f4-4cb840e77f18'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:27:34.015290 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-aa0a8d81-5a97-449a-a0f4-4cb840e77f18 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '494f9fc8a6e84d43849d002b83a2d498', 'request_id': 'req-aa0a8d81-5a97-449a-a0f4-4cb840e77f18'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:27:34.024287 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-aa0a8d81-5a97-449a-a0f4-4cb840e77f18 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '494f9fc8a6e84d43849d002b83a2d498', 'request_id': 'req-aa0a8d81-5a97-449a-a0f4-4cb840e77f18'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:27:34.036172 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-aa0a8d81-5a97-449a-a0f4-4cb840e77f18 admin admin] The token cache is being invalidate because project 494f9fc8a6e84d43849d002b83a2d498 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 12:27:34.036697 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-aa0a8d81-5a97-449a-a0f4-4cb840e77f18 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:27:34.038052 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-aa0a8d81-5a97-449a-a0f4-4cb840e77f18 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:27:34.039660 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 977/1940] 10.222.0.44 () {58 vars in 1232 bytes} [Thu Jun 16 12:27:33 2022] DELETE /identity/v3/projects/494f9fc8a6e84d43849d002b83a2d498 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 12:27:34.044171 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346d4fe2-ca7c-4a5c-b304-08a429f5dfad service neutron] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:27:34.057899 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346d4fe2-ca7c-4a5c-b304-08a429f5dfad service neutron] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:27:34.124778 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1775166c-5e9f-43aa-9e6b-8a7266710da4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:27:34.125659 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1775166c-5e9f-43aa-9e6b-8a7266710da4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:34.125943 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1775166c-5e9f-43aa-9e6b-8a7266710da4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:34.126222 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1775166c-5e9f-43aa-9e6b-8a7266710da4 admin admin] PATH_INFO: `/v3/users/ae6c2b09593541809e674ea4784f8501` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:34.127495 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1775166c-5e9f-43aa-9e6b-8a7266710da4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ae6c2b09593541809e674ea4784f8501)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:27:34.129456 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1775166c-5e9f-43aa-9e6b-8a7266710da4 admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:27:34.162659 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0a8d81-5a97-449a-a0f4-4cb840e77f18 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:27:34.164336 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-aa0a8d81-5a97-449a-a0f4-4cb840e77f18 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:27:34.185602 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0a8d81-5a97-449a-a0f4-4cb840e77f18 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:27:34.190883 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1475eade-658e-46f3-98b6-6cc9f2af34e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:27:34.191799 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1475eade-658e-46f3-98b6-6cc9f2af34e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:34.192115 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1475eade-658e-46f3-98b6-6cc9f2af34e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:34.192397 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1475eade-658e-46f3-98b6-6cc9f2af34e4 admin admin] PATH_INFO: `/v3/users/cea98a0c139d461792016725c2173592` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:34.193699 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1475eade-658e-46f3-98b6-6cc9f2af34e4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cea98a0c139d461792016725c2173592)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:27:34.194364 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-1775166c-5e9f-43aa-9e6b-8a7266710da4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ae6c2b09593541809e674ea4784f8501'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:27:34.195777 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1475eade-658e-46f3-98b6-6cc9f2af34e4 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:27:34.207090 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-1775166c-5e9f-43aa-9e6b-8a7266710da4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ae6c2b09593541809e674ea4784f8501'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:27:34.216258 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-1775166c-5e9f-43aa-9e6b-8a7266710da4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ae6c2b09593541809e674ea4784f8501'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:27:34.217022 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-1775166c-5e9f-43aa-9e6b-8a7266710da4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ae6c2b09593541809e674ea4784f8501'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:27:34.217646 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-1775166c-5e9f-43aa-9e6b-8a7266710da4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ae6c2b09593541809e674ea4784f8501'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:27:34.236773 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 964/1941] 10.222.0.44 () {58 vars in 1223 bytes} [Thu Jun 16 12:27:34 2022] DELETE /identity/v3/users/ae6c2b09593541809e674ea4784f8501 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:27:34.276007 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-1475eade-658e-46f3-98b6-6cc9f2af34e4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cea98a0c139d461792016725c2173592'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:27:34.276880 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-1475eade-658e-46f3-98b6-6cc9f2af34e4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cea98a0c139d461792016725c2173592'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:27:34.284656 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-1475eade-658e-46f3-98b6-6cc9f2af34e4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cea98a0c139d461792016725c2173592'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:27:34.285627 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-1475eade-658e-46f3-98b6-6cc9f2af34e4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cea98a0c139d461792016725c2173592'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:27:34.296840 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-1475eade-658e-46f3-98b6-6cc9f2af34e4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cea98a0c139d461792016725c2173592'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:27:34.354479 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 978/1942] 10.222.0.44 () {58 vars in 1223 bytes} [Thu Jun 16 12:27:34 2022] DELETE /identity/v3/users/cea98a0c139d461792016725c2173592 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:27:34.358895 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8336dab5-b13e-4778-90e3-e5dd2bebe18a None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:34.359520 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8336dab5-b13e-4778-90e3-e5dd2bebe18a None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:34.359966 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8336dab5-b13e-4778-90e3-e5dd2bebe18a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:34.425962 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-8336dab5-b13e-4778-90e3-e5dd2bebe18a None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:27:34.427393 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-8336dab5-b13e-4778-90e3-e5dd2bebe18a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:27:34.458447 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:27:34.550398 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 965/1943] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 12:27:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:27:34.561337 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1475eade-658e-46f3-98b6-6cc9f2af34e4 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:27:34.562794 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-1475eade-658e-46f3-98b6-6cc9f2af34e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:27:34.662886 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1475eade-658e-46f3-98b6-6cc9f2af34e4 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:27:34.667601 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50311272-22a0-40e4-8005-573f21a3cde4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1094729b25a4be7b0b394998c9ca681', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '601361df39e34fcca71175aa94e425c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:27:34.668289 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50311272-22a0-40e4-8005-573f21a3cde4 service neutron] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:34.668567 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50311272-22a0-40e4-8005-573f21a3cde4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:34.668876 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50311272-22a0-40e4-8005-573f21a3cde4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:34.681305 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8336dab5-b13e-4778-90e3-e5dd2bebe18a None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:27:34.683239 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-8336dab5-b13e-4778-90e3-e5dd2bebe18a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:27:34.688120 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50311272-22a0-40e4-8005-573f21a3cde4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:27:34.689826 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50311272-22a0-40e4-8005-573f21a3cde4 service neutron] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:27:34.704142 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 979/1944] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 12:27:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 12:27:34.723119 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8336dab5-b13e-4778-90e3-e5dd2bebe18a None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:27:34.728391 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef0a0c5-2a13-411d-a667-2d05c215737e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:27:34.729309 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef0a0c5-2a13-411d-a667-2d05c215737e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:34.729591 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef0a0c5-2a13-411d-a667-2d05c215737e admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:34.729865 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef0a0c5-2a13-411d-a667-2d05c215737e admin admin] PATH_INFO: `/v3/projects/0bf1a25cb7d2477d90758dfa291221ed` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:34.731054 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef0a0c5-2a13-411d-a667-2d05c215737e admin admin] RBAC: Authorizing `identity:delete_project(project_id=0bf1a25cb7d2477d90758dfa291221ed)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:27:34.732982 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef0a0c5-2a13-411d-a667-2d05c215737e admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:27:34.826605 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-6ef0a0c5-2a13-411d-a667-2d05c215737e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0bf1a25cb7d2477d90758dfa291221ed', 'request_id': 'req-6ef0a0c5-2a13-411d-a667-2d05c215737e'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:27:34.846336 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-6ef0a0c5-2a13-411d-a667-2d05c215737e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0bf1a25cb7d2477d90758dfa291221ed', 'request_id': 'req-6ef0a0c5-2a13-411d-a667-2d05c215737e'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:27:34.864982 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-6ef0a0c5-2a13-411d-a667-2d05c215737e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0bf1a25cb7d2477d90758dfa291221ed', 'request_id': 'req-6ef0a0c5-2a13-411d-a667-2d05c215737e'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:27:34.891539 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-6ef0a0c5-2a13-411d-a667-2d05c215737e admin admin] The token cache is being invalidate because project 0bf1a25cb7d2477d90758dfa291221ed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 12:27:34.891842 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-6ef0a0c5-2a13-411d-a667-2d05c215737e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:27:34.893716 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-6ef0a0c5-2a13-411d-a667-2d05c215737e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:27:34.895893 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 966/1945] 10.222.0.44 () {58 vars in 1232 bytes} [Thu Jun 16 12:27:34 2022] DELETE /identity/v3/projects/0bf1a25cb7d2477d90758dfa291221ed => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 12:27:34.902509 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422711fa-42d8-4f31-86c8-761767845c98 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:34.902800 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422711fa-42d8-4f31-86c8-761767845c98 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:34.904066 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422711fa-42d8-4f31-86c8-761767845c98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:34.923244 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-422711fa-42d8-4f31-86c8-761767845c98 None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:27:34.927230 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-422711fa-42d8-4f31-86c8-761767845c98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:27:34.942549 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:27:35.012843 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 980/1946] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 12:27:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:27:35.016042 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3828a7fc-bd2d-4e01-acfd-b557c20972c0 None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:35.016399 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3828a7fc-bd2d-4e01-acfd-b557c20972c0 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:35.016803 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3828a7fc-bd2d-4e01-acfd-b557c20972c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:35.042345 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-3828a7fc-bd2d-4e01-acfd-b557c20972c0 None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:27:35.043567 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-3828a7fc-bd2d-4e01-acfd-b557c20972c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:27:35.051705 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 967/1947] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 12:27:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:27:35.056060 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422711fa-42d8-4f31-86c8-761767845c98 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:27:35.066153 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422711fa-42d8-4f31-86c8-761767845c98 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:27:35.071415 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7e545c-d181-448f-86ba-498002cf18aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:27:35.072078 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7e545c-d181-448f-86ba-498002cf18aa admin admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:35.072359 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7e545c-d181-448f-86ba-498002cf18aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:35.072638 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7e545c-d181-448f-86ba-498002cf18aa admin admin] PATH_INFO: `/v3/domains` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:35.073409 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7e545c-d181-448f-86ba-498002cf18aa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:27:35.073718 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7e545c-d181-448f-86ba-498002cf18aa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:27:35.075320 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7e545c-d181-448f-86ba-498002cf18aa admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:27:35.088847 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 981/1948] 10.222.0.44 () {58 vars in 1152 bytes} [Thu Jun 16 12:27:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:27:35.093341 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3828a7fc-bd2d-4e01-acfd-b557c20972c0 None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:27:35.103460 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3828a7fc-bd2d-4e01-acfd-b557c20972c0 None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:27:35.109352 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb15ea7-a0cb-45c7-b6aa-9ebfde3893a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:27:35.110268 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb15ea7-a0cb-45c7-b6aa-9ebfde3893a7 admin admin] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:35.110556 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb15ea7-a0cb-45c7-b6aa-9ebfde3893a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:35.110832 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb15ea7-a0cb-45c7-b6aa-9ebfde3893a7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:35.111539 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb15ea7-a0cb-45c7-b6aa-9ebfde3893a7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:27:35.113629 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb15ea7-a0cb-45c7-b6aa-9ebfde3893a7 admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:27:35.128432 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7e545c-d181-448f-86ba-498002cf18aa admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:27:35.132020 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-2d7e545c-d181-448f-86ba-498002cf18aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:27:35.149794 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7e545c-d181-448f-86ba-498002cf18aa admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:27:35.156189 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ff66d0-5cee-4809-bd7e-d3d4786ccfa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:27:35.157148 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ff66d0-5cee-4809-bd7e-d3d4786ccfa5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:35.157414 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ff66d0-5cee-4809-bd7e-d3d4786ccfa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:35.157682 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ff66d0-5cee-4809-bd7e-d3d4786ccfa5 admin admin] PATH_INFO: `/v3/projects/0bb4ce4b37474e4e8b906cd91b5d2c8a` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:35.157998 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 968/1949] 10.222.0.44 () {60 vars in 1152 bytes} [Thu Jun 16 12:27:35 2022] POST /identity/v3/projects => generated 409 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 12:27:35.161842 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ff66d0-5cee-4809-bd7e-d3d4786ccfa5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0bb4ce4b37474e4e8b906cd91b5d2c8a)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:27:35.164259 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ff66d0-5cee-4809-bd7e-d3d4786ccfa5 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:27:35.168821 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb15ea7-a0cb-45c7-b6aa-9ebfde3893a7 admin admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:27:35.259564 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb15ea7-a0cb-45c7-b6aa-9ebfde3893a7 admin admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:27:35.268016 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-51ff66d0-5cee-4809-bd7e-d3d4786ccfa5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0bb4ce4b37474e4e8b906cd91b5d2c8a', 'request_id': 'req-51ff66d0-5cee-4809-bd7e-d3d4786ccfa5'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:27:35.276873 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:27:35.278937 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-51ff66d0-5cee-4809-bd7e-d3d4786ccfa5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0bb4ce4b37474e4e8b906cd91b5d2c8a', 'request_id': 'req-51ff66d0-5cee-4809-bd7e-d3d4786ccfa5'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:27:35.287597 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-51ff66d0-5cee-4809-bd7e-d3d4786ccfa5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0bb4ce4b37474e4e8b906cd91b5d2c8a', 'request_id': 'req-51ff66d0-5cee-4809-bd7e-d3d4786ccfa5'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:27:35.310167 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-51ff66d0-5cee-4809-bd7e-d3d4786ccfa5 admin admin] The token cache is being invalidate because project 0bb4ce4b37474e4e8b906cd91b5d2c8a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 12:27:35.310534 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-51ff66d0-5cee-4809-bd7e-d3d4786ccfa5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:27:35.311991 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-51ff66d0-5cee-4809-bd7e-d3d4786ccfa5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:27:35.314066 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 982/1950] 10.222.0.44 () {58 vars in 1232 bytes} [Thu Jun 16 12:27:35 2022] DELETE /identity/v3/projects/0bb4ce4b37474e4e8b906cd91b5d2c8a => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 12:27:35.317589 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ff66d0-5cee-4809-bd7e-d3d4786ccfa5 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:27:35.320004 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-51ff66d0-5cee-4809-bd7e-d3d4786ccfa5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:27:35.334977 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf18c59e-8e40-4877-ad51-e9a5bc589c46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:27:35.335655 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf18c59e-8e40-4877-ad51-e9a5bc589c46 admin admin] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:35.335942 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf18c59e-8e40-4877-ad51-e9a5bc589c46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:35.336216 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf18c59e-8e40-4877-ad51-e9a5bc589c46 admin admin] PATH_INFO: `/v3/users` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:35.336951 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf18c59e-8e40-4877-ad51-e9a5bc589c46 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:27:35.338879 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf18c59e-8e40-4877-ad51-e9a5bc589c46 admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:27:35.366961 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 969/1951] 10.222.0.44 () {60 vars in 1143 bytes} [Thu Jun 16 12:27:35 2022] POST /identity/v3/users => generated 305 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 12:27:35.367379 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf18c59e-8e40-4877-ad51-e9a5bc589c46 admin admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:27:35.369421 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-cf18c59e-8e40-4877-ad51-e9a5bc589c46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:27:35.382836 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf18c59e-8e40-4877-ad51-e9a5bc589c46 admin admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:27:35.388096 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348519bc-fd4a-420d-a7d1-e7e40a308b78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:27:35.389146 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348519bc-fd4a-420d-a7d1-e7e40a308b78 admin admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:35.389430 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348519bc-fd4a-420d-a7d1-e7e40a308b78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:35.389709 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348519bc-fd4a-420d-a7d1-e7e40a308b78 admin admin] PATH_INFO: `/v3/roles` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:35.390580 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348519bc-fd4a-420d-a7d1-e7e40a308b78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:27:35.392162 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348519bc-fd4a-420d-a7d1-e7e40a308b78 admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:27:35.404616 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 970/1952] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 12:27:35 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 12:27:35.408297 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348519bc-fd4a-420d-a7d1-e7e40a308b78 admin admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:27:35.409381 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ff66d0-5cee-4809-bd7e-d3d4786ccfa5 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:27:35.414859 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c64fc77-3c56-4bfa-b136-58df80b609b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:27:35.416017 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c64fc77-3c56-4bfa-b136-58df80b609b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:35.416959 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c64fc77-3c56-4bfa-b136-58df80b609b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:35.417318 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c64fc77-3c56-4bfa-b136-58df80b609b2 admin admin] PATH_INFO: `/v3/users/3e177f15797a45de88a9a91d28568f25` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:35.419024 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c64fc77-3c56-4bfa-b136-58df80b609b2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3e177f15797a45de88a9a91d28568f25)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:27:35.420734 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348519bc-fd4a-420d-a7d1-e7e40a308b78 admin admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:27:35.421233 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c64fc77-3c56-4bfa-b136-58df80b609b2 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:27:35.433853 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370dca25-5059-4480-bc46-6b9db534615a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:27:35.434541 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370dca25-5059-4480-bc46-6b9db534615a admin admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:35.434821 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370dca25-5059-4480-bc46-6b9db534615a admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:35.435101 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370dca25-5059-4480-bc46-6b9db534615a admin admin] PATH_INFO: `/v3/roles` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:35.435868 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370dca25-5059-4480-bc46-6b9db534615a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:27:35.437527 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370dca25-5059-4480-bc46-6b9db534615a admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:27:35.450771 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 971/1953] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 12:27:35 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 12:27:35.457125 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370dca25-5059-4480-bc46-6b9db534615a admin admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:27:35.463346 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:27:35.480593 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370dca25-5059-4480-bc46-6b9db534615a admin admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:27:35.489119 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb7452a-73e7-4b27-9f9b-804255a544d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:27:35.491031 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb7452a-73e7-4b27-9f9b-804255a544d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:35.491390 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb7452a-73e7-4b27-9f9b-804255a544d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:35.491731 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb7452a-73e7-4b27-9f9b-804255a544d7 admin admin] PATH_INFO: `/v3/projects/9649261fe98c4121bc3c1be26923450c/users/31dfe17024a34ea59568c8742f39c992/roles/c39882b202e942479a7cdac2fc6da72c` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:35.491970 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-1c64fc77-3c56-4bfa-b136-58df80b609b2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3e177f15797a45de88a9a91d28568f25'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:27:35.492666 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-1c64fc77-3c56-4bfa-b136-58df80b609b2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3e177f15797a45de88a9a91d28568f25'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:27:35.500399 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-1c64fc77-3c56-4bfa-b136-58df80b609b2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3e177f15797a45de88a9a91d28568f25'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:27:35.500882 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-1c64fc77-3c56-4bfa-b136-58df80b609b2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3e177f15797a45de88a9a91d28568f25'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:27:35.508926 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb7452a-73e7-4b27-9f9b-804255a544d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9649261fe98c4121bc3c1be26923450c, user_id=31dfe17024a34ea59568c8742f39c992, role_id=c39882b202e942479a7cdac2fc6da72c)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:27:35.512313 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb7452a-73e7-4b27-9f9b-804255a544d7 admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:27:35.512813 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-1c64fc77-3c56-4bfa-b136-58df80b609b2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3e177f15797a45de88a9a91d28568f25'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:27:35.532952 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 983/1954] 10.222.0.44 () {58 vars in 1223 bytes} [Thu Jun 16 12:27:35 2022] DELETE /identity/v3/users/3e177f15797a45de88a9a91d28568f25 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 12:27:35.533203 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 972/1955] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 16 12:27:35 2022] PUT /identity/v3/projects/9649261fe98c4121bc3c1be26923450c/users/31dfe17024a34ea59568c8742f39c992/roles/c39882b202e942479a7cdac2fc6da72c => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 12:27:35.541834 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c64fc77-3c56-4bfa-b136-58df80b609b2 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:27:35.548914 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-1c64fc77-3c56-4bfa-b136-58df80b609b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:27:35.551605 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8291de-a0fb-4d8f-8429-d52ca5988274 None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:35.551899 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8291de-a0fb-4d8f-8429-d52ca5988274 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:35.552182 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8291de-a0fb-4d8f-8429-d52ca5988274 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:35.604076 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-ac8291de-a0fb-4d8f-8429-d52ca5988274 None None] MFA Rules not processed for user `31dfe17024a34ea59568c8742f39c992`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:27:35.605359 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-ac8291de-a0fb-4d8f-8429-d52ca5988274 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:27:35.686023 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c64fc77-3c56-4bfa-b136-58df80b609b2 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:27:35.691495 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb93ad6-f5d7-45fc-a970-60595f654c2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:27:35.692387 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb93ad6-f5d7-45fc-a970-60595f654c2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:35.692669 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb93ad6-f5d7-45fc-a970-60595f654c2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:35.692979 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb93ad6-f5d7-45fc-a970-60595f654c2c admin admin] PATH_INFO: `/v3/users/6a047d2d2338406f909c7002b66b94af` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:35.694967 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb93ad6-f5d7-45fc-a970-60595f654c2c admin admin] RBAC: Authorizing `identity:delete_user(user_id=6a047d2d2338406f909c7002b66b94af)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:27:35.710205 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb93ad6-f5d7-45fc-a970-60595f654c2c admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:27:35.716045 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 973/1956] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 12:27:35 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:27:35.717480 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8291de-a0fb-4d8f-8429-d52ca5988274 None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:27:35.718877 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-ac8291de-a0fb-4d8f-8429-d52ca5988274 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:27:35.742706 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8291de-a0fb-4d8f-8429-d52ca5988274 None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:27:35.757540 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3c46f7-dd69-4042-bc0c-6ad7b7aadfc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:27:35.758383 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3c46f7-dd69-4042-bc0c-6ad7b7aadfc3 admin admin] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:35.758662 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3c46f7-dd69-4042-bc0c-6ad7b7aadfc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:35.758986 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3c46f7-dd69-4042-bc0c-6ad7b7aadfc3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:35.761841 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3c46f7-dd69-4042-bc0c-6ad7b7aadfc3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:27:35.763843 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3c46f7-dd69-4042-bc0c-6ad7b7aadfc3 admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:27:35.791176 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-bbb93ad6-f5d7-45fc-a970-60595f654c2c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6a047d2d2338406f909c7002b66b94af'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:27:35.792830 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-bbb93ad6-f5d7-45fc-a970-60595f654c2c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6a047d2d2338406f909c7002b66b94af'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:27:35.809475 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-bbb93ad6-f5d7-45fc-a970-60595f654c2c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6a047d2d2338406f909c7002b66b94af'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:27:35.810255 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-bbb93ad6-f5d7-45fc-a970-60595f654c2c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6a047d2d2338406f909c7002b66b94af'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:27:35.820407 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-bbb93ad6-f5d7-45fc-a970-60595f654c2c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6a047d2d2338406f909c7002b66b94af'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:27:35.824831 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 974/1957] 10.222.0.44 () {60 vars in 1152 bytes} [Thu Jun 16 12:27:35 2022] POST /identity/v3/projects => generated 407 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 12:27:35.829091 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3c46f7-dd69-4042-bc0c-6ad7b7aadfc3 admin admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:27:35.834969 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-0e3c46f7-dd69-4042-bc0c-6ad7b7aadfc3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:27:35.844846 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 984/1958] 10.222.0.44 () {58 vars in 1223 bytes} [Thu Jun 16 12:27:35 2022] DELETE /identity/v3/users/6a047d2d2338406f909c7002b66b94af => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:27:35.849979 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ffe201-4d8e-48a1-bbe6-04e0444fcab2 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:35.850355 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ffe201-4d8e-48a1-bbe6-04e0444fcab2 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:35.850874 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ffe201-4d8e-48a1-bbe6-04e0444fcab2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:35.879391 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:27:35.883676 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-89ffe201-4d8e-48a1-bbe6-04e0444fcab2 None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:27:35.885027 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-89ffe201-4d8e-48a1-bbe6-04e0444fcab2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:27:35.908226 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:27:35.968143 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3c46f7-dd69-4042-bc0c-6ad7b7aadfc3 admin admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:27:35.990794 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 985/1959] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 12:27:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:27:36.009601 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ffe201-4d8e-48a1-bbe6-04e0444fcab2 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:27:36.012305 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-89ffe201-4d8e-48a1-bbe6-04e0444fcab2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:27:36.047835 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9413bd8-3304-452b-b9d7-3eeeca942cb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:27:36.047835 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9413bd8-3304-452b-b9d7-3eeeca942cb6 admin admin] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:36.047835 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9413bd8-3304-452b-b9d7-3eeeca942cb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:36.048054 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9413bd8-3304-452b-b9d7-3eeeca942cb6 admin admin] PATH_INFO: `/v3/users` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:36.048597 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9413bd8-3304-452b-b9d7-3eeeca942cb6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:27:36.050877 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9413bd8-3304-452b-b9d7-3eeeca942cb6 admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:27:36.087807 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 975/1960] 10.222.0.44 () {60 vars in 1143 bytes} [Thu Jun 16 12:27:35 2022] POST /identity/v3/users => generated 310 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 12:27:36.091732 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9413bd8-3304-452b-b9d7-3eeeca942cb6 admin admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:27:36.103157 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9413bd8-3304-452b-b9d7-3eeeca942cb6 admin admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:27:36.103936 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ffe201-4d8e-48a1-bbe6-04e0444fcab2 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:27:36.108495 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d19deb-bd3e-4825-981d-b713bf432fe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:27:36.109217 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d19deb-bd3e-4825-981d-b713bf432fe7 admin admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:36.109505 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d19deb-bd3e-4825-981d-b713bf432fe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:36.109782 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d19deb-bd3e-4825-981d-b713bf432fe7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:36.110692 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d19deb-bd3e-4825-981d-b713bf432fe7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:27:36.112614 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070c9177-daae-4f47-a103-fa64df314e97 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1094729b25a4be7b0b394998c9ca681', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '601361df39e34fcca71175aa94e425c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:27:36.113222 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d19deb-bd3e-4825-981d-b713bf432fe7 admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:27:36.113348 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070c9177-daae-4f47-a103-fa64df314e97 service neutron] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:36.114321 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070c9177-daae-4f47-a103-fa64df314e97 service neutron] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:36.114321 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070c9177-daae-4f47-a103-fa64df314e97 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:36.123977 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 976/1961] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 12:27:36 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 12:27:36.128469 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d19deb-bd3e-4825-981d-b713bf432fe7 admin admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:27:36.138179 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070c9177-daae-4f47-a103-fa64df314e97 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:27:36.139987 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070c9177-daae-4f47-a103-fa64df314e97 service neutron] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:27:36.143005 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d19deb-bd3e-4825-981d-b713bf432fe7 admin admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:27:36.149557 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b7ca6a-6f1b-4080-a4b8-51b4758a04e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:27:36.150308 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b7ca6a-6f1b-4080-a4b8-51b4758a04e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:36.150599 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b7ca6a-6f1b-4080-a4b8-51b4758a04e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:36.151041 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b7ca6a-6f1b-4080-a4b8-51b4758a04e1 admin admin] PATH_INFO: `/v3/projects/44c6644fb5a24533a93f1e40d5205dc2/users/078fb1c01f884c26b6bda3636c085a59/roles/0688968254744e3f9913653cafea3091` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:36.153761 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 986/1962] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 12:27:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 12:27:36.155332 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070c9177-daae-4f47-a103-fa64df314e97 service neutron] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:27:36.156877 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-070c9177-daae-4f47-a103-fa64df314e97 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:27:36.173766 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b7ca6a-6f1b-4080-a4b8-51b4758a04e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=44c6644fb5a24533a93f1e40d5205dc2, user_id=078fb1c01f884c26b6bda3636c085a59, role_id=0688968254744e3f9913653cafea3091)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:27:36.179888 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b7ca6a-6f1b-4080-a4b8-51b4758a04e1 admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:27:36.188616 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070c9177-daae-4f47-a103-fa64df314e97 service neutron] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:27:36.197641 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 977/1963] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 16 12:27:36 2022] PUT /identity/v3/projects/44c6644fb5a24533a93f1e40d5205dc2/users/078fb1c01f884c26b6bda3636c085a59/roles/0688968254744e3f9913653cafea3091 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:27:36.201444 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b7ca6a-6f1b-4080-a4b8-51b4758a04e1 admin admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:27:36.264336 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00581400-2639-408c-a905-b08c658598ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:27:36.265257 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00581400-2639-408c-a905-b08c658598ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:36.265548 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00581400-2639-408c-a905-b08c658598ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:36.265827 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00581400-2639-408c-a905-b08c658598ef admin admin] PATH_INFO: `/v3/projects/0725ac1cb894453e9f62dca9f96b99e3` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:36.267107 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00581400-2639-408c-a905-b08c658598ef admin admin] RBAC: Authorizing `identity:delete_project(project_id=0725ac1cb894453e9f62dca9f96b99e3)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:27:36.269395 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00581400-2639-408c-a905-b08c658598ef admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:27:36.297988 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b7ca6a-6f1b-4080-a4b8-51b4758a04e1 admin admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:27:36.304960 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4258c8-42b5-424c-9900-0d6612d3c3c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:27:36.305945 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4258c8-42b5-424c-9900-0d6612d3c3c6 admin admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:36.306091 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4258c8-42b5-424c-9900-0d6612d3c3c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:36.306398 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4258c8-42b5-424c-9900-0d6612d3c3c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:36.307607 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4258c8-42b5-424c-9900-0d6612d3c3c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:27:36.308629 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4258c8-42b5-424c-9900-0d6612d3c3c6 admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:27:36.321704 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-00581400-2639-408c-a905-b08c658598ef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0725ac1cb894453e9f62dca9f96b99e3', 'request_id': 'req-00581400-2639-408c-a905-b08c658598ef'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:27:36.326460 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 978/1964] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 12:27:36 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 12:27:36.330392 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4258c8-42b5-424c-9900-0d6612d3c3c6 admin admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:27:36.345197 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-00581400-2639-408c-a905-b08c658598ef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0725ac1cb894453e9f62dca9f96b99e3', 'request_id': 'req-00581400-2639-408c-a905-b08c658598ef'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:27:36.349245 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4258c8-42b5-424c-9900-0d6612d3c3c6 admin admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:27:36.353551 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-00581400-2639-408c-a905-b08c658598ef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0725ac1cb894453e9f62dca9f96b99e3', 'request_id': 'req-00581400-2639-408c-a905-b08c658598ef'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:27:36.361168 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:27:36.370193 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-00581400-2639-408c-a905-b08c658598ef admin admin] The token cache is being invalidate because project 0725ac1cb894453e9f62dca9f96b99e3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 12:27:36.372564 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:27:36.374520 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-00581400-2639-408c-a905-b08c658598ef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:27:36.375120 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-00581400-2639-408c-a905-b08c658598ef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:27:36.377716 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 987/1965] 10.222.0.44 () {58 vars in 1232 bytes} [Thu Jun 16 12:27:36 2022] DELETE /identity/v3/projects/0725ac1cb894453e9f62dca9f96b99e3 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:27:36.387335 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8612f39e-b5f4-4ef1-8105-4c71023b5326 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:36.388921 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8612f39e-b5f4-4ef1-8105-4c71023b5326 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:36.389131 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8612f39e-b5f4-4ef1-8105-4c71023b5326 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:36.411612 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-8612f39e-b5f4-4ef1-8105-4c71023b5326 None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:27:36.413425 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-8612f39e-b5f4-4ef1-8105-4c71023b5326 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:27:36.426301 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8918d9ce-e374-4f6f-baf3-4a1dc10f1a1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:27:36.428457 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8918d9ce-e374-4f6f-baf3-4a1dc10f1a1d admin admin] REQUEST_METHOD: `PUT` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:36.429344 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8918d9ce-e374-4f6f-baf3-4a1dc10f1a1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:36.429344 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8918d9ce-e374-4f6f-baf3-4a1dc10f1a1d admin admin] PATH_INFO: `/v3/projects/44c6644fb5a24533a93f1e40d5205dc2/users/078fb1c01f884c26b6bda3636c085a59/roles/0688968254744e3f9913653cafea3091` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:36.431980 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8918d9ce-e374-4f6f-baf3-4a1dc10f1a1d admin admin] RBAC: Authorizing `identity:create_grant(project_id=44c6644fb5a24533a93f1e40d5205dc2, user_id=078fb1c01f884c26b6bda3636c085a59, role_id=0688968254744e3f9913653cafea3091)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:27:36.435160 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8918d9ce-e374-4f6f-baf3-4a1dc10f1a1d admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:27:36.450389 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 979/1966] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 16 12:27:36 2022] PUT /identity/v3/projects/44c6644fb5a24533a93f1e40d5205dc2/users/078fb1c01f884c26b6bda3636c085a59/roles/0688968254744e3f9913653cafea3091 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 12:27:36.461317 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a7d77c-4f95-4cf5-8fd9-5d9d2f510c39 None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:36.461876 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a7d77c-4f95-4cf5-8fd9-5d9d2f510c39 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:36.462158 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a7d77c-4f95-4cf5-8fd9-5d9d2f510c39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:36.487106 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 988/1967] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 12:27:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:27:36.495130 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57f5848-6bc6-4bed-b841-b53e5a248041 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:36.495426 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57f5848-6bc6-4bed-b841-b53e5a248041 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:36.495713 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57f5848-6bc6-4bed-b841-b53e5a248041 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:36.496386 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-09a7d77c-4f95-4cf5-8fd9-5d9d2f510c39 None None] MFA Rules not processed for user `078fb1c01f884c26b6bda3636c085a59`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:27:36.497836 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-09a7d77c-4f95-4cf5-8fd9-5d9d2f510c39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:27:36.518366 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-d57f5848-6bc6-4bed-b841-b53e5a248041 None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:27:36.519903 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-d57f5848-6bc6-4bed-b841-b53e5a248041 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:27:36.585683 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 980/1968] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 12:27:36 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 12:27:36.586536 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a7d77c-4f95-4cf5-8fd9-5d9d2f510c39 None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:27:36.587864 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-09a7d77c-4f95-4cf5-8fd9-5d9d2f510c39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:27:36.605878 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 989/1969] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 12:27:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 12:27:36.606836 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57f5848-6bc6-4bed-b841-b53e5a248041 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:27:36.608151 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-d57f5848-6bc6-4bed-b841-b53e5a248041 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:27:36.669325 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a7d77c-4f95-4cf5-8fd9-5d9d2f510c39 None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:27:36.674532 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93230499-d2b0-4cd4-b0a6-f35cb450e0f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:27:36.675406 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93230499-d2b0-4cd4-b0a6-f35cb450e0f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:36.675677 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93230499-d2b0-4cd4-b0a6-f35cb450e0f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:36.675891 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57f5848-6bc6-4bed-b841-b53e5a248041 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:27:36.675995 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93230499-d2b0-4cd4-b0a6-f35cb450e0f6 admin admin] PATH_INFO: `/v3/projects/177d663a60ae431c83dd60c1e3902d61` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:36.677218 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93230499-d2b0-4cd4-b0a6-f35cb450e0f6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=177d663a60ae431c83dd60c1e3902d61)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:27:36.680344 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93230499-d2b0-4cd4-b0a6-f35cb450e0f6 admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:27:36.681825 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60836e3a-8551-427f-94b8-a39d3fbf5d3e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f96fc14ed89478c8a8c2f11c87511e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '601361df39e34fcca71175aa94e425c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:27:36.682591 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60836e3a-8551-427f-94b8-a39d3fbf5d3e service cinder] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:36.683264 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60836e3a-8551-427f-94b8-a39d3fbf5d3e service cinder] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:36.683264 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60836e3a-8551-427f-94b8-a39d3fbf5d3e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:36.694989 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60836e3a-8551-427f-94b8-a39d3fbf5d3e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:27:36.696533 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60836e3a-8551-427f-94b8-a39d3fbf5d3e service cinder] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:27:36.709609 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 990/1970] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 12:27:36 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 12:27:36.712055 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60836e3a-8551-427f-94b8-a39d3fbf5d3e service cinder] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:27:36.736396 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60836e3a-8551-427f-94b8-a39d3fbf5d3e service cinder] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:27:36.747635 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:27:36.764737 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-93230499-d2b0-4cd4-b0a6-f35cb450e0f6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '177d663a60ae431c83dd60c1e3902d61', 'request_id': 'req-93230499-d2b0-4cd4-b0a6-f35cb450e0f6'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:27:36.780910 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-93230499-d2b0-4cd4-b0a6-f35cb450e0f6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '177d663a60ae431c83dd60c1e3902d61', 'request_id': 'req-93230499-d2b0-4cd4-b0a6-f35cb450e0f6'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:27:36.793996 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-93230499-d2b0-4cd4-b0a6-f35cb450e0f6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '177d663a60ae431c83dd60c1e3902d61', 'request_id': 'req-93230499-d2b0-4cd4-b0a6-f35cb450e0f6'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:27:36.800322 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:27:36.817318 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-93230499-d2b0-4cd4-b0a6-f35cb450e0f6 admin admin] The token cache is being invalidate because project 177d663a60ae431c83dd60c1e3902d61 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 12:27:36.817611 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-93230499-d2b0-4cd4-b0a6-f35cb450e0f6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:27:36.818338 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-93230499-d2b0-4cd4-b0a6-f35cb450e0f6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:27:36.820582 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 981/1971] 10.222.0.44 () {58 vars in 1232 bytes} [Thu Jun 16 12:27:36 2022] DELETE /identity/v3/projects/177d663a60ae431c83dd60c1e3902d61 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:27:36.821859 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a28e2d1-4dde-42ef-be56-40467c96d024 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:27:36.822533 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a28e2d1-4dde-42ef-be56-40467c96d024 admin admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:36.822818 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a28e2d1-4dde-42ef-be56-40467c96d024 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:36.823096 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a28e2d1-4dde-42ef-be56-40467c96d024 admin admin] PATH_INFO: `/v3/domains` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:36.823833 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a28e2d1-4dde-42ef-be56-40467c96d024 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:27:36.824144 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a28e2d1-4dde-42ef-be56-40467c96d024 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:27:36.824646 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93230499-d2b0-4cd4-b0a6-f35cb450e0f6 admin admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:27:36.825835 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a28e2d1-4dde-42ef-be56-40467c96d024 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:27:36.826436 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-93230499-d2b0-4cd4-b0a6-f35cb450e0f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:27:36.840791 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 991/1972] 10.222.0.44 () {58 vars in 1152 bytes} [Thu Jun 16 12:27:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:27:36.841897 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93230499-d2b0-4cd4-b0a6-f35cb450e0f6 admin admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:27:36.844642 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a28e2d1-4dde-42ef-be56-40467c96d024 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:27:36.846486 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-3a28e2d1-4dde-42ef-be56-40467c96d024 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:27:36.848663 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86a64a4-f49e-4f89-a34e-27b504cf4734 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:27:36.849714 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86a64a4-f49e-4f89-a34e-27b504cf4734 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:36.850000 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86a64a4-f49e-4f89-a34e-27b504cf4734 admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:36.850276 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86a64a4-f49e-4f89-a34e-27b504cf4734 admin admin] PATH_INFO: `/v3/users/452aef527028426385b9f7d3d9ad56fc` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:36.851500 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86a64a4-f49e-4f89-a34e-27b504cf4734 admin admin] RBAC: Authorizing `identity:delete_user(user_id=452aef527028426385b9f7d3d9ad56fc)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:27:36.853496 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86a64a4-f49e-4f89-a34e-27b504cf4734 admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:27:36.861898 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a28e2d1-4dde-42ef-be56-40467c96d024 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:27:36.868106 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a68361c-2e20-4335-ad60-0e38d5c4e583 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:27:36.868810 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a68361c-2e20-4335-ad60-0e38d5c4e583 admin admin] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:36.869140 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a68361c-2e20-4335-ad60-0e38d5c4e583 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:36.869406 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a68361c-2e20-4335-ad60-0e38d5c4e583 admin admin] PATH_INFO: `/v3/projects` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:36.870122 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a68361c-2e20-4335-ad60-0e38d5c4e583 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:27:36.872108 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a68361c-2e20-4335-ad60-0e38d5c4e583 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:27:36.905194 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 992/1973] 10.222.0.44 () {60 vars in 1152 bytes} [Thu Jun 16 12:27:36 2022] POST /identity/v3/projects => generated 357 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 12:27:36.909388 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a68361c-2e20-4335-ad60-0e38d5c4e583 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:27:36.912906 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-d86a64a4-f49e-4f89-a34e-27b504cf4734 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '452aef527028426385b9f7d3d9ad56fc'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:27:36.928356 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-d86a64a4-f49e-4f89-a34e-27b504cf4734 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '452aef527028426385b9f7d3d9ad56fc'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:27:36.947324 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-d86a64a4-f49e-4f89-a34e-27b504cf4734 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '452aef527028426385b9f7d3d9ad56fc'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:27:36.948323 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-d86a64a4-f49e-4f89-a34e-27b504cf4734 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '452aef527028426385b9f7d3d9ad56fc'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:27:36.949237 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-d86a64a4-f49e-4f89-a34e-27b504cf4734 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '452aef527028426385b9f7d3d9ad56fc'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:27:36.962641 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 982/1974] 10.222.0.44 () {58 vars in 1223 bytes} [Thu Jun 16 12:27:36 2022] DELETE /identity/v3/users/452aef527028426385b9f7d3d9ad56fc => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 12:27:36.965681 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86a64a4-f49e-4f89-a34e-27b504cf4734 admin admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:27:36.967152 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-d86a64a4-f49e-4f89-a34e-27b504cf4734 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:27:36.991254 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a68361c-2e20-4335-ad60-0e38d5c4e583 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:27:37.041447 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86a64a4-f49e-4f89-a34e-27b504cf4734 admin admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:27:37.047347 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b89f308-87cf-4a82-92f2-3759a18daa56 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f96fc14ed89478c8a8c2f11c87511e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '601361df39e34fcca71175aa94e425c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:27:37.048105 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b89f308-87cf-4a82-92f2-3759a18daa56 service cinder] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:37.048373 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b89f308-87cf-4a82-92f2-3759a18daa56 service cinder] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:37.048743 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b89f308-87cf-4a82-92f2-3759a18daa56 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:37.052092 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-2b89f308-87cf-4a82-92f2-3759a18daa56 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:27:37.067144 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c90553f-ce33-40ad-9ee6-09fa4d0f635f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:27:37.068078 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c90553f-ce33-40ad-9ee6-09fa4d0f635f admin admin] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:37.068538 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c90553f-ce33-40ad-9ee6-09fa4d0f635f admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:37.072878 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c90553f-ce33-40ad-9ee6-09fa4d0f635f admin admin] PATH_INFO: `/v3/users` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:37.074300 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c90553f-ce33-40ad-9ee6-09fa4d0f635f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:27:37.077738 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c90553f-ce33-40ad-9ee6-09fa4d0f635f admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:27:37.108240 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 993/1975] 10.222.0.44 () {60 vars in 1143 bytes} [Thu Jun 16 12:27:36 2022] POST /identity/v3/users => generated 279 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 12:27:37.112815 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c90553f-ce33-40ad-9ee6-09fa4d0f635f admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:27:37.114283 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-0c90553f-ce33-40ad-9ee6-09fa4d0f635f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:27:37.140961 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:27:37.144170 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b89f308-87cf-4a82-92f2-3759a18daa56 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:27:37.149153 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c90553f-ce33-40ad-9ee6-09fa4d0f635f admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:27:37.156267 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b398589-9ce2-44d4-80a5-f7e888864caa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:27:37.157132 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b398589-9ce2-44d4-80a5-f7e888864caa admin admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:37.157518 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b398589-9ce2-44d4-80a5-f7e888864caa admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:37.158080 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b398589-9ce2-44d4-80a5-f7e888864caa admin admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:37.158499 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b89f308-87cf-4a82-92f2-3759a18daa56 service cinder] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:27:37.159029 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b398589-9ce2-44d4-80a5-f7e888864caa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:27:37.161055 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b398589-9ce2-44d4-80a5-f7e888864caa admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:27:37.174245 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 983/1976] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 12:27:36 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 12:27:37.181538 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 994/1977] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 12:27:37 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 12:27:37.185892 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b89f308-87cf-4a82-92f2-3759a18daa56 service cinder] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:27:37.200658 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b89f308-87cf-4a82-92f2-3759a18daa56 service cinder] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:27:37.218375 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894942a2-5fde-4c59-a1cf-08302293dfde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:27:37.219182 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894942a2-5fde-4c59-a1cf-08302293dfde admin admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:37.219599 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894942a2-5fde-4c59-a1cf-08302293dfde admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:37.219977 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894942a2-5fde-4c59-a1cf-08302293dfde admin admin] PATH_INFO: `/v3/roles` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:37.221054 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894942a2-5fde-4c59-a1cf-08302293dfde admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:27:37.223262 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894942a2-5fde-4c59-a1cf-08302293dfde admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:27:37.239832 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 984/1978] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 12:27:37 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 12:27:37.244589 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b398589-9ce2-44d4-80a5-f7e888864caa admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:27:37.257757 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b398589-9ce2-44d4-80a5-f7e888864caa admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:27:37.266716 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d68820-b15b-429c-9875-d4b9638b87b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:27:37.267506 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d68820-b15b-429c-9875-d4b9638b87b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:37.268051 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d68820-b15b-429c-9875-d4b9638b87b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:37.268431 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d68820-b15b-429c-9875-d4b9638b87b9 admin admin] PATH_INFO: `/v3/projects/0439bc6f811c45ee9c99149b94dfc45a/users/b400def2aca54d778c47e75c41658d81/roles/c39882b202e942479a7cdac2fc6da72c` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:37.292494 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d68820-b15b-429c-9875-d4b9638b87b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0439bc6f811c45ee9c99149b94dfc45a, user_id=b400def2aca54d778c47e75c41658d81, role_id=c39882b202e942479a7cdac2fc6da72c)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:27:37.296034 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d68820-b15b-429c-9875-d4b9638b87b9 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:27:37.315114 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 995/1979] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 16 12:27:37 2022] PUT /identity/v3/projects/0439bc6f811c45ee9c99149b94dfc45a/users/b400def2aca54d778c47e75c41658d81/roles/c39882b202e942479a7cdac2fc6da72c => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 12:27:37.325437 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0e42ad-faf8-4ef6-a116-3d30464579e7 None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:37.325951 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0e42ad-faf8-4ef6-a116-3d30464579e7 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:37.326355 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0e42ad-faf8-4ef6-a116-3d30464579e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:37.379376 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-7d0e42ad-faf8-4ef6-a116-3d30464579e7 None None] MFA Rules not processed for user `b400def2aca54d778c47e75c41658d81`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:27:37.381522 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-7d0e42ad-faf8-4ef6-a116-3d30464579e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:27:37.401794 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d68820-b15b-429c-9875-d4b9638b87b9 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:27:37.403982 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-90d68820-b15b-429c-9875-d4b9638b87b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:27:37.454916 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:27:37.514900 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 985/1980] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 12:27:37 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:27:37.516478 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0e42ad-faf8-4ef6-a116-3d30464579e7 None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:27:37.550485 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d68820-b15b-429c-9875-d4b9638b87b9 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:27:37.555768 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e7f279-5781-4638-8493-97edc06f7110 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:27:37.556703 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e7f279-5781-4638-8493-97edc06f7110 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:37.557050 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e7f279-5781-4638-8493-97edc06f7110 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:37.557620 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e7f279-5781-4638-8493-97edc06f7110 admin admin] PATH_INFO: `/v3/projects/6ec034919daa4325b34e9a4338d94a35` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:37.558948 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e7f279-5781-4638-8493-97edc06f7110 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6ec034919daa4325b34e9a4338d94a35)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:27:37.587695 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e7f279-5781-4638-8493-97edc06f7110 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:27:37.659289 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0e42ad-faf8-4ef6-a116-3d30464579e7 None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:27:37.675389 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-39e7f279-5781-4638-8493-97edc06f7110 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6ec034919daa4325b34e9a4338d94a35', 'request_id': 'req-39e7f279-5781-4638-8493-97edc06f7110'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:27:37.694677 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-39e7f279-5781-4638-8493-97edc06f7110 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6ec034919daa4325b34e9a4338d94a35', 'request_id': 'req-39e7f279-5781-4638-8493-97edc06f7110'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:27:37.702677 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-39e7f279-5781-4638-8493-97edc06f7110 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6ec034919daa4325b34e9a4338d94a35', 'request_id': 'req-39e7f279-5781-4638-8493-97edc06f7110'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:27:37.720075 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-39e7f279-5781-4638-8493-97edc06f7110 admin admin] The token cache is being invalidate because project 6ec034919daa4325b34e9a4338d94a35 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 12:27:37.720510 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-39e7f279-5781-4638-8493-97edc06f7110 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:27:37.721353 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-39e7f279-5781-4638-8493-97edc06f7110 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:27:37.723384 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 996/1981] 10.222.0.44 () {58 vars in 1232 bytes} [Thu Jun 16 12:27:37 2022] DELETE /identity/v3/projects/6ec034919daa4325b34e9a4338d94a35 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 12:27:37.729115 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a561a642-0feb-43e7-b7b8-2ae2a2e67bc8 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:37.729520 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a561a642-0feb-43e7-b7b8-2ae2a2e67bc8 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:37.729902 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a561a642-0feb-43e7-b7b8-2ae2a2e67bc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:37.740669 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f99179-37c8-4c07-ac6b-834bfe7cee67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:27:37.741371 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f99179-37c8-4c07-ac6b-834bfe7cee67 admin admin] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:37.741655 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f99179-37c8-4c07-ac6b-834bfe7cee67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:37.741930 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f99179-37c8-4c07-ac6b-834bfe7cee67 admin admin] PATH_INFO: `/v3/projects` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:37.742628 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f99179-37c8-4c07-ac6b-834bfe7cee67 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:27:37.744564 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f99179-37c8-4c07-ac6b-834bfe7cee67 admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:27:37.750266 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-a561a642-0feb-43e7-b7b8-2ae2a2e67bc8 None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:27:37.751618 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-a561a642-0feb-43e7-b7b8-2ae2a2e67bc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:27:37.767450 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 997/1982] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 12:27:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 12:27:37.769452 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a23d42-e916-4529-80b4-76eba693396d None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:37.769452 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a23d42-e916-4529-80b4-76eba693396d None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:37.769711 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a23d42-e916-4529-80b4-76eba693396d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:37.772414 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 986/1983] 10.222.0.44 () {60 vars in 1152 bytes} [Thu Jun 16 12:27:37 2022] POST /identity/v3/projects => generated 365 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 12:27:37.776732 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f99179-37c8-4c07-ac6b-834bfe7cee67 admin admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:27:37.778896 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-30f99179-37c8-4c07-ac6b-834bfe7cee67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:27:37.789060 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:27:37.796064 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-31a23d42-e916-4529-80b4-76eba693396d None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:27:37.799147 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-31a23d42-e916-4529-80b4-76eba693396d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:27:37.861914 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f99179-37c8-4c07-ac6b-834bfe7cee67 admin admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:27:37.866172 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 998/1984] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 12:27:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 12:27:37.866992 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ceda59-4fac-48c4-ba9a-ec57591d7864 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:27:37.867826 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ceda59-4fac-48c4-ba9a-ec57591d7864 admin admin] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:37.868185 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ceda59-4fac-48c4-ba9a-ec57591d7864 admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:37.868532 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ceda59-4fac-48c4-ba9a-ec57591d7864 admin admin] PATH_INFO: `/v3/users` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:37.869336 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ceda59-4fac-48c4-ba9a-ec57591d7864 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:27:37.870329 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a23d42-e916-4529-80b4-76eba693396d None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:27:37.871454 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ceda59-4fac-48c4-ba9a-ec57591d7864 admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:27:37.879727 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a23d42-e916-4529-80b4-76eba693396d None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:27:37.893060 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe25ada7-827b-4369-903d-4f45384ae600 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:27:37.897584 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe25ada7-827b-4369-903d-4f45384ae600 admin admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:37.897734 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 987/1985] 10.222.0.44 () {60 vars in 1143 bytes} [Thu Jun 16 12:27:37 2022] POST /identity/v3/users => generated 289 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 12:27:37.897850 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe25ada7-827b-4369-903d-4f45384ae600 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:37.897850 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe25ada7-827b-4369-903d-4f45384ae600 admin admin] PATH_INFO: `/v3/domains` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:37.897850 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe25ada7-827b-4369-903d-4f45384ae600 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:27:37.897850 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe25ada7-827b-4369-903d-4f45384ae600 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:27:37.898402 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe25ada7-827b-4369-903d-4f45384ae600 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:27:37.899548 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ceda59-4fac-48c4-ba9a-ec57591d7864 admin admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:27:37.911421 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ceda59-4fac-48c4-ba9a-ec57591d7864 admin admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:27:37.912803 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 999/1986] 10.222.0.44 () {58 vars in 1152 bytes} [Thu Jun 16 12:27:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 12:27:37.916681 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe25ada7-827b-4369-903d-4f45384ae600 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:27:37.920048 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e377a5f5-e511-46ed-904a-afdcee31f032 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:27:37.920723 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e377a5f5-e511-46ed-904a-afdcee31f032 admin admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:37.921039 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e377a5f5-e511-46ed-904a-afdcee31f032 admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:37.921327 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e377a5f5-e511-46ed-904a-afdcee31f032 admin admin] PATH_INFO: `/v3/roles` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:37.922061 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e377a5f5-e511-46ed-904a-afdcee31f032 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:27:37.923706 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e377a5f5-e511-46ed-904a-afdcee31f032 admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:27:37.927865 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe25ada7-827b-4369-903d-4f45384ae600 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:27:37.938400 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 988/1987] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 12:27:37 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 12:27:37.939176 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e377a5f5-e511-46ed-904a-afdcee31f032 admin admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:27:37.939819 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23310caa-fa97-4276-9587-d28a840aea0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:27:37.940562 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23310caa-fa97-4276-9587-d28a840aea0a admin admin] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:37.940946 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23310caa-fa97-4276-9587-d28a840aea0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:37.941254 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23310caa-fa97-4276-9587-d28a840aea0a admin admin] PATH_INFO: `/v3/projects` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:37.942078 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23310caa-fa97-4276-9587-d28a840aea0a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:27:37.944784 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23310caa-fa97-4276-9587-d28a840aea0a admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:27:37.950467 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e377a5f5-e511-46ed-904a-afdcee31f032 admin admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:27:37.955760 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dca6b00-105b-41bc-80f3-97f6ba93b759 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:27:37.956729 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dca6b00-105b-41bc-80f3-97f6ba93b759 admin admin] REQUEST_METHOD: `PUT` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:37.957101 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dca6b00-105b-41bc-80f3-97f6ba93b759 admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:37.957812 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dca6b00-105b-41bc-80f3-97f6ba93b759 admin admin] PATH_INFO: `/v3/projects/d4bb2935653b4f3ba02a9570b6d230fc/users/cd9bd1f3cfb6458892c3febd26f46fd0/roles/0688968254744e3f9913653cafea3091` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:37.984510 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dca6b00-105b-41bc-80f3-97f6ba93b759 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d4bb2935653b4f3ba02a9570b6d230fc, user_id=cd9bd1f3cfb6458892c3febd26f46fd0, role_id=0688968254744e3f9913653cafea3091)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:27:37.984699 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1000/1988] 10.222.0.44 () {60 vars in 1152 bytes} [Thu Jun 16 12:27:37 2022] POST /identity/v3/projects => generated 371 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 12:27:37.985566 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23310caa-fa97-4276-9587-d28a840aea0a admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:27:37.988355 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dca6b00-105b-41bc-80f3-97f6ba93b759 admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:27:37.993837 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:27:38.012563 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 989/1989] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 16 12:27:37 2022] PUT /identity/v3/projects/d4bb2935653b4f3ba02a9570b6d230fc/users/cd9bd1f3cfb6458892c3febd26f46fd0/roles/0688968254744e3f9913653cafea3091 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:27:38.012563 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dca6b00-105b-41bc-80f3-97f6ba93b759 admin admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:27:38.058508 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23310caa-fa97-4276-9587-d28a840aea0a admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:27:38.080063 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dca6b00-105b-41bc-80f3-97f6ba93b759 admin admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:27:38.085301 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa045ed-1e23-4dfd-9d54-20777bab30a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:27:38.086084 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa045ed-1e23-4dfd-9d54-20777bab30a9 admin admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:38.086383 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa045ed-1e23-4dfd-9d54-20777bab30a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:38.086643 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa045ed-1e23-4dfd-9d54-20777bab30a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:38.087370 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa045ed-1e23-4dfd-9d54-20777bab30a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:27:38.088999 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa045ed-1e23-4dfd-9d54-20777bab30a9 admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:27:38.099331 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 990/1990] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 12:27:38 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 12:27:38.103183 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa045ed-1e23-4dfd-9d54-20777bab30a9 admin admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:27:38.113021 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa045ed-1e23-4dfd-9d54-20777bab30a9 admin admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:27:38.118513 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffb55cc-019c-42d2-8f16-1a26bf1bd5f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:27:38.119563 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffb55cc-019c-42d2-8f16-1a26bf1bd5f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:38.119850 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffb55cc-019c-42d2-8f16-1a26bf1bd5f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:38.120055 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32db12e4-0fbd-4fef-b8cf-276be701ce7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:27:38.120283 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffb55cc-019c-42d2-8f16-1a26bf1bd5f6 admin admin] PATH_INFO: `/v3/projects/d4bb2935653b4f3ba02a9570b6d230fc/users/cd9bd1f3cfb6458892c3febd26f46fd0/roles/0688968254744e3f9913653cafea3091` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:38.120731 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32db12e4-0fbd-4fef-b8cf-276be701ce7e admin admin] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:38.121050 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32db12e4-0fbd-4fef-b8cf-276be701ce7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:38.121329 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32db12e4-0fbd-4fef-b8cf-276be701ce7e admin admin] PATH_INFO: `/v3/users` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:38.122024 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32db12e4-0fbd-4fef-b8cf-276be701ce7e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:27:38.122691 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffb55cc-019c-42d2-8f16-1a26bf1bd5f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d4bb2935653b4f3ba02a9570b6d230fc, user_id=cd9bd1f3cfb6458892c3febd26f46fd0, role_id=0688968254744e3f9913653cafea3091)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:27:38.123970 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32db12e4-0fbd-4fef-b8cf-276be701ce7e admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:27:38.125542 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffb55cc-019c-42d2-8f16-1a26bf1bd5f6 admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:27:38.138485 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 991/1991] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 16 12:27:38 2022] PUT /identity/v3/projects/d4bb2935653b4f3ba02a9570b6d230fc/users/cd9bd1f3cfb6458892c3febd26f46fd0/roles/0688968254744e3f9913653cafea3091 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 12:27:38.148564 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1001/1992] 10.222.0.44 () {60 vars in 1143 bytes} [Thu Jun 16 12:27:37 2022] POST /identity/v3/users => generated 286 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 12:27:38.149587 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32db12e4-0fbd-4fef-b8cf-276be701ce7e admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:27:38.149765 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63939c6a-f99e-4797-95f9-688be1deb118 None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:38.150198 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63939c6a-f99e-4797-95f9-688be1deb118 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:38.150368 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63939c6a-f99e-4797-95f9-688be1deb118 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:38.159410 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32db12e4-0fbd-4fef-b8cf-276be701ce7e admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:27:38.178796 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-63939c6a-f99e-4797-95f9-688be1deb118 None None] MFA Rules not processed for user `cd9bd1f3cfb6458892c3febd26f46fd0`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:27:38.180692 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-63939c6a-f99e-4797-95f9-688be1deb118 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:27:38.213780 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:27:38.216537 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b111c1d-3601-4d94-b095-093453653f57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:27:38.217960 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b111c1d-3601-4d94-b095-093453653f57 admin admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:38.217960 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b111c1d-3601-4d94-b095-093453653f57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:38.217960 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b111c1d-3601-4d94-b095-093453653f57 admin admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:38.218612 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b111c1d-3601-4d94-b095-093453653f57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:27:38.220184 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b111c1d-3601-4d94-b095-093453653f57 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:27:38.230253 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1002/1993] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 12:27:38 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 12:27:38.234105 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b111c1d-3601-4d94-b095-093453653f57 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:27:38.244384 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b111c1d-3601-4d94-b095-093453653f57 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:27:38.248979 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad55b1e-c603-4634-af48-ecf254cdefd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:27:38.249640 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad55b1e-c603-4634-af48-ecf254cdefd3 admin admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:38.249920 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad55b1e-c603-4634-af48-ecf254cdefd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:38.250189 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad55b1e-c603-4634-af48-ecf254cdefd3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:38.250908 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad55b1e-c603-4634-af48-ecf254cdefd3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:27:38.252501 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad55b1e-c603-4634-af48-ecf254cdefd3 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:27:38.257134 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 992/1994] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 12:27:38 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:27:38.263634 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1003/1995] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 12:27:38 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 12:27:38.269036 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63939c6a-f99e-4797-95f9-688be1deb118 None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:27:38.273848 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad55b1e-c603-4634-af48-ecf254cdefd3 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:27:38.275937 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-8ad55b1e-c603-4634-af48-ecf254cdefd3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:27:38.280400 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63939c6a-f99e-4797-95f9-688be1deb118 None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:27:38.286473 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299678c5-045b-4e96-b1f8-054878c396b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:27:38.286831 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299678c5-045b-4e96-b1f8-054878c396b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:38.287149 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299678c5-045b-4e96-b1f8-054878c396b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:38.287423 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299678c5-045b-4e96-b1f8-054878c396b8 admin admin] PATH_INFO: `/v3/projects/53a1c049d3d540a1b8ae05695d0d0a5f/users/090f06724937434ba307b6985493288a/roles/c39882b202e942479a7cdac2fc6da72c` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:38.306134 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299678c5-045b-4e96-b1f8-054878c396b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=53a1c049d3d540a1b8ae05695d0d0a5f, user_id=090f06724937434ba307b6985493288a, role_id=c39882b202e942479a7cdac2fc6da72c)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:27:38.311578 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299678c5-045b-4e96-b1f8-054878c396b8 admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:27:38.321569 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:27:38.329606 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 993/1996] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 16 12:27:38 2022] PUT /identity/v3/projects/53a1c049d3d540a1b8ae05695d0d0a5f/users/090f06724937434ba307b6985493288a/roles/c39882b202e942479a7cdac2fc6da72c => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:27:38.342349 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c69cb28-72d7-4409-8260-2ec53f613c80 None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:38.342684 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c69cb28-72d7-4409-8260-2ec53f613c80 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:38.342974 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c69cb28-72d7-4409-8260-2ec53f613c80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:38.367177 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad55b1e-c603-4634-af48-ecf254cdefd3 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:27:38.371150 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-9c69cb28-72d7-4409-8260-2ec53f613c80 None None] MFA Rules not processed for user `090f06724937434ba307b6985493288a`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:27:38.374274 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-9c69cb28-72d7-4409-8260-2ec53f613c80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:27:38.455311 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c612494-6046-4091-9dc3-2d4507f3a2e9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f96fc14ed89478c8a8c2f11c87511e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '601361df39e34fcca71175aa94e425c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:27:38.456074 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c612494-6046-4091-9dc3-2d4507f3a2e9 service cinder] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:38.456434 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c612494-6046-4091-9dc3-2d4507f3a2e9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:38.456798 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c612494-6046-4091-9dc3-2d4507f3a2e9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:38.478840 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 994/1997] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 12:27:38 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:27:38.489747 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c69cb28-72d7-4409-8260-2ec53f613c80 None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:27:38.493299 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-9c69cb28-72d7-4409-8260-2ec53f613c80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:27:38.507172 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c69cb28-72d7-4409-8260-2ec53f613c80 None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:27:38.513736 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd1bf15-2171-4f2b-8df2-0abb44cc7748 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f96fc14ed89478c8a8c2f11c87511e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '601361df39e34fcca71175aa94e425c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:27:38.514617 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd1bf15-2171-4f2b-8df2-0abb44cc7748 service cinder] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:38.515144 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd1bf15-2171-4f2b-8df2-0abb44cc7748 service cinder] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:38.515567 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd1bf15-2171-4f2b-8df2-0abb44cc7748 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:38.525795 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd1bf15-2171-4f2b-8df2-0abb44cc7748 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:27:38.528316 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd1bf15-2171-4f2b-8df2-0abb44cc7748 service cinder] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:27:38.534752 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c612494-6046-4091-9dc3-2d4507f3a2e9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:27:38.536467 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c612494-6046-4091-9dc3-2d4507f3a2e9 service cinder] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:27:38.539346 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 995/1998] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 12:27:38 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 12:27:38.550080 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1004/1999] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 12:27:38 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 12:27:38.563100 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd1bf15-2171-4f2b-8df2-0abb44cc7748 service cinder] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:27:38.638185 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c612494-6046-4091-9dc3-2d4507f3a2e9 service cinder] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:27:38.649077 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c612494-6046-4091-9dc3-2d4507f3a2e9 service cinder] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:27:38.655040 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91f3097-76f1-4909-96d9-1506d35c6106 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f96fc14ed89478c8a8c2f11c87511e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '601361df39e34fcca71175aa94e425c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:27:38.655887 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91f3097-76f1-4909-96d9-1506d35c6106 service cinder] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:38.656252 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91f3097-76f1-4909-96d9-1506d35c6106 service cinder] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:38.656723 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91f3097-76f1-4909-96d9-1506d35c6106 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:38.658612 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd1bf15-2171-4f2b-8df2-0abb44cc7748 service cinder] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:27:38.658824 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-a91f3097-76f1-4909-96d9-1506d35c6106 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:27:38.664930 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe4b0bb-7496-4a09-b42c-7be19ad87888 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:27:38.668576 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe4b0bb-7496-4a09-b42c-7be19ad87888 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:38.669088 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe4b0bb-7496-4a09-b42c-7be19ad87888 admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:38.669682 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe4b0bb-7496-4a09-b42c-7be19ad87888 admin admin] PATH_INFO: `/v3/users/090f06724937434ba307b6985493288a` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:38.673985 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe4b0bb-7496-4a09-b42c-7be19ad87888 admin admin] RBAC: Authorizing `identity:delete_user(user_id=090f06724937434ba307b6985493288a)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:27:38.678939 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe4b0bb-7496-4a09-b42c-7be19ad87888 admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:27:38.725958 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=95,keystone:INSERT=1,keystone:DELETE=4 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:27:38.773408 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-2fe4b0bb-7496-4a09-b42c-7be19ad87888 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '090f06724937434ba307b6985493288a'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:27:38.794104 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-2fe4b0bb-7496-4a09-b42c-7be19ad87888 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '090f06724937434ba307b6985493288a'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:27:38.805735 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-2fe4b0bb-7496-4a09-b42c-7be19ad87888 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '090f06724937434ba307b6985493288a'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:27:38.806672 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-2fe4b0bb-7496-4a09-b42c-7be19ad87888 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '090f06724937434ba307b6985493288a'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:27:38.807454 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-2fe4b0bb-7496-4a09-b42c-7be19ad87888 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '090f06724937434ba307b6985493288a'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:27:38.844710 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91f3097-76f1-4909-96d9-1506d35c6106 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:27:38.846199 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91f3097-76f1-4909-96d9-1506d35c6106 service cinder] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:27:38.846981 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 996/2000] 10.222.0.44 () {58 vars in 1223 bytes} [Thu Jun 16 12:27:38 2022] DELETE /identity/v3/users/090f06724937434ba307b6985493288a => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:27:38.848812 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f20994c-0726-4e4c-8c07-4a04b107b026 None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:38.849110 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f20994c-0726-4e4c-8c07-4a04b107b026 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:38.849423 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f20994c-0726-4e4c-8c07-4a04b107b026 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:38.876854 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1005/2001] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 12:27:38 2022] GET /identity/v3/auth/tokens => generated 3224 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 12:27:38.895198 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-2f20994c-0726-4e4c-8c07-4a04b107b026 None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:27:38.901449 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-2f20994c-0726-4e4c-8c07-4a04b107b026 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:27:39.020908 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 997/2002] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 12:27:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:27:39.218323 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91f3097-76f1-4909-96d9-1506d35c6106 service cinder] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:27:39.220169 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-a91f3097-76f1-4909-96d9-1506d35c6106 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:27:39.288797 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:27:39.328187 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91f3097-76f1-4909-96d9-1506d35c6106 service cinder] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:27:39.421020 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0724ae-1f6b-4bb0-9a21-02d83033dcb7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1094729b25a4be7b0b394998c9ca681', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '601361df39e34fcca71175aa94e425c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:27:39.422263 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0724ae-1f6b-4bb0-9a21-02d83033dcb7 service neutron] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:39.422714 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0724ae-1f6b-4bb0-9a21-02d83033dcb7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:39.423241 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0724ae-1f6b-4bb0-9a21-02d83033dcb7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:39.445518 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0724ae-1f6b-4bb0-9a21-02d83033dcb7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:27:39.448064 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0724ae-1f6b-4bb0-9a21-02d83033dcb7 service neutron] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:27:39.471286 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1006/2003] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 12:27:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 12:27:40.482078 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f20994c-0726-4e4c-8c07-4a04b107b026 None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:27:40.484285 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-2f20994c-0726-4e4c-8c07-4a04b107b026 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:27:40.504396 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f20994c-0726-4e4c-8c07-4a04b107b026 None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:27:40.520702 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8117a6-ae72-4238-b446-e52b17c0f6d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:27:40.521857 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8117a6-ae72-4238-b446-e52b17c0f6d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:40.522227 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8117a6-ae72-4238-b446-e52b17c0f6d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:40.522428 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8117a6-ae72-4238-b446-e52b17c0f6d1 admin admin] PATH_INFO: `/v3/projects/53a1c049d3d540a1b8ae05695d0d0a5f` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:40.524562 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8117a6-ae72-4238-b446-e52b17c0f6d1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=53a1c049d3d540a1b8ae05695d0d0a5f)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:27:40.526520 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8117a6-ae72-4238-b446-e52b17c0f6d1 admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:27:40.621969 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-4c8117a6-ae72-4238-b446-e52b17c0f6d1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '53a1c049d3d540a1b8ae05695d0d0a5f', 'request_id': 'req-4c8117a6-ae72-4238-b446-e52b17c0f6d1'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:27:40.641318 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-4c8117a6-ae72-4238-b446-e52b17c0f6d1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '53a1c049d3d540a1b8ae05695d0d0a5f', 'request_id': 'req-4c8117a6-ae72-4238-b446-e52b17c0f6d1'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:27:40.649317 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-4c8117a6-ae72-4238-b446-e52b17c0f6d1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '53a1c049d3d540a1b8ae05695d0d0a5f', 'request_id': 'req-4c8117a6-ae72-4238-b446-e52b17c0f6d1'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:27:40.665669 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-4c8117a6-ae72-4238-b446-e52b17c0f6d1 admin admin] The token cache is being invalidate because project 53a1c049d3d540a1b8ae05695d0d0a5f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 12:27:40.666077 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-4c8117a6-ae72-4238-b446-e52b17c0f6d1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:27:40.666760 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-4c8117a6-ae72-4238-b446-e52b17c0f6d1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:27:40.668831 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 998/2004] 10.222.0.44 () {58 vars in 1232 bytes} [Thu Jun 16 12:27:40 2022] DELETE /identity/v3/projects/53a1c049d3d540a1b8ae05695d0d0a5f => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:27:40.674132 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9873a5e-1eb2-4120-91da-d98461d051e9 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:40.675359 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9873a5e-1eb2-4120-91da-d98461d051e9 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:40.675786 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9873a5e-1eb2-4120-91da-d98461d051e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:40.708097 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-e9873a5e-1eb2-4120-91da-d98461d051e9 None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:27:40.711484 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-e9873a5e-1eb2-4120-91da-d98461d051e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:27:40.877836 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1007/2005] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 12:27:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:27:40.878681 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9f7cd2-f34a-455c-9a65-ab7a88f07324 None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:40.879556 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9f7cd2-f34a-455c-9a65-ab7a88f07324 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:40.880063 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9f7cd2-f34a-455c-9a65-ab7a88f07324 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:40.912009 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-3d9f7cd2-f34a-455c-9a65-ab7a88f07324 None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:27:40.913687 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-3d9f7cd2-f34a-455c-9a65-ab7a88f07324 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:27:40.945348 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9873a5e-1eb2-4120-91da-d98461d051e9 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:27:40.946826 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 999/2006] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 12:27:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:27:40.958717 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9873a5e-1eb2-4120-91da-d98461d051e9 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:27:40.965931 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167d5e21-3c4e-4da6-b846-a1933ab4c4ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:27:40.966616 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167d5e21-3c4e-4da6-b846-a1933ab4c4ef admin admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:40.966968 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167d5e21-3c4e-4da6-b846-a1933ab4c4ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:40.967254 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167d5e21-3c4e-4da6-b846-a1933ab4c4ef admin admin] PATH_INFO: `/v3/domains` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:40.968003 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167d5e21-3c4e-4da6-b846-a1933ab4c4ef admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:27:40.968300 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167d5e21-3c4e-4da6-b846-a1933ab4c4ef admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:27:40.969963 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167d5e21-3c4e-4da6-b846-a1933ab4c4ef admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:27:40.984805 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1008/2007] 10.222.0.44 () {58 vars in 1152 bytes} [Thu Jun 16 12:27:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:27:40.988657 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9f7cd2-f34a-455c-9a65-ab7a88f07324 None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:27:40.999230 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9f7cd2-f34a-455c-9a65-ab7a88f07324 None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:27:41.017152 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d596e34-fa7c-4bfa-ab3c-dd83c70a90c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:27:41.017966 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d596e34-fa7c-4bfa-ab3c-dd83c70a90c2 admin admin] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:41.018379 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d596e34-fa7c-4bfa-ab3c-dd83c70a90c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:41.018657 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d596e34-fa7c-4bfa-ab3c-dd83c70a90c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:41.019580 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d596e34-fa7c-4bfa-ab3c-dd83c70a90c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:27:41.022487 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d596e34-fa7c-4bfa-ab3c-dd83c70a90c2 admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:27:41.047171 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=84,keystone:DELETE=13,keystone:INSERT=3 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:27:41.065419 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1000/2008] 10.222.0.44 () {60 vars in 1152 bytes} [Thu Jun 16 12:27:40 2022] POST /identity/v3/projects => generated 367 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 12:27:41.070171 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167d5e21-3c4e-4da6-b846-a1933ab4c4ef admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:27:41.082506 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167d5e21-3c4e-4da6-b846-a1933ab4c4ef admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:27:41.163708 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b7409b-df87-4f66-9ed3-bd1c83558531 None None] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:41.164202 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b7409b-df87-4f66-9ed3-bd1c83558531 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:41.164539 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b7409b-df87-4f66-9ed3-bd1c83558531 None None] PATH_INFO: `/` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:41.166972 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1001/2009] 10.222.0.44 () {54 vars in 921 bytes} [Thu Jun 16 12:27:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 12:27:41.177308 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960e3dd5-918c-4fc3-94d3-53ce6d9043f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:27:41.180868 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960e3dd5-918c-4fc3-94d3-53ce6d9043f1 admin admin] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:41.181055 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e933296-09fd-4b3f-97d3-f4228ad6afc3 None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:41.181207 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960e3dd5-918c-4fc3-94d3-53ce6d9043f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:41.181492 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960e3dd5-918c-4fc3-94d3-53ce6d9043f1 admin admin] PATH_INFO: `/v3/users` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:41.181586 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e933296-09fd-4b3f-97d3-f4228ad6afc3 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:41.181951 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e933296-09fd-4b3f-97d3-f4228ad6afc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:41.182212 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960e3dd5-918c-4fc3-94d3-53ce6d9043f1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:27:41.184341 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960e3dd5-918c-4fc3-94d3-53ce6d9043f1 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:27:41.213130 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1009/2010] 10.222.0.44 () {60 vars in 1143 bytes} [Thu Jun 16 12:27:41 2022] POST /identity/v3/users => generated 284 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 12:27:41.214262 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960e3dd5-918c-4fc3-94d3-53ce6d9043f1 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:27:41.216430 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-8e933296-09fd-4b3f-97d3-f4228ad6afc3 None None] MFA Rules not processed for user `edfb12d445e74136b90800e93941f468`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:27:41.220032 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-8e933296-09fd-4b3f-97d3-f4228ad6afc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:27:41.227268 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960e3dd5-918c-4fc3-94d3-53ce6d9043f1 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:27:41.240803 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f1bc3c-f685-44dc-86ed-4bbbbd165469 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:27:41.242502 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f1bc3c-f685-44dc-86ed-4bbbbd165469 admin admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:41.243238 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f1bc3c-f685-44dc-86ed-4bbbbd165469 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:41.243804 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f1bc3c-f685-44dc-86ed-4bbbbd165469 admin admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:41.249269 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f1bc3c-f685-44dc-86ed-4bbbbd165469 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:27:41.249269 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f1bc3c-f685-44dc-86ed-4bbbbd165469 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:27:41.265729 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:27:41.294926 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1010/2011] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 12:27:41 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 12:27:41.298817 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f1bc3c-f685-44dc-86ed-4bbbbd165469 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:27:41.323876 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f1bc3c-f685-44dc-86ed-4bbbbd165469 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:27:41.331231 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f69fcd-e8dc-4608-9d43-408908af595f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:27:41.332179 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f69fcd-e8dc-4608-9d43-408908af595f admin admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:41.333157 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f69fcd-e8dc-4608-9d43-408908af595f admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:41.333875 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f69fcd-e8dc-4608-9d43-408908af595f admin admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:41.335509 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f69fcd-e8dc-4608-9d43-408908af595f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:27:41.338863 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f69fcd-e8dc-4608-9d43-408908af595f admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:27:41.359720 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1011/2012] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 12:27:41 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 12:27:41.360706 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f69fcd-e8dc-4608-9d43-408908af595f admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:27:41.374272 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f69fcd-e8dc-4608-9d43-408908af595f admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:27:41.381212 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708625d5-58b1-47a7-804d-f0483423128e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:27:41.382968 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708625d5-58b1-47a7-804d-f0483423128e admin admin] REQUEST_METHOD: `PUT` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:41.383484 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708625d5-58b1-47a7-804d-f0483423128e admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:41.383873 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708625d5-58b1-47a7-804d-f0483423128e admin admin] PATH_INFO: `/v3/projects/0bd76d02107648569df494c8d9ee2fc7/users/ee47d81e557a45de98c74f692a0eac95/roles/c39882b202e942479a7cdac2fc6da72c` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:41.386515 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1002/2013] 10.222.0.44 () {58 vars in 1018 bytes} [Thu Jun 16 12:27:41 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:27:41.400323 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e933296-09fd-4b3f-97d3-f4228ad6afc3 None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:27:41.402579 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-8e933296-09fd-4b3f-97d3-f4228ad6afc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:27:41.415559 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708625d5-58b1-47a7-804d-f0483423128e admin admin] RBAC: Authorizing `identity:create_grant(project_id=0bd76d02107648569df494c8d9ee2fc7, user_id=ee47d81e557a45de98c74f692a0eac95, role_id=c39882b202e942479a7cdac2fc6da72c)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:27:41.417612 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e933296-09fd-4b3f-97d3-f4228ad6afc3 None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:27:41.418462 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708625d5-58b1-47a7-804d-f0483423128e admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:27:41.424984 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a34ccf9-fde2-45fe-9215-a46237675718 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edfb12d445e74136b90800e93941f468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '601361df39e34fcca71175aa94e425c4', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:27:41.426031 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a34ccf9-fde2-45fe-9215-a46237675718 service nova] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:41.426393 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a34ccf9-fde2-45fe-9215-a46237675718 service nova] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:41.426764 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a34ccf9-fde2-45fe-9215-a46237675718 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:41.433989 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1012/2014] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 16 12:27:41 2022] PUT /identity/v3/projects/0bd76d02107648569df494c8d9ee2fc7/users/ee47d81e557a45de98c74f692a0eac95/roles/c39882b202e942479a7cdac2fc6da72c => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:27:41.445468 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59e2379-d5f9-4799-9ceb-f062c6f6484a None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:41.446451 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59e2379-d5f9-4799-9ceb-f062c6f6484a None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:41.447131 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59e2379-d5f9-4799-9ceb-f062c6f6484a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:41.447414 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a34ccf9-fde2-45fe-9215-a46237675718 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:27:41.449246 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a34ccf9-fde2-45fe-9215-a46237675718 service nova] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:27:41.468655 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1003/2015] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 12:27:41 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 12:27:41.488143 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-a59e2379-d5f9-4799-9ceb-f062c6f6484a None None] MFA Rules not processed for user `ee47d81e557a45de98c74f692a0eac95`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:27:41.489777 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-a59e2379-d5f9-4799-9ceb-f062c6f6484a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:27:41.587166 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1013/2016] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 12:27:41 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:27:41.598347 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a34ccf9-fde2-45fe-9215-a46237675718 service nova] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:27:41.600884 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-7a34ccf9-fde2-45fe-9215-a46237675718 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:27:41.666968 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a34ccf9-fde2-45fe-9215-a46237675718 service nova] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:27:41.741155 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea49271b-84e9-483c-8db2-7487c37f800e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42dedbccc64747d581c862a69ae20941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '601361df39e34fcca71175aa94e425c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:27:41.742009 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea49271b-84e9-483c-8db2-7487c37f800e service glance] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:41.742605 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea49271b-84e9-483c-8db2-7487c37f800e service glance] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:41.742988 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea49271b-84e9-483c-8db2-7487c37f800e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:41.757679 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea49271b-84e9-483c-8db2-7487c37f800e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:27:41.760197 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea49271b-84e9-483c-8db2-7487c37f800e service glance] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:27:41.773874 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1004/2017] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 12:27:41 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 12:27:43.424931 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59e2379-d5f9-4799-9ceb-f062c6f6484a None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:27:43.426927 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-a59e2379-d5f9-4799-9ceb-f062c6f6484a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:27:43.492996 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59e2379-d5f9-4799-9ceb-f062c6f6484a None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:27:43.498650 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cdd572-6f59-4da2-8321-8d33cf81220b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:27:43.499683 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cdd572-6f59-4da2-8321-8d33cf81220b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:43.499969 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cdd572-6f59-4da2-8321-8d33cf81220b admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:43.505980 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cdd572-6f59-4da2-8321-8d33cf81220b admin admin] PATH_INFO: `/v3/users/31dfe17024a34ea59568c8742f39c992` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:43.507493 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cdd572-6f59-4da2-8321-8d33cf81220b admin admin] RBAC: Authorizing `identity:delete_user(user_id=31dfe17024a34ea59568c8742f39c992)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:27:43.511197 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cdd572-6f59-4da2-8321-8d33cf81220b admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:27:43.575890 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-e6cdd572-6f59-4da2-8321-8d33cf81220b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '31dfe17024a34ea59568c8742f39c992'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:27:43.576769 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-e6cdd572-6f59-4da2-8321-8d33cf81220b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '31dfe17024a34ea59568c8742f39c992'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:27:43.582121 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=92,keystone:INSERT=1,keystone:DELETE=7 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:27:43.586272 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-e6cdd572-6f59-4da2-8321-8d33cf81220b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '31dfe17024a34ea59568c8742f39c992'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:27:43.587031 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-e6cdd572-6f59-4da2-8321-8d33cf81220b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '31dfe17024a34ea59568c8742f39c992'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:27:43.603001 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-e6cdd572-6f59-4da2-8321-8d33cf81220b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '31dfe17024a34ea59568c8742f39c992'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:27:43.631958 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1014/2018] 10.222.0.44 () {58 vars in 1223 bytes} [Thu Jun 16 12:27:43 2022] DELETE /identity/v3/users/31dfe17024a34ea59568c8742f39c992 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:27:43.645739 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc0137c-2619-4003-a044-3c3188ffebf7 None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:43.646273 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc0137c-2619-4003-a044-3c3188ffebf7 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:43.646463 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc0137c-2619-4003-a044-3c3188ffebf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:43.695244 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-fbc0137c-2619-4003-a044-3c3188ffebf7 None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:27:43.697081 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-fbc0137c-2619-4003-a044-3c3188ffebf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:27:43.742388 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:27:43.794707 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1005/2019] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 12:27:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:27:43.805075 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cdd572-6f59-4da2-8321-8d33cf81220b admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:27:43.806651 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-e6cdd572-6f59-4da2-8321-8d33cf81220b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:27:43.889581 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cdd572-6f59-4da2-8321-8d33cf81220b admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:27:43.893493 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4de71ea-847b-42bf-b5a5-b2b4f043fc21 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1094729b25a4be7b0b394998c9ca681', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '601361df39e34fcca71175aa94e425c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:27:43.894217 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4de71ea-847b-42bf-b5a5-b2b4f043fc21 service neutron] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:43.894500 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4de71ea-847b-42bf-b5a5-b2b4f043fc21 service neutron] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:43.894778 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4de71ea-847b-42bf-b5a5-b2b4f043fc21 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:43.905707 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4de71ea-847b-42bf-b5a5-b2b4f043fc21 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:27:43.907221 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4de71ea-847b-42bf-b5a5-b2b4f043fc21 service neutron] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:27:43.922812 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1015/2020] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 12:27:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 12:27:44.291471 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc0137c-2619-4003-a044-3c3188ffebf7 None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:27:44.293493 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-fbc0137c-2619-4003-a044-3c3188ffebf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:27:44.308260 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc0137c-2619-4003-a044-3c3188ffebf7 None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:27:44.314130 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31eb457f-3229-48d2-821f-41a453452ea6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:27:44.315910 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31eb457f-3229-48d2-821f-41a453452ea6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:44.316381 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31eb457f-3229-48d2-821f-41a453452ea6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:44.317055 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31eb457f-3229-48d2-821f-41a453452ea6 admin admin] PATH_INFO: `/v3/projects/9649261fe98c4121bc3c1be26923450c` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:44.319472 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31eb457f-3229-48d2-821f-41a453452ea6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9649261fe98c4121bc3c1be26923450c)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:27:44.322981 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31eb457f-3229-48d2-821f-41a453452ea6 admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:27:44.396977 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-31eb457f-3229-48d2-821f-41a453452ea6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9649261fe98c4121bc3c1be26923450c', 'request_id': 'req-31eb457f-3229-48d2-821f-41a453452ea6'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:27:44.414937 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-31eb457f-3229-48d2-821f-41a453452ea6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9649261fe98c4121bc3c1be26923450c', 'request_id': 'req-31eb457f-3229-48d2-821f-41a453452ea6'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:27:44.426593 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-31eb457f-3229-48d2-821f-41a453452ea6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9649261fe98c4121bc3c1be26923450c', 'request_id': 'req-31eb457f-3229-48d2-821f-41a453452ea6'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:27:44.445237 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-31eb457f-3229-48d2-821f-41a453452ea6 admin admin] The token cache is being invalidate because project 9649261fe98c4121bc3c1be26923450c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 12:27:44.445592 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-31eb457f-3229-48d2-821f-41a453452ea6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:27:44.446840 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-31eb457f-3229-48d2-821f-41a453452ea6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:27:44.453375 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1006/2021] 10.222.0.44 () {58 vars in 1232 bytes} [Thu Jun 16 12:27:44 2022] DELETE /identity/v3/projects/9649261fe98c4121bc3c1be26923450c => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:27:44.456287 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4de71ea-847b-42bf-b5a5-b2b4f043fc21 service neutron] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:27:44.478319 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4de71ea-847b-42bf-b5a5-b2b4f043fc21 service neutron] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:27:44.564787 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdd7799-5ee3-4cea-88a9-8534431c39a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:27:44.565997 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdd7799-5ee3-4cea-88a9-8534431c39a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:44.566479 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdd7799-5ee3-4cea-88a9-8534431c39a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:44.566940 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdd7799-5ee3-4cea-88a9-8534431c39a9 admin admin] PATH_INFO: `/v3/users/078fb1c01f884c26b6bda3636c085a59` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:44.569309 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdd7799-5ee3-4cea-88a9-8534431c39a9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=078fb1c01f884c26b6bda3636c085a59)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:27:44.573447 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdd7799-5ee3-4cea-88a9-8534431c39a9 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:27:44.693947 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-ffdd7799-5ee3-4cea-88a9-8534431c39a9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '078fb1c01f884c26b6bda3636c085a59'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:27:44.695771 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-ffdd7799-5ee3-4cea-88a9-8534431c39a9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '078fb1c01f884c26b6bda3636c085a59'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:27:44.708331 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-ffdd7799-5ee3-4cea-88a9-8534431c39a9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '078fb1c01f884c26b6bda3636c085a59'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:27:44.709778 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-ffdd7799-5ee3-4cea-88a9-8534431c39a9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '078fb1c01f884c26b6bda3636c085a59'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:27:44.722910 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-ffdd7799-5ee3-4cea-88a9-8534431c39a9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '078fb1c01f884c26b6bda3636c085a59'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:27:44.736171 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=86,keystone:INSERT=2,keystone:DELETE=12 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:27:44.760343 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1016/2022] 10.222.0.44 () {58 vars in 1223 bytes} [Thu Jun 16 12:27:44 2022] DELETE /identity/v3/users/078fb1c01f884c26b6bda3636c085a59 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 12:27:45.159309 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31eb457f-3229-48d2-821f-41a453452ea6 admin admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:27:45.161378 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-31eb457f-3229-48d2-821f-41a453452ea6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:27:45.198175 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31eb457f-3229-48d2-821f-41a453452ea6 admin admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:27:45.268166 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08954890-474c-474b-8a1c-e817b8e0c001 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:27:45.269415 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08954890-474c-474b-8a1c-e817b8e0c001 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:45.269841 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08954890-474c-474b-8a1c-e817b8e0c001 admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:45.270411 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08954890-474c-474b-8a1c-e817b8e0c001 admin admin] PATH_INFO: `/v3/projects/44c6644fb5a24533a93f1e40d5205dc2` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:45.271849 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08954890-474c-474b-8a1c-e817b8e0c001 admin admin] RBAC: Authorizing `identity:delete_project(project_id=44c6644fb5a24533a93f1e40d5205dc2)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:27:45.273912 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08954890-474c-474b-8a1c-e817b8e0c001 admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:27:45.336778 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-08954890-474c-474b-8a1c-e817b8e0c001 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '44c6644fb5a24533a93f1e40d5205dc2', 'request_id': 'req-08954890-474c-474b-8a1c-e817b8e0c001'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:27:45.344665 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-08954890-474c-474b-8a1c-e817b8e0c001 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '44c6644fb5a24533a93f1e40d5205dc2', 'request_id': 'req-08954890-474c-474b-8a1c-e817b8e0c001'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:27:45.346696 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:27:45.352792 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-08954890-474c-474b-8a1c-e817b8e0c001 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '44c6644fb5a24533a93f1e40d5205dc2', 'request_id': 'req-08954890-474c-474b-8a1c-e817b8e0c001'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:27:45.366534 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-08954890-474c-474b-8a1c-e817b8e0c001 admin admin] The token cache is being invalidate because project 44c6644fb5a24533a93f1e40d5205dc2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 12:27:45.366814 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-08954890-474c-474b-8a1c-e817b8e0c001 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:27:45.367487 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-08954890-474c-474b-8a1c-e817b8e0c001 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:27:45.372841 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1007/2023] 10.222.0.44 () {58 vars in 1232 bytes} [Thu Jun 16 12:27:45 2022] DELETE /identity/v3/projects/44c6644fb5a24533a93f1e40d5205dc2 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:27:45.376983 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2efe82a-5950-42f0-b6e4-2614d64fa52b None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:45.377771 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2efe82a-5950-42f0-b6e4-2614d64fa52b None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:45.378424 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2efe82a-5950-42f0-b6e4-2614d64fa52b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:45.400484 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-f2efe82a-5950-42f0-b6e4-2614d64fa52b None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:27:45.401833 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-f2efe82a-5950-42f0-b6e4-2614d64fa52b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:27:45.462237 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1017/2024] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 12:27:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:27:45.469891 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60b6a6a-1202-4cf6-b0ff-93e96c3f1540 None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:45.470409 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60b6a6a-1202-4cf6-b0ff-93e96c3f1540 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:45.470876 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60b6a6a-1202-4cf6-b0ff-93e96c3f1540 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:45.514072 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-c60b6a6a-1202-4cf6-b0ff-93e96c3f1540 None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:27:45.515583 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-c60b6a6a-1202-4cf6-b0ff-93e96c3f1540 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:27:45.533825 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1008/2025] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 12:27:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:27:45.538965 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2efe82a-5950-42f0-b6e4-2614d64fa52b None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:27:45.550876 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2efe82a-5950-42f0-b6e4-2614d64fa52b None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:27:45.585728 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c106b2-0cfa-4b4b-9d09-0e3b4c069cbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:27:45.590045 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c106b2-0cfa-4b4b-9d09-0e3b4c069cbf admin admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:45.590514 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c106b2-0cfa-4b4b-9d09-0e3b4c069cbf admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:45.590891 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c106b2-0cfa-4b4b-9d09-0e3b4c069cbf admin admin] PATH_INFO: `/v3/domains` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:45.591828 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c106b2-0cfa-4b4b-9d09-0e3b4c069cbf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:27:45.593294 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c106b2-0cfa-4b4b-9d09-0e3b4c069cbf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:27:45.595509 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c106b2-0cfa-4b4b-9d09-0e3b4c069cbf admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:27:45.616835 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1018/2026] 10.222.0.44 () {58 vars in 1152 bytes} [Thu Jun 16 12:27:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:27:45.621846 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60b6a6a-1202-4cf6-b0ff-93e96c3f1540 None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:27:45.638573 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60b6a6a-1202-4cf6-b0ff-93e96c3f1540 None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:27:45.655661 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a10f31-855c-4d27-b8fa-de7a5c9526dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:27:45.656291 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a10f31-855c-4d27-b8fa-de7a5c9526dd admin admin] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:45.656906 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a10f31-855c-4d27-b8fa-de7a5c9526dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:45.657186 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a10f31-855c-4d27-b8fa-de7a5c9526dd admin admin] PATH_INFO: `/v3/projects` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:45.657914 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a10f31-855c-4d27-b8fa-de7a5c9526dd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:27:45.668242 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a10f31-855c-4d27-b8fa-de7a5c9526dd admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:27:45.724129 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1009/2027] 10.222.0.44 () {60 vars in 1152 bytes} [Thu Jun 16 12:27:45 2022] POST /identity/v3/projects => generated 375 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 12:27:45.730259 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c106b2-0cfa-4b4b-9d09-0e3b4c069cbf admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:27:45.751862 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c106b2-0cfa-4b4b-9d09-0e3b4c069cbf admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:27:45.854061 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e016b71-e46b-4d5a-901a-277e5006430e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:27:45.854743 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e016b71-e46b-4d5a-901a-277e5006430e admin admin] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:45.855078 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e016b71-e46b-4d5a-901a-277e5006430e admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:45.855359 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e016b71-e46b-4d5a-901a-277e5006430e admin admin] PATH_INFO: `/v3/users` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:45.856072 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e016b71-e46b-4d5a-901a-277e5006430e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:27:45.858216 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e016b71-e46b-4d5a-901a-277e5006430e admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:27:45.885402 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1019/2028] 10.222.0.44 () {60 vars in 1143 bytes} [Thu Jun 16 12:27:45 2022] POST /identity/v3/users => generated 288 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 12:27:45.886310 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a10f31-855c-4d27-b8fa-de7a5c9526dd admin admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:27:45.901718 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a10f31-855c-4d27-b8fa-de7a5c9526dd admin admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:27:45.907600 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d780bf96-e101-4dac-99df-82165dee91cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:27:45.908205 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d780bf96-e101-4dac-99df-82165dee91cf admin admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:45.908489 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d780bf96-e101-4dac-99df-82165dee91cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:45.908848 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d780bf96-e101-4dac-99df-82165dee91cf admin admin] PATH_INFO: `/v3/roles` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:45.909955 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d780bf96-e101-4dac-99df-82165dee91cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:27:45.912611 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d780bf96-e101-4dac-99df-82165dee91cf admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:27:45.945742 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1010/2029] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 12:27:45 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 12:27:45.955259 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e016b71-e46b-4d5a-901a-277e5006430e admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:27:45.966517 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e016b71-e46b-4d5a-901a-277e5006430e admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:27:45.971825 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351ba876-546f-4ee3-a67a-185f3b2ebb78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:27:45.972588 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351ba876-546f-4ee3-a67a-185f3b2ebb78 admin admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:45.973026 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351ba876-546f-4ee3-a67a-185f3b2ebb78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:45.974601 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351ba876-546f-4ee3-a67a-185f3b2ebb78 admin admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:45.975479 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351ba876-546f-4ee3-a67a-185f3b2ebb78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:27:45.977416 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351ba876-546f-4ee3-a67a-185f3b2ebb78 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:27:45.992270 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1020/2030] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 12:27:45 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 12:27:45.997799 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d780bf96-e101-4dac-99df-82165dee91cf admin admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:27:46.013493 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d780bf96-e101-4dac-99df-82165dee91cf admin admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:27:46.018719 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6026a6a0-6db1-4a09-8ef1-7b973e0b73fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:27:46.019785 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6026a6a0-6db1-4a09-8ef1-7b973e0b73fa admin admin] REQUEST_METHOD: `PUT` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:46.019923 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6026a6a0-6db1-4a09-8ef1-7b973e0b73fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:46.020154 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6026a6a0-6db1-4a09-8ef1-7b973e0b73fa admin admin] PATH_INFO: `/v3/projects/435868f180cf4df39d4781f47fb6537e/users/2eab41a3d7624cb6b9f64fa0cfc61a15/roles/c39882b202e942479a7cdac2fc6da72c` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:46.042164 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6026a6a0-6db1-4a09-8ef1-7b973e0b73fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=435868f180cf4df39d4781f47fb6537e, user_id=2eab41a3d7624cb6b9f64fa0cfc61a15, role_id=c39882b202e942479a7cdac2fc6da72c)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:27:46.045649 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6026a6a0-6db1-4a09-8ef1-7b973e0b73fa admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:27:46.064802 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1011/2031] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 16 12:27:45 2022] PUT /identity/v3/projects/435868f180cf4df39d4781f47fb6537e/users/2eab41a3d7624cb6b9f64fa0cfc61a15/roles/c39882b202e942479a7cdac2fc6da72c => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:27:46.073043 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3307d9b5-1e88-44cc-9cab-c5dcd8726669 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:46.073330 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3307d9b5-1e88-44cc-9cab-c5dcd8726669 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:46.073607 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3307d9b5-1e88-44cc-9cab-c5dcd8726669 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:46.158140 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-3307d9b5-1e88-44cc-9cab-c5dcd8726669 None None] MFA Rules not processed for user `2eab41a3d7624cb6b9f64fa0cfc61a15`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:27:46.159863 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-3307d9b5-1e88-44cc-9cab-c5dcd8726669 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:27:46.225150 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:27:46.302926 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6026a6a0-6db1-4a09-8ef1-7b973e0b73fa admin admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:27:46.306236 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-6026a6a0-6db1-4a09-8ef1-7b973e0b73fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:27:46.307952 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1021/2032] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 12:27:46 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:27:46.444108 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6026a6a0-6db1-4a09-8ef1-7b973e0b73fa admin admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:27:46.448645 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c700a6c-6afe-4276-a305-571892217fad service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42dedbccc64747d581c862a69ae20941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '601361df39e34fcca71175aa94e425c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:27:46.449640 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c700a6c-6afe-4276-a305-571892217fad service glance] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:46.450115 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c700a6c-6afe-4276-a305-571892217fad service glance] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:46.450727 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c700a6c-6afe-4276-a305-571892217fad service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:46.462579 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c700a6c-6afe-4276-a305-571892217fad service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:27:46.464575 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c700a6c-6afe-4276-a305-571892217fad service glance] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:27:46.480890 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1012/2033] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 12:27:46 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 12:27:47.351088 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebab8344-ea11-4175-aeda-75b6f7cc56a3 None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:47.351767 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebab8344-ea11-4175-aeda-75b6f7cc56a3 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:47.351767 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebab8344-ea11-4175-aeda-75b6f7cc56a3 None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:47.353381 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1022/2034] 10.222.0.44 () {54 vars in 921 bytes} [Thu Jun 16 12:27:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 12:27:47.398020 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9b2581-1613-49ff-84aa-b7b9668da808 None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:47.398619 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9b2581-1613-49ff-84aa-b7b9668da808 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:47.398619 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9b2581-1613-49ff-84aa-b7b9668da808 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:47.428492 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-af9b2581-1613-49ff-84aa-b7b9668da808 None None] MFA Rules not processed for user `8bff8ccf460a403d993c39327bbcbd29`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:27:47.430140 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-af9b2581-1613-49ff-84aa-b7b9668da808 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:27:47.438583 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebab8344-ea11-4175-aeda-75b6f7cc56a3 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:27:47.441024 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-ebab8344-ea11-4175-aeda-75b6f7cc56a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:27:47.528611 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1013/2035] 10.222.0.44 () {58 vars in 1018 bytes} [Thu Jun 16 12:27:47 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:27:47.529582 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9b2581-1613-49ff-84aa-b7b9668da808 None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:27:47.530906 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-af9b2581-1613-49ff-84aa-b7b9668da808 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:27:47.549455 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebab8344-ea11-4175-aeda-75b6f7cc56a3 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:27:47.552896 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9b2581-1613-49ff-84aa-b7b9668da808 None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:27:47.556908 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206d060c-c478-45af-969e-cd308efe57b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:27:47.557802 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206d060c-c478-45af-969e-cd308efe57b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:47.557924 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737b3c4f-8525-4951-b73c-73f89f5c315e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:27:47.558089 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206d060c-c478-45af-969e-cd308efe57b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:47.558479 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206d060c-c478-45af-969e-cd308efe57b4 admin admin] PATH_INFO: `/v3/users/b400def2aca54d778c47e75c41658d81` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:47.558990 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737b3c4f-8525-4951-b73c-73f89f5c315e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:47.559239 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737b3c4f-8525-4951-b73c-73f89f5c315e admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:47.559707 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206d060c-c478-45af-969e-cd308efe57b4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b400def2aca54d778c47e75c41658d81)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:27:47.559898 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737b3c4f-8525-4951-b73c-73f89f5c315e admin admin] PATH_INFO: `/v3/users/799308ced5f04bbba8e5e19cdd6acb1b` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:47.561297 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737b3c4f-8525-4951-b73c-73f89f5c315e admin admin] RBAC: Authorizing `identity:delete_user(user_id=799308ced5f04bbba8e5e19cdd6acb1b)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:27:47.561669 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206d060c-c478-45af-969e-cd308efe57b4 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:27:47.563337 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737b3c4f-8525-4951-b73c-73f89f5c315e admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:27:47.581863 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:27:47.624999 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-206d060c-c478-45af-969e-cd308efe57b4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b400def2aca54d778c47e75c41658d81'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:27:47.625959 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-206d060c-c478-45af-969e-cd308efe57b4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b400def2aca54d778c47e75c41658d81'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:27:47.628171 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-737b3c4f-8525-4951-b73c-73f89f5c315e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '799308ced5f04bbba8e5e19cdd6acb1b'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:27:47.636698 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-206d060c-c478-45af-969e-cd308efe57b4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b400def2aca54d778c47e75c41658d81'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:27:47.637460 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-206d060c-c478-45af-969e-cd308efe57b4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b400def2aca54d778c47e75c41658d81'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:27:47.641012 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-737b3c4f-8525-4951-b73c-73f89f5c315e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '799308ced5f04bbba8e5e19cdd6acb1b'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:27:47.653660 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-737b3c4f-8525-4951-b73c-73f89f5c315e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '799308ced5f04bbba8e5e19cdd6acb1b'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:27:47.653837 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-206d060c-c478-45af-969e-cd308efe57b4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b400def2aca54d778c47e75c41658d81'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:27:47.655300 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-737b3c4f-8525-4951-b73c-73f89f5c315e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '799308ced5f04bbba8e5e19cdd6acb1b'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:27:47.656333 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-737b3c4f-8525-4951-b73c-73f89f5c315e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '799308ced5f04bbba8e5e19cdd6acb1b'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:27:47.674001 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1014/2036] 10.222.0.44 () {58 vars in 1223 bytes} [Thu Jun 16 12:27:47 2022] DELETE /identity/v3/users/799308ced5f04bbba8e5e19cdd6acb1b => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:27:47.675235 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737b3c4f-8525-4951-b73c-73f89f5c315e admin admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:27:47.676943 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-737b3c4f-8525-4951-b73c-73f89f5c315e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:27:47.683704 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1023/2037] 10.222.0.44 () {58 vars in 1223 bytes} [Thu Jun 16 12:27:47 2022] DELETE /identity/v3/users/b400def2aca54d778c47e75c41658d81 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 12:27:47.688469 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1ca75d-0fa9-4c56-b8fb-b38473086669 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:47.688787 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1ca75d-0fa9-4c56-b8fb-b38473086669 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:47.689069 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1ca75d-0fa9-4c56-b8fb-b38473086669 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:47.709166 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-fa1ca75d-0fa9-4c56-b8fb-b38473086669 None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:27:47.710514 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-fa1ca75d-0fa9-4c56-b8fb-b38473086669 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:27:47.761920 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737b3c4f-8525-4951-b73c-73f89f5c315e admin admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:27:47.804616 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1024/2038] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 12:27:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 12:27:47.818605 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1ca75d-0fa9-4c56-b8fb-b38473086669 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:27:47.820660 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-fa1ca75d-0fa9-4c56-b8fb-b38473086669 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:27:47.832617 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:27:47.866222 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4037d838-2f72-4a03-a41d-56c907855e7f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8bff8ccf460a403d993c39327bbcbd29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '601361df39e34fcca71175aa94e425c4', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:27:47.867871 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4037d838-2f72-4a03-a41d-56c907855e7f service placement] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:47.868441 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4037d838-2f72-4a03-a41d-56c907855e7f service placement] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:47.869176 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4037d838-2f72-4a03-a41d-56c907855e7f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:47.871549 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-4037d838-2f72-4a03-a41d-56c907855e7f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:27:47.885794 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4037d838-2f72-4a03-a41d-56c907855e7f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:27:47.888108 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4037d838-2f72-4a03-a41d-56c907855e7f service placement] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:27:47.904969 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1015/2039] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 12:27:47 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 12:27:47.910761 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1ca75d-0fa9-4c56-b8fb-b38473086669 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:27:47.914828 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99c4654-d20d-4286-99b1-8eda53665343 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1094729b25a4be7b0b394998c9ca681', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '601361df39e34fcca71175aa94e425c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:27:47.915563 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99c4654-d20d-4286-99b1-8eda53665343 service neutron] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:47.915933 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99c4654-d20d-4286-99b1-8eda53665343 service neutron] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:47.916276 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99c4654-d20d-4286-99b1-8eda53665343 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:47.937377 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99c4654-d20d-4286-99b1-8eda53665343 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:27:47.941268 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99c4654-d20d-4286-99b1-8eda53665343 service neutron] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:27:47.951904 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4037d838-2f72-4a03-a41d-56c907855e7f service placement] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:27:47.953596 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-4037d838-2f72-4a03-a41d-56c907855e7f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:27:47.955573 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1025/2040] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 12:27:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 12:27:47.967887 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4037d838-2f72-4a03-a41d-56c907855e7f service placement] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:27:47.973599 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccab8a5-dab3-441c-a197-16290a6e20b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:27:47.974528 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccab8a5-dab3-441c-a197-16290a6e20b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:47.974812 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccab8a5-dab3-441c-a197-16290a6e20b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:47.975090 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccab8a5-dab3-441c-a197-16290a6e20b9 admin admin] PATH_INFO: `/v3/projects/f3f87f9a4f134a96b8d94f8bda417f83` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:47.976730 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccab8a5-dab3-441c-a197-16290a6e20b9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f3f87f9a4f134a96b8d94f8bda417f83)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:27:47.978941 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccab8a5-dab3-441c-a197-16290a6e20b9 admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:27:48.037784 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:27:48.066991 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-dccab8a5-dab3-441c-a197-16290a6e20b9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f3f87f9a4f134a96b8d94f8bda417f83', 'request_id': 'req-dccab8a5-dab3-441c-a197-16290a6e20b9'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:27:48.077584 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-dccab8a5-dab3-441c-a197-16290a6e20b9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f3f87f9a4f134a96b8d94f8bda417f83', 'request_id': 'req-dccab8a5-dab3-441c-a197-16290a6e20b9'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:27:48.090937 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-dccab8a5-dab3-441c-a197-16290a6e20b9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f3f87f9a4f134a96b8d94f8bda417f83', 'request_id': 'req-dccab8a5-dab3-441c-a197-16290a6e20b9'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:27:48.104315 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-dccab8a5-dab3-441c-a197-16290a6e20b9 admin admin] The token cache is being invalidate because project f3f87f9a4f134a96b8d94f8bda417f83 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 12:27:48.104607 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-dccab8a5-dab3-441c-a197-16290a6e20b9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:27:48.106903 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-dccab8a5-dab3-441c-a197-16290a6e20b9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:27:48.108786 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1016/2041] 10.222.0.44 () {58 vars in 1232 bytes} [Thu Jun 16 12:27:47 2022] DELETE /identity/v3/projects/f3f87f9a4f134a96b8d94f8bda417f83 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 12:27:48.118798 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc905c04-47ba-4ff4-a29f-7dfa45f71c17 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:48.119087 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc905c04-47ba-4ff4-a29f-7dfa45f71c17 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:48.119383 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc905c04-47ba-4ff4-a29f-7dfa45f71c17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:48.142899 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-fc905c04-47ba-4ff4-a29f-7dfa45f71c17 None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:27:48.144929 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-fc905c04-47ba-4ff4-a29f-7dfa45f71c17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:27:48.242303 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1026/2042] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 12:27:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:27:48.250488 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a92a1c-d72c-4931-8ba2-90eb9dea746d None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:48.250779 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a92a1c-d72c-4931-8ba2-90eb9dea746d None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:48.251056 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a92a1c-d72c-4931-8ba2-90eb9dea746d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:48.278725 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-24a92a1c-d72c-4931-8ba2-90eb9dea746d None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:27:48.280324 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-24a92a1c-d72c-4931-8ba2-90eb9dea746d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:27:48.296954 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1017/2043] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 12:27:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:27:48.298611 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc905c04-47ba-4ff4-a29f-7dfa45f71c17 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:27:48.313812 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc905c04-47ba-4ff4-a29f-7dfa45f71c17 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:27:48.319510 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79527437-2a72-400d-87d5-644971cf7687 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:27:48.320494 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79527437-2a72-400d-87d5-644971cf7687 admin admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:48.320991 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79527437-2a72-400d-87d5-644971cf7687 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:48.321307 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79527437-2a72-400d-87d5-644971cf7687 admin admin] PATH_INFO: `/v3/domains` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:48.322144 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79527437-2a72-400d-87d5-644971cf7687 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:27:48.322451 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79527437-2a72-400d-87d5-644971cf7687 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:27:48.324839 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79527437-2a72-400d-87d5-644971cf7687 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:27:48.341648 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1027/2044] 10.222.0.44 () {58 vars in 1152 bytes} [Thu Jun 16 12:27:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:27:48.346498 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a92a1c-d72c-4931-8ba2-90eb9dea746d None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:27:48.347019 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79527437-2a72-400d-87d5-644971cf7687 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:27:48.349824 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-79527437-2a72-400d-87d5-644971cf7687 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:27:48.362478 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a92a1c-d72c-4931-8ba2-90eb9dea746d None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:27:48.369183 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233d6529-417a-4ea8-80e1-f997cd767106 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:27:48.370465 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233d6529-417a-4ea8-80e1-f997cd767106 admin admin] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:48.370978 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233d6529-417a-4ea8-80e1-f997cd767106 admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:48.371259 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233d6529-417a-4ea8-80e1-f997cd767106 admin admin] PATH_INFO: `/v3/projects` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:48.372092 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233d6529-417a-4ea8-80e1-f997cd767106 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:27:48.374441 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233d6529-417a-4ea8-80e1-f997cd767106 admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:27:48.400344 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79527437-2a72-400d-87d5-644971cf7687 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:27:48.408804 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04aaefd-d2a0-4c57-b697-c40e4f83cbc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:27:48.410758 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04aaefd-d2a0-4c57-b697-c40e4f83cbc7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:48.411041 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04aaefd-d2a0-4c57-b697-c40e4f83cbc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:48.411845 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04aaefd-d2a0-4c57-b697-c40e4f83cbc7 admin admin] PATH_INFO: `/v3/projects/0439bc6f811c45ee9c99149b94dfc45a` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:48.413553 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04aaefd-d2a0-4c57-b697-c40e4f83cbc7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0439bc6f811c45ee9c99149b94dfc45a)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:27:48.415510 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04aaefd-d2a0-4c57-b697-c40e4f83cbc7 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:27:48.416291 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1018/2045] 10.222.0.44 () {60 vars in 1152 bytes} [Thu Jun 16 12:27:48 2022] POST /identity/v3/projects => generated 373 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 12:27:48.420409 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233d6529-417a-4ea8-80e1-f997cd767106 admin admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:27:48.477072 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-f04aaefd-d2a0-4c57-b697-c40e4f83cbc7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0439bc6f811c45ee9c99149b94dfc45a', 'request_id': 'req-f04aaefd-d2a0-4c57-b697-c40e4f83cbc7'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:27:48.490767 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-f04aaefd-d2a0-4c57-b697-c40e4f83cbc7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0439bc6f811c45ee9c99149b94dfc45a', 'request_id': 'req-f04aaefd-d2a0-4c57-b697-c40e4f83cbc7'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:27:48.497836 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-f04aaefd-d2a0-4c57-b697-c40e4f83cbc7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0439bc6f811c45ee9c99149b94dfc45a', 'request_id': 'req-f04aaefd-d2a0-4c57-b697-c40e4f83cbc7'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:27:48.510680 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233d6529-417a-4ea8-80e1-f997cd767106 admin admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:27:48.517319 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-f04aaefd-d2a0-4c57-b697-c40e4f83cbc7 admin admin] The token cache is being invalidate because project 0439bc6f811c45ee9c99149b94dfc45a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 12:27:48.517426 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-f04aaefd-d2a0-4c57-b697-c40e4f83cbc7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:27:48.518325 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-f04aaefd-d2a0-4c57-b697-c40e4f83cbc7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:27:48.524112 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1028/2046] 10.222.0.44 () {58 vars in 1232 bytes} [Thu Jun 16 12:27:48 2022] DELETE /identity/v3/projects/0439bc6f811c45ee9c99149b94dfc45a => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:27:48.525383 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04aaefd-d2a0-4c57-b697-c40e4f83cbc7 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:27:48.528047 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-f04aaefd-d2a0-4c57-b697-c40e4f83cbc7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:27:48.563973 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:27:48.592437 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6abb749-3aef-46b8-a499-6c8d551c6c61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:27:48.593550 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6abb749-3aef-46b8-a499-6c8d551c6c61 admin admin] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:48.594064 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6abb749-3aef-46b8-a499-6c8d551c6c61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:48.594355 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6abb749-3aef-46b8-a499-6c8d551c6c61 admin admin] PATH_INFO: `/v3/users` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:48.595405 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6abb749-3aef-46b8-a499-6c8d551c6c61 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:27:48.597557 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6abb749-3aef-46b8-a499-6c8d551c6c61 admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:27:48.624912 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1019/2047] 10.222.0.44 () {60 vars in 1143 bytes} [Thu Jun 16 12:27:48 2022] POST /identity/v3/users => generated 287 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 12:27:48.629414 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6abb749-3aef-46b8-a499-6c8d551c6c61 admin admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:27:48.631791 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-c6abb749-3aef-46b8-a499-6c8d551c6c61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:27:48.632786 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04aaefd-d2a0-4c57-b697-c40e4f83cbc7 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:27:48.647989 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6abb749-3aef-46b8-a499-6c8d551c6c61 admin admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:27:48.652383 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4b962f-b60e-408b-86a2-ebd26cc0ec1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:27:48.653942 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4b962f-b60e-408b-86a2-ebd26cc0ec1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:48.654224 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4b962f-b60e-408b-86a2-ebd26cc0ec1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:48.654498 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4b962f-b60e-408b-86a2-ebd26cc0ec1e admin admin] PATH_INFO: `/v3/users/cd9bd1f3cfb6458892c3febd26f46fd0` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:48.656166 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4b962f-b60e-408b-86a2-ebd26cc0ec1e admin admin] RBAC: Authorizing `identity:delete_user(user_id=cd9bd1f3cfb6458892c3febd26f46fd0)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:27:48.660929 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4b962f-b60e-408b-86a2-ebd26cc0ec1e admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:27:48.661091 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcec96d-b475-4343-abde-1e571fec3235 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:27:48.662393 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcec96d-b475-4343-abde-1e571fec3235 admin admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:48.662764 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcec96d-b475-4343-abde-1e571fec3235 admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:48.663095 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcec96d-b475-4343-abde-1e571fec3235 admin admin] PATH_INFO: `/v3/roles` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:48.663718 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dcec96d-b475-4343-abde-1e571fec3235 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:27:48.665400 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dcec96d-b475-4343-abde-1e571fec3235 admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:27:48.683576 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1020/2048] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 12:27:48 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 12:27:48.689968 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcec96d-b475-4343-abde-1e571fec3235 admin admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:27:48.719559 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcec96d-b475-4343-abde-1e571fec3235 admin admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:27:48.726704 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ceae44-9d70-4187-a042-fe1776888934 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:27:48.727520 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ceae44-9d70-4187-a042-fe1776888934 admin admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:48.728144 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ceae44-9d70-4187-a042-fe1776888934 admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:48.728564 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ceae44-9d70-4187-a042-fe1776888934 admin admin] PATH_INFO: `/v3/roles` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:48.729561 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ceae44-9d70-4187-a042-fe1776888934 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:27:48.733472 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-3d4b962f-b60e-408b-86a2-ebd26cc0ec1e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd9bd1f3cfb6458892c3febd26f46fd0'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:27:48.735467 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ceae44-9d70-4187-a042-fe1776888934 admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:27:48.737095 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:DELETE=7,keystone:SELECT=88,keystone:INSERT=5 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:27:48.737384 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-3d4b962f-b60e-408b-86a2-ebd26cc0ec1e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd9bd1f3cfb6458892c3febd26f46fd0'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:27:48.753674 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1021/2049] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 12:27:48 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 12:27:48.755155 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ceae44-9d70-4187-a042-fe1776888934 admin admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:27:48.757264 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-d8ceae44-9d70-4187-a042-fe1776888934 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:27:48.759574 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-3d4b962f-b60e-408b-86a2-ebd26cc0ec1e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd9bd1f3cfb6458892c3febd26f46fd0'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:27:48.760813 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-3d4b962f-b60e-408b-86a2-ebd26cc0ec1e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd9bd1f3cfb6458892c3febd26f46fd0'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:27:48.772334 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-3d4b962f-b60e-408b-86a2-ebd26cc0ec1e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd9bd1f3cfb6458892c3febd26f46fd0'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:27:48.775539 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ceae44-9d70-4187-a042-fe1776888934 admin admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:27:48.781695 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf43bc3-6a0b-48ff-97f9-688653b0c3aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:27:48.782771 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf43bc3-6a0b-48ff-97f9-688653b0c3aa admin admin] REQUEST_METHOD: `PUT` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:48.783065 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf43bc3-6a0b-48ff-97f9-688653b0c3aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:48.783637 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf43bc3-6a0b-48ff-97f9-688653b0c3aa admin admin] PATH_INFO: `/v3/projects/ddfe22d9f67f42868c09938f3039e6e8/users/ec95d8dfa98b4d3db7edaad4e37925b4/roles/c39882b202e942479a7cdac2fc6da72c` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:48.794663 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1029/2050] 10.222.0.44 () {58 vars in 1223 bytes} [Thu Jun 16 12:27:48 2022] DELETE /identity/v3/users/cd9bd1f3cfb6458892c3febd26f46fd0 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:27:48.795555 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4b962f-b60e-408b-86a2-ebd26cc0ec1e admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:27:48.797182 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-3d4b962f-b60e-408b-86a2-ebd26cc0ec1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:27:48.801104 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf43bc3-6a0b-48ff-97f9-688653b0c3aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=ddfe22d9f67f42868c09938f3039e6e8, user_id=ec95d8dfa98b4d3db7edaad4e37925b4, role_id=c39882b202e942479a7cdac2fc6da72c)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:27:48.804265 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf43bc3-6a0b-48ff-97f9-688653b0c3aa admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:27:48.823589 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1022/2051] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 16 12:27:48 2022] PUT /identity/v3/projects/ddfe22d9f67f42868c09938f3039e6e8/users/ec95d8dfa98b4d3db7edaad4e37925b4/roles/c39882b202e942479a7cdac2fc6da72c => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:27:48.834124 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224fd166-21d3-4fab-b4e2-7b84388b1fe1 None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:48.834634 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224fd166-21d3-4fab-b4e2-7b84388b1fe1 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:48.834924 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224fd166-21d3-4fab-b4e2-7b84388b1fe1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:48.854536 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-224fd166-21d3-4fab-b4e2-7b84388b1fe1 None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:27:48.855989 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-224fd166-21d3-4fab-b4e2-7b84388b1fe1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:27:48.883886 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4b962f-b60e-408b-86a2-ebd26cc0ec1e admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:27:48.952472 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1023/2052] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 12:27:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:27:48.963069 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224fd166-21d3-4fab-b4e2-7b84388b1fe1 None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:27:48.963656 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99398574-be45-4bb1-84c9-f51a51e190ae service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f96fc14ed89478c8a8c2f11c87511e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '601361df39e34fcca71175aa94e425c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:27:48.965166 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-224fd166-21d3-4fab-b4e2-7b84388b1fe1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:27:48.966864 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99398574-be45-4bb1-84c9-f51a51e190ae service cinder] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:48.969844 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99398574-be45-4bb1-84c9-f51a51e190ae service cinder] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:48.970137 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99398574-be45-4bb1-84c9-f51a51e190ae service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:48.974475 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-99398574-be45-4bb1-84c9-f51a51e190ae service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:27:48.987752 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:27:49.052648 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224fd166-21d3-4fab-b4e2-7b84388b1fe1 None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:27:49.056612 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cb4145-3082-47f5-a5e3-fe15830380a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1094729b25a4be7b0b394998c9ca681', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '601361df39e34fcca71175aa94e425c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:27:49.057976 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cb4145-3082-47f5-a5e3-fe15830380a8 service neutron] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:49.058643 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cb4145-3082-47f5-a5e3-fe15830380a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:49.058643 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cb4145-3082-47f5-a5e3-fe15830380a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:49.061754 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99398574-be45-4bb1-84c9-f51a51e190ae service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:27:49.063369 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99398574-be45-4bb1-84c9-f51a51e190ae service cinder] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:27:49.069405 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cb4145-3082-47f5-a5e3-fe15830380a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:27:49.071495 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cb4145-3082-47f5-a5e3-fe15830380a8 service neutron] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:27:49.075792 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1030/2053] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 12:27:48 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 12:27:49.084723 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1024/2054] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 12:27:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 12:27:49.119425 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99398574-be45-4bb1-84c9-f51a51e190ae service cinder] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:27:49.123912 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-99398574-be45-4bb1-84c9-f51a51e190ae service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:27:49.152525 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99398574-be45-4bb1-84c9-f51a51e190ae service cinder] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:27:49.160814 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed93de2d-fccd-46aa-aba2-54410e6d5483 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:27:49.162038 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed93de2d-fccd-46aa-aba2-54410e6d5483 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:49.162530 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed93de2d-fccd-46aa-aba2-54410e6d5483 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:49.162960 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed93de2d-fccd-46aa-aba2-54410e6d5483 admin admin] PATH_INFO: `/v3/projects/d4bb2935653b4f3ba02a9570b6d230fc` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:49.164593 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed93de2d-fccd-46aa-aba2-54410e6d5483 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d4bb2935653b4f3ba02a9570b6d230fc)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:27:49.167030 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed93de2d-fccd-46aa-aba2-54410e6d5483 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:27:49.225272 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-ed93de2d-fccd-46aa-aba2-54410e6d5483 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd4bb2935653b4f3ba02a9570b6d230fc', 'request_id': 'req-ed93de2d-fccd-46aa-aba2-54410e6d5483'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:27:49.235403 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-ed93de2d-fccd-46aa-aba2-54410e6d5483 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd4bb2935653b4f3ba02a9570b6d230fc', 'request_id': 'req-ed93de2d-fccd-46aa-aba2-54410e6d5483'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:27:49.245052 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-ed93de2d-fccd-46aa-aba2-54410e6d5483 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd4bb2935653b4f3ba02a9570b6d230fc', 'request_id': 'req-ed93de2d-fccd-46aa-aba2-54410e6d5483'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:27:49.269242 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-ed93de2d-fccd-46aa-aba2-54410e6d5483 admin admin] The token cache is being invalidate because project d4bb2935653b4f3ba02a9570b6d230fc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 12:27:49.269242 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-ed93de2d-fccd-46aa-aba2-54410e6d5483 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:27:49.270186 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-ed93de2d-fccd-46aa-aba2-54410e6d5483 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:27:49.276230 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1031/2055] 10.222.0.44 () {58 vars in 1232 bytes} [Thu Jun 16 12:27:49 2022] DELETE /identity/v3/projects/d4bb2935653b4f3ba02a9570b6d230fc => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:27:49.278186 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14e0bd1-2790-4bc1-b99e-81e4927e95a5 None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:49.278543 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14e0bd1-2790-4bc1-b99e-81e4927e95a5 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:49.278887 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14e0bd1-2790-4bc1-b99e-81e4927e95a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:49.299807 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-e14e0bd1-2790-4bc1-b99e-81e4927e95a5 None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:27:49.301530 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-e14e0bd1-2790-4bc1-b99e-81e4927e95a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:27:49.387569 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1025/2056] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 12:27:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:27:49.389819 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fcf611-3f60-4332-90a8-ae08b3a1af49 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:49.389819 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fcf611-3f60-4332-90a8-ae08b3a1af49 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:49.390093 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fcf611-3f60-4332-90a8-ae08b3a1af49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:49.410534 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-29fcf611-3f60-4332-90a8-ae08b3a1af49 None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:27:49.412231 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-29fcf611-3f60-4332-90a8-ae08b3a1af49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:27:49.421030 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1032/2057] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 12:27:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:27:49.425262 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14e0bd1-2790-4bc1-b99e-81e4927e95a5 None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:27:49.437760 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14e0bd1-2790-4bc1-b99e-81e4927e95a5 None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:27:49.445142 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ced732-ad45-456f-9a6f-d9a2e4aa8c44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:27:49.445713 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ced732-ad45-456f-9a6f-d9a2e4aa8c44 admin admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:49.445993 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ced732-ad45-456f-9a6f-d9a2e4aa8c44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:49.446361 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ced732-ad45-456f-9a6f-d9a2e4aa8c44 admin admin] PATH_INFO: `/v3/domains` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:49.447002 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ced732-ad45-456f-9a6f-d9a2e4aa8c44 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:27:49.447312 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ced732-ad45-456f-9a6f-d9a2e4aa8c44 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:27:49.448959 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ced732-ad45-456f-9a6f-d9a2e4aa8c44 admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:27:49.464513 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1026/2058] 10.222.0.44 () {58 vars in 1152 bytes} [Thu Jun 16 12:27:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 12:27:49.469617 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fcf611-3f60-4332-90a8-ae08b3a1af49 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:27:49.497268 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fcf611-3f60-4332-90a8-ae08b3a1af49 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:27:49.517473 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c74559d-a1b7-4944-b100-c5973b97ec36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:27:49.518268 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c74559d-a1b7-4944-b100-c5973b97ec36 admin admin] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:49.518451 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c74559d-a1b7-4944-b100-c5973b97ec36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:49.518804 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c74559d-a1b7-4944-b100-c5973b97ec36 admin admin] PATH_INFO: `/v3/projects` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:49.524177 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c74559d-a1b7-4944-b100-c5973b97ec36 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:27:49.528678 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c74559d-a1b7-4944-b100-c5973b97ec36 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:27:49.575223 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1033/2059] 10.222.0.44 () {60 vars in 1152 bytes} [Thu Jun 16 12:27:49 2022] POST /identity/v3/projects => generated 387 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 12:27:49.579830 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ced732-ad45-456f-9a6f-d9a2e4aa8c44 admin admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:27:49.585247 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:27:49.592744 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ced732-ad45-456f-9a6f-d9a2e4aa8c44 admin admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:27:49.689150 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec8b83f-5503-4f00-85e1-03a5d9b417d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:27:49.689838 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec8b83f-5503-4f00-85e1-03a5d9b417d7 admin admin] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:49.690126 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec8b83f-5503-4f00-85e1-03a5d9b417d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:49.690406 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec8b83f-5503-4f00-85e1-03a5d9b417d7 admin admin] PATH_INFO: `/v3/users` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:49.691112 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec8b83f-5503-4f00-85e1-03a5d9b417d7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:27:49.693717 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec8b83f-5503-4f00-85e1-03a5d9b417d7 admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:27:49.774136 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1027/2060] 10.222.0.44 () {60 vars in 1143 bytes} [Thu Jun 16 12:27:49 2022] POST /identity/v3/users => generated 294 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 12:27:49.787960 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c74559d-a1b7-4944-b100-c5973b97ec36 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:27:49.800778 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c74559d-a1b7-4944-b100-c5973b97ec36 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:27:49.808293 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d56c0d-33fb-4f0d-8996-df68787aa8ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:27:49.809846 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d56c0d-33fb-4f0d-8996-df68787aa8ce admin admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:49.810131 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d56c0d-33fb-4f0d-8996-df68787aa8ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:49.810409 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d56c0d-33fb-4f0d-8996-df68787aa8ce admin admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:49.811450 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d56c0d-33fb-4f0d-8996-df68787aa8ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:27:49.813163 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d56c0d-33fb-4f0d-8996-df68787aa8ce admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:27:49.825067 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1034/2061] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 12:27:49 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 12:27:49.829301 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec8b83f-5503-4f00-85e1-03a5d9b417d7 admin admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:27:49.841671 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec8b83f-5503-4f00-85e1-03a5d9b417d7 admin admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:27:49.848101 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f67c30-dceb-4a9d-91c2-20fe053d563f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:27:49.849587 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f67c30-dceb-4a9d-91c2-20fe053d563f admin admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:49.850012 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f67c30-dceb-4a9d-91c2-20fe053d563f admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:49.850292 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f67c30-dceb-4a9d-91c2-20fe053d563f admin admin] PATH_INFO: `/v3/roles` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:49.851189 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f67c30-dceb-4a9d-91c2-20fe053d563f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:27:49.853257 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f67c30-dceb-4a9d-91c2-20fe053d563f admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:27:49.888911 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1028/2062] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 12:27:49 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 12:27:49.893496 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d56c0d-33fb-4f0d-8996-df68787aa8ce admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:27:49.905369 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d56c0d-33fb-4f0d-8996-df68787aa8ce admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:27:49.913875 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b47cb0c-a8b1-4647-87ad-8197f7daeef4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:27:49.915645 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b47cb0c-a8b1-4647-87ad-8197f7daeef4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:49.915995 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b47cb0c-a8b1-4647-87ad-8197f7daeef4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:49.916567 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b47cb0c-a8b1-4647-87ad-8197f7daeef4 admin admin] PATH_INFO: `/v3/projects/879762344a6b4f89be453e07b908913c/users/0add0e638a0c43ea8cfe8dc51ec3f964/roles/c39882b202e942479a7cdac2fc6da72c` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:49.949112 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b47cb0c-a8b1-4647-87ad-8197f7daeef4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=879762344a6b4f89be453e07b908913c, user_id=0add0e638a0c43ea8cfe8dc51ec3f964, role_id=c39882b202e942479a7cdac2fc6da72c)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:27:49.951851 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b47cb0c-a8b1-4647-87ad-8197f7daeef4 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:27:49.993405 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1035/2063] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 16 12:27:49 2022] PUT /identity/v3/projects/879762344a6b4f89be453e07b908913c/users/0add0e638a0c43ea8cfe8dc51ec3f964/roles/c39882b202e942479a7cdac2fc6da72c => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:27:50.004123 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca045d41-af4c-4af6-91eb-4a83f6589b68 None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:50.004412 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca045d41-af4c-4af6-91eb-4a83f6589b68 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:50.004685 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca045d41-af4c-4af6-91eb-4a83f6589b68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:50.053750 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-ca045d41-af4c-4af6-91eb-4a83f6589b68 None None] MFA Rules not processed for user `0add0e638a0c43ea8cfe8dc51ec3f964`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:27:50.057178 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-ca045d41-af4c-4af6-91eb-4a83f6589b68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:27:50.169978 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1029/2064] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 12:27:50 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 12:27:50.174345 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b47cb0c-a8b1-4647-87ad-8197f7daeef4 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:27:50.219236 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:27:50.304067 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b47cb0c-a8b1-4647-87ad-8197f7daeef4 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:27:50.313627 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb95a29-20ed-4f8a-9dea-7a90368cec67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:27:50.314764 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb95a29-20ed-4f8a-9dea-7a90368cec67 admin admin] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:50.315052 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb95a29-20ed-4f8a-9dea-7a90368cec67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:50.315329 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb95a29-20ed-4f8a-9dea-7a90368cec67 admin admin] PATH_INFO: `/v3/projects` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:50.316047 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb95a29-20ed-4f8a-9dea-7a90368cec67 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:27:50.319191 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb95a29-20ed-4f8a-9dea-7a90368cec67 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:27:50.364970 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1036/2065] 10.222.0.44 () {60 vars in 1152 bytes} [Thu Jun 16 12:27:50 2022] POST /identity/v3/projects => generated 387 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 12:27:50.365810 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca045d41-af4c-4af6-91eb-4a83f6589b68 None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:27:50.377835 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca045d41-af4c-4af6-91eb-4a83f6589b68 None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:27:50.464685 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3a1fe8-4408-46d7-93f5-e321f1cd09fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:27:50.466165 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3a1fe8-4408-46d7-93f5-e321f1cd09fd admin admin] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:50.466454 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3a1fe8-4408-46d7-93f5-e321f1cd09fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:50.466924 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3a1fe8-4408-46d7-93f5-e321f1cd09fd admin admin] PATH_INFO: `/v3/users` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:50.467631 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3a1fe8-4408-46d7-93f5-e321f1cd09fd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:27:50.469925 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3a1fe8-4408-46d7-93f5-e321f1cd09fd admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:27:50.487983 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:27:50.500222 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1030/2066] 10.222.0.44 () {60 vars in 1143 bytes} [Thu Jun 16 12:27:50 2022] POST /identity/v3/users => generated 300 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 12:27:50.502214 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb95a29-20ed-4f8a-9dea-7a90368cec67 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:27:50.514270 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb95a29-20ed-4f8a-9dea-7a90368cec67 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:27:50.543298 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f435f2e7-6bc4-4a4c-9a96-01b25ac36eb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:27:50.544205 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f435f2e7-6bc4-4a4c-9a96-01b25ac36eb6 admin admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:50.544319 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f435f2e7-6bc4-4a4c-9a96-01b25ac36eb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:50.544593 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f435f2e7-6bc4-4a4c-9a96-01b25ac36eb6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:50.545437 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f435f2e7-6bc4-4a4c-9a96-01b25ac36eb6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:27:50.547046 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f435f2e7-6bc4-4a4c-9a96-01b25ac36eb6 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:27:50.576891 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1037/2067] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 12:27:50 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 12:27:50.581209 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3a1fe8-4408-46d7-93f5-e321f1cd09fd admin admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:27:50.601636 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3a1fe8-4408-46d7-93f5-e321f1cd09fd admin admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:27:50.606740 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a45f5a-3e36-4533-8a79-93f252af1624 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:27:50.607699 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a45f5a-3e36-4533-8a79-93f252af1624 admin admin] REQUEST_METHOD: `PUT` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:50.608054 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a45f5a-3e36-4533-8a79-93f252af1624 admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:50.608399 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a45f5a-3e36-4533-8a79-93f252af1624 admin admin] PATH_INFO: `/v3/projects/4f7cd5876874437e9d336f6f40fa72db/users/7a150c99475b4bcf9f9446a53a5f0491/roles/0688968254744e3f9913653cafea3091` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:50.628223 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a45f5a-3e36-4533-8a79-93f252af1624 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f7cd5876874437e9d336f6f40fa72db, user_id=7a150c99475b4bcf9f9446a53a5f0491, role_id=0688968254744e3f9913653cafea3091)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:27:50.631532 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a45f5a-3e36-4533-8a79-93f252af1624 admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:27:50.646680 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1031/2068] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 16 12:27:50 2022] PUT /identity/v3/projects/4f7cd5876874437e9d336f6f40fa72db/users/7a150c99475b4bcf9f9446a53a5f0491/roles/0688968254744e3f9913653cafea3091 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:27:50.651020 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f435f2e7-6bc4-4a4c-9a96-01b25ac36eb6 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:27:50.663102 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f435f2e7-6bc4-4a4c-9a96-01b25ac36eb6 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:27:50.764650 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927ad5f6-6137-4e27-a188-fcc16ebba2a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:27:50.765579 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927ad5f6-6137-4e27-a188-fcc16ebba2a8 admin admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:50.765932 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927ad5f6-6137-4e27-a188-fcc16ebba2a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:50.766286 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927ad5f6-6137-4e27-a188-fcc16ebba2a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:50.767116 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927ad5f6-6137-4e27-a188-fcc16ebba2a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:27:50.772877 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927ad5f6-6137-4e27-a188-fcc16ebba2a8 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:27:50.788348 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1038/2069] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 12:27:50 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 12:27:50.798555 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a45f5a-3e36-4533-8a79-93f252af1624 admin admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:27:50.814767 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a45f5a-3e36-4533-8a79-93f252af1624 admin admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:27:50.822548 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cec188-3910-45f4-96f0-303e968e0b99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:27:50.824450 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cec188-3910-45f4-96f0-303e968e0b99 admin admin] REQUEST_METHOD: `PUT` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:50.825154 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cec188-3910-45f4-96f0-303e968e0b99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:50.825618 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cec188-3910-45f4-96f0-303e968e0b99 admin admin] PATH_INFO: `/v3/projects/4f7cd5876874437e9d336f6f40fa72db/users/7a150c99475b4bcf9f9446a53a5f0491/roles/0688968254744e3f9913653cafea3091` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:50.827860 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1cec188-3910-45f4-96f0-303e968e0b99 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f7cd5876874437e9d336f6f40fa72db, user_id=7a150c99475b4bcf9f9446a53a5f0491, role_id=0688968254744e3f9913653cafea3091)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:27:50.830843 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1cec188-3910-45f4-96f0-303e968e0b99 admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:27:50.860998 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1032/2070] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 16 12:27:50 2022] PUT /identity/v3/projects/4f7cd5876874437e9d336f6f40fa72db/users/7a150c99475b4bcf9f9446a53a5f0491/roles/0688968254744e3f9913653cafea3091 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:27:50.867186 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d71d294-d481-4336-b58c-f9339efb5ccc None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:50.867474 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d71d294-d481-4336-b58c-f9339efb5ccc None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:50.867759 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d71d294-d481-4336-b58c-f9339efb5ccc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:50.910568 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-7d71d294-d481-4336-b58c-f9339efb5ccc None None] MFA Rules not processed for user `7a150c99475b4bcf9f9446a53a5f0491`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:27:50.911879 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-7d71d294-d481-4336-b58c-f9339efb5ccc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:27:51.072091 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1039/2071] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 12:27:50 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:27:51.086038 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cec188-3910-45f4-96f0-303e968e0b99 admin admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:27:51.088501 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-b1cec188-3910-45f4-96f0-303e968e0b99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:27:51.156460 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cec188-3910-45f4-96f0-303e968e0b99 admin admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:27:51.160904 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3969a052-89fd-4a69-b15b-ea07bcbed9f8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f96fc14ed89478c8a8c2f11c87511e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '601361df39e34fcca71175aa94e425c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:27:51.162118 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3969a052-89fd-4a69-b15b-ea07bcbed9f8 service cinder] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:51.162686 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3969a052-89fd-4a69-b15b-ea07bcbed9f8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:51.162686 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3969a052-89fd-4a69-b15b-ea07bcbed9f8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:51.172560 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3969a052-89fd-4a69-b15b-ea07bcbed9f8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:27:51.173981 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3969a052-89fd-4a69-b15b-ea07bcbed9f8 service cinder] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:27:51.183801 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1033/2072] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 12:27:51 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 12:27:51.211257 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d71d294-d481-4336-b58c-f9339efb5ccc None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:27:51.232711 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:27:51.279225 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d71d294-d481-4336-b58c-f9339efb5ccc None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:27:51.284072 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283f70c6-465c-44d5-9e2d-a71257ed0a32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:27:51.285353 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283f70c6-465c-44d5-9e2d-a71257ed0a32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:51.285627 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283f70c6-465c-44d5-9e2d-a71257ed0a32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:51.286367 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283f70c6-465c-44d5-9e2d-a71257ed0a32 admin admin] PATH_INFO: `/v3/users/0add0e638a0c43ea8cfe8dc51ec3f964` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:51.287295 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283f70c6-465c-44d5-9e2d-a71257ed0a32 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0add0e638a0c43ea8cfe8dc51ec3f964)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:27:51.289478 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283f70c6-465c-44d5-9e2d-a71257ed0a32 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:27:51.374282 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-283f70c6-465c-44d5-9e2d-a71257ed0a32 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0add0e638a0c43ea8cfe8dc51ec3f964'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:27:51.375994 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-283f70c6-465c-44d5-9e2d-a71257ed0a32 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0add0e638a0c43ea8cfe8dc51ec3f964'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:27:51.388685 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-283f70c6-465c-44d5-9e2d-a71257ed0a32 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0add0e638a0c43ea8cfe8dc51ec3f964'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:27:51.390516 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-283f70c6-465c-44d5-9e2d-a71257ed0a32 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0add0e638a0c43ea8cfe8dc51ec3f964'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:27:51.410764 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-283f70c6-465c-44d5-9e2d-a71257ed0a32 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0add0e638a0c43ea8cfe8dc51ec3f964'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:27:51.431410 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1040/2073] 10.222.0.44 () {58 vars in 1223 bytes} [Thu Jun 16 12:27:51 2022] DELETE /identity/v3/users/0add0e638a0c43ea8cfe8dc51ec3f964 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:27:51.435901 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958a7959-0d54-42a1-96ed-91d18bc2bffa None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:51.436269 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958a7959-0d54-42a1-96ed-91d18bc2bffa None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:51.436642 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958a7959-0d54-42a1-96ed-91d18bc2bffa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:51.471848 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-958a7959-0d54-42a1-96ed-91d18bc2bffa None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:27:51.476157 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-958a7959-0d54-42a1-96ed-91d18bc2bffa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:27:51.557043 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1034/2074] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 12:27:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:27:51.567310 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283f70c6-465c-44d5-9e2d-a71257ed0a32 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:27:51.569405 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-283f70c6-465c-44d5-9e2d-a71257ed0a32 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:27:51.655881 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283f70c6-465c-44d5-9e2d-a71257ed0a32 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:27:51.659873 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8065b6db-eeec-40b1-889c-3f483c9e5dcc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1094729b25a4be7b0b394998c9ca681', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '601361df39e34fcca71175aa94e425c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:27:51.660857 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8065b6db-eeec-40b1-889c-3f483c9e5dcc service neutron] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:51.661189 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8065b6db-eeec-40b1-889c-3f483c9e5dcc service neutron] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:51.661472 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8065b6db-eeec-40b1-889c-3f483c9e5dcc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:51.672105 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8065b6db-eeec-40b1-889c-3f483c9e5dcc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:27:51.673667 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8065b6db-eeec-40b1-889c-3f483c9e5dcc service neutron] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:27:51.684620 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1041/2075] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 12:27:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 12:27:52.146481 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958a7959-0d54-42a1-96ed-91d18bc2bffa None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:27:52.152660 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-958a7959-0d54-42a1-96ed-91d18bc2bffa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:27:52.197873 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958a7959-0d54-42a1-96ed-91d18bc2bffa None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:27:52.205859 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93619443-8b89-4bad-beb5-6e2f6cec359b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:27:52.206798 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93619443-8b89-4bad-beb5-6e2f6cec359b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:52.207168 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93619443-8b89-4bad-beb5-6e2f6cec359b admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:52.207493 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93619443-8b89-4bad-beb5-6e2f6cec359b admin admin] PATH_INFO: `/v3/projects/879762344a6b4f89be453e07b908913c` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:52.209341 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93619443-8b89-4bad-beb5-6e2f6cec359b admin admin] RBAC: Authorizing `identity:delete_project(project_id=879762344a6b4f89be453e07b908913c)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:27:52.212137 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93619443-8b89-4bad-beb5-6e2f6cec359b admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:27:52.326605 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-93619443-8b89-4bad-beb5-6e2f6cec359b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '879762344a6b4f89be453e07b908913c', 'request_id': 'req-93619443-8b89-4bad-beb5-6e2f6cec359b'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:27:52.350386 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-93619443-8b89-4bad-beb5-6e2f6cec359b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '879762344a6b4f89be453e07b908913c', 'request_id': 'req-93619443-8b89-4bad-beb5-6e2f6cec359b'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:27:52.356076 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=91,keystone:INSERT=3,keystone:DELETE=6 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:27:52.357457 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-93619443-8b89-4bad-beb5-6e2f6cec359b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '879762344a6b4f89be453e07b908913c', 'request_id': 'req-93619443-8b89-4bad-beb5-6e2f6cec359b'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:27:52.388058 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-93619443-8b89-4bad-beb5-6e2f6cec359b admin admin] The token cache is being invalidate because project 879762344a6b4f89be453e07b908913c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 12:27:52.388405 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-93619443-8b89-4bad-beb5-6e2f6cec359b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:27:52.389560 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-93619443-8b89-4bad-beb5-6e2f6cec359b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:27:52.394500 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1035/2076] 10.222.0.44 () {58 vars in 1232 bytes} [Thu Jun 16 12:27:52 2022] DELETE /identity/v3/projects/879762344a6b4f89be453e07b908913c => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:27:52.396537 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8065b6db-eeec-40b1-889c-3f483c9e5dcc service neutron] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:27:52.418297 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8065b6db-eeec-40b1-889c-3f483c9e5dcc service neutron] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:27:52.554382 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:27:52.589299 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8da241-56d4-4c17-b911-263d6c530ff2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:27:52.590193 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8da241-56d4-4c17-b911-263d6c530ff2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:52.591091 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8da241-56d4-4c17-b911-263d6c530ff2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:52.591442 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8da241-56d4-4c17-b911-263d6c530ff2 admin admin] PATH_INFO: `/v3/users/7a150c99475b4bcf9f9446a53a5f0491` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:52.592878 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8da241-56d4-4c17-b911-263d6c530ff2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7a150c99475b4bcf9f9446a53a5f0491)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:27:52.610069 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8da241-56d4-4c17-b911-263d6c530ff2 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:27:52.709697 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-ff8da241-56d4-4c17-b911-263d6c530ff2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7a150c99475b4bcf9f9446a53a5f0491'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:27:52.710664 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-ff8da241-56d4-4c17-b911-263d6c530ff2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7a150c99475b4bcf9f9446a53a5f0491'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:27:52.725423 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-ff8da241-56d4-4c17-b911-263d6c530ff2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7a150c99475b4bcf9f9446a53a5f0491'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:27:52.727422 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-ff8da241-56d4-4c17-b911-263d6c530ff2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7a150c99475b4bcf9f9446a53a5f0491'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:27:52.744963 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-ff8da241-56d4-4c17-b911-263d6c530ff2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7a150c99475b4bcf9f9446a53a5f0491'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:27:52.777781 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1042/2077] 10.222.0.44 () {58 vars in 1223 bytes} [Thu Jun 16 12:27:52 2022] DELETE /identity/v3/users/7a150c99475b4bcf9f9446a53a5f0491 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:27:53.270978 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93619443-8b89-4bad-beb5-6e2f6cec359b admin admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:27:53.272997 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-93619443-8b89-4bad-beb5-6e2f6cec359b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:27:53.292038 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93619443-8b89-4bad-beb5-6e2f6cec359b admin admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:27:53.381746 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0ac551-f51b-494f-9ecc-8f0164e7d56d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:27:53.382769 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0ac551-f51b-494f-9ecc-8f0164e7d56d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:53.383102 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0ac551-f51b-494f-9ecc-8f0164e7d56d admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:53.383317 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0ac551-f51b-494f-9ecc-8f0164e7d56d admin admin] PATH_INFO: `/v3/projects/4f7cd5876874437e9d336f6f40fa72db` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:53.384958 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0ac551-f51b-494f-9ecc-8f0164e7d56d admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f7cd5876874437e9d336f6f40fa72db)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:27:53.386895 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0ac551-f51b-494f-9ecc-8f0164e7d56d admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:27:53.476460 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-bb0ac551-f51b-494f-9ecc-8f0164e7d56d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f7cd5876874437e9d336f6f40fa72db', 'request_id': 'req-bb0ac551-f51b-494f-9ecc-8f0164e7d56d'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:27:53.491415 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-bb0ac551-f51b-494f-9ecc-8f0164e7d56d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f7cd5876874437e9d336f6f40fa72db', 'request_id': 'req-bb0ac551-f51b-494f-9ecc-8f0164e7d56d'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:27:53.499559 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-bb0ac551-f51b-494f-9ecc-8f0164e7d56d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f7cd5876874437e9d336f6f40fa72db', 'request_id': 'req-bb0ac551-f51b-494f-9ecc-8f0164e7d56d'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:27:53.528524 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-bb0ac551-f51b-494f-9ecc-8f0164e7d56d admin admin] The token cache is being invalidate because project 4f7cd5876874437e9d336f6f40fa72db was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 12:27:53.529522 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-bb0ac551-f51b-494f-9ecc-8f0164e7d56d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:27:53.530220 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-bb0ac551-f51b-494f-9ecc-8f0164e7d56d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:27:53.532966 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1036/2078] 10.222.0.44 () {58 vars in 1232 bytes} [Thu Jun 16 12:27:53 2022] DELETE /identity/v3/projects/4f7cd5876874437e9d336f6f40fa72db => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:27:53.538417 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e36518-0ff0-452d-bd8f-81b68aeae02f None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:53.538709 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e36518-0ff0-452d-bd8f-81b68aeae02f None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:53.538992 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e36518-0ff0-452d-bd8f-81b68aeae02f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:53.574704 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-a7e36518-0ff0-452d-bd8f-81b68aeae02f None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:27:53.578655 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-a7e36518-0ff0-452d-bd8f-81b68aeae02f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:27:53.727239 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1043/2079] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 12:27:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:27:53.731653 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c895da51-50b0-4475-8bc8-ceca37f45b96 None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:53.732388 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c895da51-50b0-4475-8bc8-ceca37f45b96 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:53.733170 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c895da51-50b0-4475-8bc8-ceca37f45b96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:53.795779 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-c895da51-50b0-4475-8bc8-ceca37f45b96 None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:27:53.797166 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-c895da51-50b0-4475-8bc8-ceca37f45b96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:27:53.830931 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1037/2080] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 12:27:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:27:53.832429 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e36518-0ff0-452d-bd8f-81b68aeae02f None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:27:53.845125 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e36518-0ff0-452d-bd8f-81b68aeae02f None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:27:53.852435 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8b80d2-33f9-484d-ba14-7fba200bca18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:27:53.853408 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8b80d2-33f9-484d-ba14-7fba200bca18 admin admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:53.853755 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8b80d2-33f9-484d-ba14-7fba200bca18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:53.854170 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8b80d2-33f9-484d-ba14-7fba200bca18 admin admin] PATH_INFO: `/v3/domains` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:53.855021 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8b80d2-33f9-484d-ba14-7fba200bca18 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:27:53.855391 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8b80d2-33f9-484d-ba14-7fba200bca18 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:27:53.857113 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8b80d2-33f9-484d-ba14-7fba200bca18 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:27:53.873967 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1044/2081] 10.222.0.44 () {58 vars in 1152 bytes} [Thu Jun 16 12:27:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:27:53.882404 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c895da51-50b0-4475-8bc8-ceca37f45b96 None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:27:53.919736 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c895da51-50b0-4475-8bc8-ceca37f45b96 None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:27:53.942792 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507e4146-d84a-48d5-8120-9c424a4d7e47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:27:53.943837 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507e4146-d84a-48d5-8120-9c424a4d7e47 admin admin] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:53.944307 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507e4146-d84a-48d5-8120-9c424a4d7e47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:53.944811 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507e4146-d84a-48d5-8120-9c424a4d7e47 admin admin] PATH_INFO: `/v3/projects` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:53.945726 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507e4146-d84a-48d5-8120-9c424a4d7e47 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:27:53.947843 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507e4146-d84a-48d5-8120-9c424a4d7e47 admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:27:54.013852 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1038/2082] 10.222.0.44 () {60 vars in 1152 bytes} [Thu Jun 16 12:27:53 2022] POST /identity/v3/projects => generated 379 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 12:27:54.018374 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8b80d2-33f9-484d-ba14-7fba200bca18 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:27:54.044503 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8b80d2-33f9-484d-ba14-7fba200bca18 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:27:54.144923 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:27:54.179258 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03981327-70f2-407b-a23d-e7bff6dd6869 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:27:54.180062 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03981327-70f2-407b-a23d-e7bff6dd6869 admin admin] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:54.180402 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03981327-70f2-407b-a23d-e7bff6dd6869 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:54.180966 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03981327-70f2-407b-a23d-e7bff6dd6869 admin admin] PATH_INFO: `/v3/users` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:54.182445 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03981327-70f2-407b-a23d-e7bff6dd6869 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:27:54.184877 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03981327-70f2-407b-a23d-e7bff6dd6869 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:27:54.215617 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1045/2083] 10.222.0.44 () {60 vars in 1143 bytes} [Thu Jun 16 12:27:54 2022] POST /identity/v3/users => generated 290 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 12:27:54.219748 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507e4146-d84a-48d5-8120-9c424a4d7e47 admin admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:27:54.250539 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507e4146-d84a-48d5-8120-9c424a4d7e47 admin admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:27:54.250539 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05ea52a-d3d5-473c-b6b4-58045b2dfb8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:27:54.250539 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05ea52a-d3d5-473c-b6b4-58045b2dfb8a admin admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:54.250539 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05ea52a-d3d5-473c-b6b4-58045b2dfb8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:54.251109 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05ea52a-d3d5-473c-b6b4-58045b2dfb8a admin admin] PATH_INFO: `/v3/roles` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:54.251109 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05ea52a-d3d5-473c-b6b4-58045b2dfb8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:27:54.258117 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05ea52a-d3d5-473c-b6b4-58045b2dfb8a admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:27:54.269150 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1039/2084] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 12:27:54 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 12:27:54.273918 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03981327-70f2-407b-a23d-e7bff6dd6869 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:27:54.284432 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03981327-70f2-407b-a23d-e7bff6dd6869 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:27:54.292094 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb873e6-a520-4913-a94c-1a0337b778da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:27:54.294281 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb873e6-a520-4913-a94c-1a0337b778da admin admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:54.295362 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb873e6-a520-4913-a94c-1a0337b778da admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:54.296293 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb873e6-a520-4913-a94c-1a0337b778da admin admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:54.298750 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb873e6-a520-4913-a94c-1a0337b778da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:27:54.303764 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb873e6-a520-4913-a94c-1a0337b778da admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:27:54.318005 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1046/2085] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 12:27:54 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 12:27:54.322124 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05ea52a-d3d5-473c-b6b4-58045b2dfb8a admin admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:27:54.337911 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05ea52a-d3d5-473c-b6b4-58045b2dfb8a admin admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:27:54.343886 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf9e995-d285-4dbf-be1a-f08f010c43bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:27:54.344972 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf9e995-d285-4dbf-be1a-f08f010c43bb admin admin] REQUEST_METHOD: `PUT` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:54.345349 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf9e995-d285-4dbf-be1a-f08f010c43bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:54.345715 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf9e995-d285-4dbf-be1a-f08f010c43bb admin admin] PATH_INFO: `/v3/projects/ff4b27922238477f960849fa9b959dce/users/7d939a438a104a5897d08808991524e3/roles/c39882b202e942479a7cdac2fc6da72c` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:54.384881 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf9e995-d285-4dbf-be1a-f08f010c43bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff4b27922238477f960849fa9b959dce, user_id=7d939a438a104a5897d08808991524e3, role_id=c39882b202e942479a7cdac2fc6da72c)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:27:54.391421 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf9e995-d285-4dbf-be1a-f08f010c43bb admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:27:54.430912 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1040/2086] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 16 12:27:54 2022] PUT /identity/v3/projects/ff4b27922238477f960849fa9b959dce/users/7d939a438a104a5897d08808991524e3/roles/c39882b202e942479a7cdac2fc6da72c => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:27:54.433530 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8660edb9-7eb5-4376-8b56-93657160ebfe None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:54.433530 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8660edb9-7eb5-4376-8b56-93657160ebfe None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:54.433530 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8660edb9-7eb5-4376-8b56-93657160ebfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:54.507460 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf9e995-d285-4dbf-be1a-f08f010c43bb admin admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:27:54.509868 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-bdf9e995-d285-4dbf-be1a-f08f010c43bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:27:54.519299 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-8660edb9-7eb5-4376-8b56-93657160ebfe None None] MFA Rules not processed for user `7d939a438a104a5897d08808991524e3`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:27:54.524799 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-8660edb9-7eb5-4376-8b56-93657160ebfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:27:54.545163 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:DELETE=8,keystone:SELECT=89,keystone:INSERT=3 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:27:54.641527 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf9e995-d285-4dbf-be1a-f08f010c43bb admin admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:27:54.658626 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2851f23a-c7dd-487d-bb0c-fdbde9a1781b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:27:54.659538 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2851f23a-c7dd-487d-bb0c-fdbde9a1781b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:54.660247 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2851f23a-c7dd-487d-bb0c-fdbde9a1781b admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:54.660433 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2851f23a-c7dd-487d-bb0c-fdbde9a1781b admin admin] PATH_INFO: `/v3/users/2767ec356c104276bbb4e7f7fa5d5563` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:54.664540 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2851f23a-c7dd-487d-bb0c-fdbde9a1781b admin admin] RBAC: Authorizing `identity:delete_user(user_id=2767ec356c104276bbb4e7f7fa5d5563)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:27:54.668178 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2851f23a-c7dd-487d-bb0c-fdbde9a1781b admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:27:54.681139 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1047/2087] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 12:27:54 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:27:54.684524 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8660edb9-7eb5-4376-8b56-93657160ebfe None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:27:54.715354 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8660edb9-7eb5-4376-8b56-93657160ebfe None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:27:54.722829 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2aa42d-100d-490e-8f91-497e6cc087b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:27:54.723761 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2aa42d-100d-490e-8f91-497e6cc087b0 admin admin] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:54.724170 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2aa42d-100d-490e-8f91-497e6cc087b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:54.724534 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2aa42d-100d-490e-8f91-497e6cc087b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:54.725375 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2aa42d-100d-490e-8f91-497e6cc087b0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:27:54.728179 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2aa42d-100d-490e-8f91-497e6cc087b0 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:27:54.772718 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-2851f23a-c7dd-487d-bb0c-fdbde9a1781b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2767ec356c104276bbb4e7f7fa5d5563'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:27:54.774236 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1048/2088] 10.222.0.44 () {60 vars in 1152 bytes} [Thu Jun 16 12:27:54 2022] POST /identity/v3/projects => generated 379 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 12:27:54.776094 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8800cbe1-80a5-447e-8c32-cefcb9d01d19 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:54.776498 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8800cbe1-80a5-447e-8c32-cefcb9d01d19 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:54.776873 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8800cbe1-80a5-447e-8c32-cefcb9d01d19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:54.792579 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-2851f23a-c7dd-487d-bb0c-fdbde9a1781b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2767ec356c104276bbb4e7f7fa5d5563'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:27:54.800045 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-2851f23a-c7dd-487d-bb0c-fdbde9a1781b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2767ec356c104276bbb4e7f7fa5d5563'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:27:54.801364 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-2851f23a-c7dd-487d-bb0c-fdbde9a1781b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2767ec356c104276bbb4e7f7fa5d5563'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:27:54.802418 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-2851f23a-c7dd-487d-bb0c-fdbde9a1781b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2767ec356c104276bbb4e7f7fa5d5563'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:27:54.818106 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-8800cbe1-80a5-447e-8c32-cefcb9d01d19 None None] MFA Rules not processed for user `ec95d8dfa98b4d3db7edaad4e37925b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:27:54.822542 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1041/2089] 10.222.0.44 () {58 vars in 1223 bytes} [Thu Jun 16 12:27:54 2022] DELETE /identity/v3/users/2767ec356c104276bbb4e7f7fa5d5563 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:27:54.822704 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-8800cbe1-80a5-447e-8c32-cefcb9d01d19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:27:54.822812 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2851f23a-c7dd-487d-bb0c-fdbde9a1781b admin admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:27:54.823925 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-2851f23a-c7dd-487d-bb0c-fdbde9a1781b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:27:54.966783 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1049/2090] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 12:27:54 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:27:54.967278 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2851f23a-c7dd-487d-bb0c-fdbde9a1781b admin admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:27:54.970434 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061402b7-9ad0-479b-958d-ddb5116cfefb None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:54.970869 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061402b7-9ad0-479b-958d-ddb5116cfefb None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:54.972274 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061402b7-9ad0-479b-958d-ddb5116cfefb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:54.983591 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4469b305-d5b2-4208-9e7d-211fd95a6a8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:27:54.984284 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4469b305-d5b2-4208-9e7d-211fd95a6a8a admin admin] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:54.984560 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4469b305-d5b2-4208-9e7d-211fd95a6a8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:54.984872 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4469b305-d5b2-4208-9e7d-211fd95a6a8a admin admin] PATH_INFO: `/v3/users` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:54.985564 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4469b305-d5b2-4208-9e7d-211fd95a6a8a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:27:54.987841 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4469b305-d5b2-4208-9e7d-211fd95a6a8a admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:27:55.013902 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-061402b7-9ad0-479b-958d-ddb5116cfefb None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:27:55.014103 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1042/2091] 10.222.0.44 () {60 vars in 1143 bytes} [Thu Jun 16 12:27:54 2022] POST /identity/v3/users => generated 296 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 12:27:55.014591 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4469b305-d5b2-4208-9e7d-211fd95a6a8a admin admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:27:55.015037 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-061402b7-9ad0-479b-958d-ddb5116cfefb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:27:55.017662 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-4469b305-d5b2-4208-9e7d-211fd95a6a8a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:27:55.023198 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1050/2092] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 12:27:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:27:55.024154 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061402b7-9ad0-479b-958d-ddb5116cfefb None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:27:55.035267 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061402b7-9ad0-479b-958d-ddb5116cfefb None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:27:55.041848 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbf208e-c76d-4e58-a13c-68b5157239fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:27:55.042534 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbf208e-c76d-4e58-a13c-68b5157239fa admin admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:55.042817 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbf208e-c76d-4e58-a13c-68b5157239fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:55.043097 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbf208e-c76d-4e58-a13c-68b5157239fa admin admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:55.043847 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbf208e-c76d-4e58-a13c-68b5157239fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:27:55.045529 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbf208e-c76d-4e58-a13c-68b5157239fa admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:27:55.059320 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1051/2093] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 12:27:55 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 12:27:55.060328 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbf208e-c76d-4e58-a13c-68b5157239fa admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:27:55.062979 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:27:55.064213 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-bdbf208e-c76d-4e58-a13c-68b5157239fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:27:55.074721 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:27:55.115436 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4469b305-d5b2-4208-9e7d-211fd95a6a8a admin admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:27:55.121632 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f86179d-8eef-4649-a43d-04a8a5be52a9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edfb12d445e74136b90800e93941f468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '601361df39e34fcca71175aa94e425c4', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:27:55.122294 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f86179d-8eef-4649-a43d-04a8a5be52a9 service nova] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:55.122576 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f86179d-8eef-4649-a43d-04a8a5be52a9 service nova] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:55.122853 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f86179d-8eef-4649-a43d-04a8a5be52a9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:55.131468 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f86179d-8eef-4649-a43d-04a8a5be52a9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:27:55.132620 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbf208e-c76d-4e58-a13c-68b5157239fa admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:27:55.133329 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f86179d-8eef-4649-a43d-04a8a5be52a9 service nova] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:27:55.136248 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf305bfd-4254-4e1b-9b16-c44854ce9eb0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1094729b25a4be7b0b394998c9ca681', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '601361df39e34fcca71175aa94e425c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:27:55.136929 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf305bfd-4254-4e1b-9b16-c44854ce9eb0 service neutron] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:55.137208 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf305bfd-4254-4e1b-9b16-c44854ce9eb0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:55.137481 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf305bfd-4254-4e1b-9b16-c44854ce9eb0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:55.143882 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1043/2094] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 12:27:55 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 12:27:55.144925 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f86179d-8eef-4649-a43d-04a8a5be52a9 service nova] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:27:55.147441 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf305bfd-4254-4e1b-9b16-c44854ce9eb0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:27:55.150595 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf305bfd-4254-4e1b-9b16-c44854ce9eb0 service neutron] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:27:55.156251 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f86179d-8eef-4649-a43d-04a8a5be52a9 service nova] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:27:55.162600 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8b782b-7d63-4b84-8955-152d6e528314 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:27:55.163595 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8b782b-7d63-4b84-8955-152d6e528314 admin admin] REQUEST_METHOD: `PUT` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:55.163879 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8b782b-7d63-4b84-8955-152d6e528314 admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:55.164255 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8b782b-7d63-4b84-8955-152d6e528314 admin admin] PATH_INFO: `/v3/projects/81fe9c2ef932470dbe0ae92f118c7568/users/8dd7bd4c2ccf4cb1a24f7809019fac80/roles/0688968254744e3f9913653cafea3091` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:55.165955 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1052/2095] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 12:27:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 12:27:55.185708 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8b782b-7d63-4b84-8955-152d6e528314 admin admin] RBAC: Authorizing `identity:create_grant(project_id=81fe9c2ef932470dbe0ae92f118c7568, user_id=8dd7bd4c2ccf4cb1a24f7809019fac80, role_id=0688968254744e3f9913653cafea3091)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:27:55.189146 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8b782b-7d63-4b84-8955-152d6e528314 admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:27:55.211468 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1044/2096] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 16 12:27:55 2022] PUT /identity/v3/projects/81fe9c2ef932470dbe0ae92f118c7568/users/8dd7bd4c2ccf4cb1a24f7809019fac80/roles/0688968254744e3f9913653cafea3091 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:27:55.215587 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf305bfd-4254-4e1b-9b16-c44854ce9eb0 service neutron] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:27:55.231818 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf305bfd-4254-4e1b-9b16-c44854ce9eb0 service neutron] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:27:55.354886 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcb67bf-30be-4792-bbe2-8641faffc490 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:27:55.355959 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcb67bf-30be-4792-bbe2-8641faffc490 admin admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:55.356356 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcb67bf-30be-4792-bbe2-8641faffc490 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:55.356642 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcb67bf-30be-4792-bbe2-8641faffc490 admin admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:55.360611 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcb67bf-30be-4792-bbe2-8641faffc490 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:27:55.370616 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcb67bf-30be-4792-bbe2-8641faffc490 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:27:55.388263 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1053/2097] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 12:27:55 2022] GET /identity/v3/roles => generated 1420 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 12:27:55.392531 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8b782b-7d63-4b84-8955-152d6e528314 admin admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:27:55.404369 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8b782b-7d63-4b84-8955-152d6e528314 admin admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:27:55.451877 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6becde-70f7-411e-a2b4-47cde536369e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:27:55.454712 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6becde-70f7-411e-a2b4-47cde536369e admin admin] REQUEST_METHOD: `PUT` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:55.457105 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6becde-70f7-411e-a2b4-47cde536369e admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:55.457544 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6becde-70f7-411e-a2b4-47cde536369e admin admin] PATH_INFO: `/v3/projects/81fe9c2ef932470dbe0ae92f118c7568/users/8dd7bd4c2ccf4cb1a24f7809019fac80/roles/0688968254744e3f9913653cafea3091` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:55.462702 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6becde-70f7-411e-a2b4-47cde536369e admin admin] RBAC: Authorizing `identity:create_grant(project_id=81fe9c2ef932470dbe0ae92f118c7568, user_id=8dd7bd4c2ccf4cb1a24f7809019fac80, role_id=0688968254744e3f9913653cafea3091)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:27:55.477461 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6becde-70f7-411e-a2b4-47cde536369e admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:27:55.521630 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f8e568-6c2a-459d-9d20-a5757e076992 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:55.522073 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f8e568-6c2a-459d-9d20-a5757e076992 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:55.522481 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f8e568-6c2a-459d-9d20-a5757e076992 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:55.530291 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1045/2098] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 16 12:27:55 2022] PUT /identity/v3/projects/81fe9c2ef932470dbe0ae92f118c7568/users/8dd7bd4c2ccf4cb1a24f7809019fac80/roles/0688968254744e3f9913653cafea3091 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:27:55.578149 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-a1f8e568-6c2a-459d-9d20-a5757e076992 None None] MFA Rules not processed for user `8dd7bd4c2ccf4cb1a24f7809019fac80`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:27:55.584453 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-a1f8e568-6c2a-459d-9d20-a5757e076992 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:27:55.742615 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6becde-70f7-411e-a2b4-47cde536369e admin admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:27:55.744888 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-cc6becde-70f7-411e-a2b4-47cde536369e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:27:55.766047 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1054/2099] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 12:27:55 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:27:55.817555 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f8e568-6c2a-459d-9d20-a5757e076992 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:27:55.819075 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-a1f8e568-6c2a-459d-9d20-a5757e076992 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:27:55.874291 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6becde-70f7-411e-a2b4-47cde536369e admin admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:27:55.879743 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd99b20-3cb6-4375-8674-750979add764 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:27:55.880706 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd99b20-3cb6-4375-8674-750979add764 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:55.881088 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd99b20-3cb6-4375-8674-750979add764 admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:55.881477 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd99b20-3cb6-4375-8674-750979add764 admin admin] PATH_INFO: `/v3/projects/5a7e55b1457447139259ebc371636d49` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:55.882784 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd99b20-3cb6-4375-8674-750979add764 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5a7e55b1457447139259ebc371636d49)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:27:55.884884 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd99b20-3cb6-4375-8674-750979add764 admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:27:55.889344 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:27:55.948125 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f8e568-6c2a-459d-9d20-a5757e076992 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:27:55.978231 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-4bd99b20-3cb6-4375-8674-750979add764 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5a7e55b1457447139259ebc371636d49', 'request_id': 'req-4bd99b20-3cb6-4375-8674-750979add764'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:27:56.000634 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-4bd99b20-3cb6-4375-8674-750979add764 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5a7e55b1457447139259ebc371636d49', 'request_id': 'req-4bd99b20-3cb6-4375-8674-750979add764'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:27:56.018282 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-4bd99b20-3cb6-4375-8674-750979add764 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5a7e55b1457447139259ebc371636d49', 'request_id': 'req-4bd99b20-3cb6-4375-8674-750979add764'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:27:56.041617 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-4bd99b20-3cb6-4375-8674-750979add764 admin admin] The token cache is being invalidate because project 5a7e55b1457447139259ebc371636d49 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 12:27:56.042428 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-4bd99b20-3cb6-4375-8674-750979add764 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:27:56.043623 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-4bd99b20-3cb6-4375-8674-750979add764 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:27:56.046521 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1046/2100] 10.222.0.44 () {58 vars in 1232 bytes} [Thu Jun 16 12:27:55 2022] DELETE /identity/v3/projects/5a7e55b1457447139259ebc371636d49 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 12:27:56.052388 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965ab9d5-129d-4299-a588-17db4d6c8f9e None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:56.052983 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965ab9d5-129d-4299-a588-17db4d6c8f9e None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:56.053224 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965ab9d5-129d-4299-a588-17db4d6c8f9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:56.053536 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a22fefe-fe6c-4b33-9346-ca2593111d2f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f96fc14ed89478c8a8c2f11c87511e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '601361df39e34fcca71175aa94e425c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:27:56.054319 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a22fefe-fe6c-4b33-9346-ca2593111d2f service cinder] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:56.054596 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a22fefe-fe6c-4b33-9346-ca2593111d2f service cinder] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:56.054904 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a22fefe-fe6c-4b33-9346-ca2593111d2f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:56.057277 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-8a22fefe-fe6c-4b33-9346-ca2593111d2f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:27:56.062265 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:27:56.083625 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-965ab9d5-129d-4299-a588-17db4d6c8f9e None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:27:56.085625 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-965ab9d5-129d-4299-a588-17db4d6c8f9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:27:56.143027 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a22fefe-fe6c-4b33-9346-ca2593111d2f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:27:56.145786 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a22fefe-fe6c-4b33-9346-ca2593111d2f service cinder] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:27:56.159520 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1055/2101] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 12:27:55 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 12:27:56.210635 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ec429e-0399-4ac5-9d07-0472174d078f None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:56.210996 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ec429e-0399-4ac5-9d07-0472174d078f None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:56.211354 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ec429e-0399-4ac5-9d07-0472174d078f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:56.216930 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1047/2102] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 12:27:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 12:27:56.240185 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-87ec429e-0399-4ac5-9d07-0472174d078f None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:27:56.241687 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-87ec429e-0399-4ac5-9d07-0472174d078f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:27:56.258677 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1056/2103] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 12:27:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 12:27:56.264043 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965ab9d5-129d-4299-a588-17db4d6c8f9e None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:27:56.278592 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965ab9d5-129d-4299-a588-17db4d6c8f9e None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:27:56.283446 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86165bb9-705f-467d-bd96-b6ddf8d1d141 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:27:56.284115 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86165bb9-705f-467d-bd96-b6ddf8d1d141 admin admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:56.284393 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86165bb9-705f-467d-bd96-b6ddf8d1d141 admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:56.284659 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86165bb9-705f-467d-bd96-b6ddf8d1d141 admin admin] PATH_INFO: `/v3/domains` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:56.285706 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86165bb9-705f-467d-bd96-b6ddf8d1d141 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:27:56.286539 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86165bb9-705f-467d-bd96-b6ddf8d1d141 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:27:56.288300 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86165bb9-705f-467d-bd96-b6ddf8d1d141 admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:27:56.304970 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1048/2104] 10.222.0.44 () {58 vars in 1152 bytes} [Thu Jun 16 12:27:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:27:56.306433 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ec429e-0399-4ac5-9d07-0472174d078f None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:27:56.325519 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ec429e-0399-4ac5-9d07-0472174d078f None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:27:56.330768 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff0bd55-f311-4222-8291-ddfec14ba72e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:27:56.331435 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff0bd55-f311-4222-8291-ddfec14ba72e admin admin] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:56.331809 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff0bd55-f311-4222-8291-ddfec14ba72e admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:56.332082 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff0bd55-f311-4222-8291-ddfec14ba72e admin admin] PATH_INFO: `/v3/projects` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:56.333473 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff0bd55-f311-4222-8291-ddfec14ba72e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:27:56.335446 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff0bd55-f311-4222-8291-ddfec14ba72e admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:27:56.370199 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1057/2105] 10.222.0.44 () {60 vars in 1152 bytes} [Thu Jun 16 12:27:56 2022] POST /identity/v3/projects => generated 383 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 12:27:56.372320 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86165bb9-705f-467d-bd96-b6ddf8d1d141 admin admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:27:56.385791 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86165bb9-705f-467d-bd96-b6ddf8d1d141 admin admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:27:56.482670 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e9f50d-0e79-4e92-be52-4daebbefc85e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:27:56.484382 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e9f50d-0e79-4e92-be52-4daebbefc85e admin admin] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:56.484775 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e9f50d-0e79-4e92-be52-4daebbefc85e admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:56.485111 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e9f50d-0e79-4e92-be52-4daebbefc85e admin admin] PATH_INFO: `/v3/users` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:56.486157 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e9f50d-0e79-4e92-be52-4daebbefc85e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:27:56.491066 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e9f50d-0e79-4e92-be52-4daebbefc85e admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:27:56.534602 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1049/2106] 10.222.0.44 () {60 vars in 1143 bytes} [Thu Jun 16 12:27:56 2022] POST /identity/v3/users => generated 292 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 12:27:56.535993 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff0bd55-f311-4222-8291-ddfec14ba72e admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:27:56.547500 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff0bd55-f311-4222-8291-ddfec14ba72e admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:27:56.553810 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018fd637-7c20-489f-b71a-4343dee0b161 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:27:56.554789 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018fd637-7c20-489f-b71a-4343dee0b161 admin admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:56.555070 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018fd637-7c20-489f-b71a-4343dee0b161 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:56.555415 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018fd637-7c20-489f-b71a-4343dee0b161 admin admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:56.556226 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018fd637-7c20-489f-b71a-4343dee0b161 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:27:56.557962 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018fd637-7c20-489f-b71a-4343dee0b161 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:27:56.570691 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1058/2107] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 12:27:56 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 12:27:56.574797 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e9f50d-0e79-4e92-be52-4daebbefc85e admin admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:27:56.587803 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e9f50d-0e79-4e92-be52-4daebbefc85e admin admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:27:56.593425 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8264ecca-df6f-45d2-a17a-7481c0ddfd6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:27:56.594695 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8264ecca-df6f-45d2-a17a-7481c0ddfd6e admin admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:56.594695 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8264ecca-df6f-45d2-a17a-7481c0ddfd6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:56.594945 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8264ecca-df6f-45d2-a17a-7481c0ddfd6e admin admin] PATH_INFO: `/v3/roles` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:56.595929 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8264ecca-df6f-45d2-a17a-7481c0ddfd6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:27:56.597917 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8264ecca-df6f-45d2-a17a-7481c0ddfd6e admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:27:56.611002 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1050/2108] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 12:27:56 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 12:27:56.615889 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018fd637-7c20-489f-b71a-4343dee0b161 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:27:56.629445 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8264ecca-df6f-45d2-a17a-7481c0ddfd6e admin admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:27:56.638758 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018fd637-7c20-489f-b71a-4343dee0b161 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:27:56.650079 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3a42a0-78d1-4573-85ce-0ccf195678c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:27:56.651484 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3a42a0-78d1-4573-85ce-0ccf195678c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:56.651846 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3a42a0-78d1-4573-85ce-0ccf195678c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:56.652162 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3a42a0-78d1-4573-85ce-0ccf195678c2 admin admin] PATH_INFO: `/v3/projects/c2b21e9b99fe418e83448ac975b1262c/users/fc4d60019f15420898e9e5c3a527a0f6/roles/c39882b202e942479a7cdac2fc6da72c` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:56.704152 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3a42a0-78d1-4573-85ce-0ccf195678c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c2b21e9b99fe418e83448ac975b1262c, user_id=fc4d60019f15420898e9e5c3a527a0f6, role_id=c39882b202e942479a7cdac2fc6da72c)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:27:56.710159 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3a42a0-78d1-4573-85ce-0ccf195678c2 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:27:56.738994 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1059/2109] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 16 12:27:56 2022] PUT /identity/v3/projects/c2b21e9b99fe418e83448ac975b1262c/users/fc4d60019f15420898e9e5c3a527a0f6/roles/c39882b202e942479a7cdac2fc6da72c => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:27:56.748166 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43d84ed-794c-49eb-8d05-cbf62ddaa2b6 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:56.748566 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43d84ed-794c-49eb-8d05-cbf62ddaa2b6 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:56.749075 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43d84ed-794c-49eb-8d05-cbf62ddaa2b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:56.755476 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8264ecca-df6f-45d2-a17a-7481c0ddfd6e admin admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:27:56.771210 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:27:56.775303 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-a43d84ed-794c-49eb-8d05-cbf62ddaa2b6 None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:27:56.777861 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-a43d84ed-794c-49eb-8d05-cbf62ddaa2b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:27:56.860854 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:27:56.861275 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6abf31-8dc4-4fd9-8c53-107511467106 tempest-VolumeQuotaClassesTest-835078961 tempest-VolumeQuotaClassesTest-835078961-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8dd7bd4c2ccf4cb1a24f7809019fac80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81fe9c2ef932470dbe0ae92f118c7568', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:27:56.863397 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6abf31-8dc4-4fd9-8c53-107511467106 tempest-VolumeQuotaClassesTest-835078961 tempest-VolumeQuotaClassesTest-835078961-project-admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:56.863693 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6abf31-8dc4-4fd9-8c53-107511467106 tempest-VolumeQuotaClassesTest-835078961 tempest-VolumeQuotaClassesTest-835078961-project-admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:56.863991 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6abf31-8dc4-4fd9-8c53-107511467106 tempest-VolumeQuotaClassesTest-835078961 tempest-VolumeQuotaClassesTest-835078961-project-admin] PATH_INFO: `/v3/domains` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:56.864897 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6abf31-8dc4-4fd9-8c53-107511467106 tempest-VolumeQuotaClassesTest-835078961 tempest-VolumeQuotaClassesTest-835078961-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:27:56.866746 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6abf31-8dc4-4fd9-8c53-107511467106 tempest-VolumeQuotaClassesTest-835078961 tempest-VolumeQuotaClassesTest-835078961-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:27:56.868479 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6abf31-8dc4-4fd9-8c53-107511467106 tempest-VolumeQuotaClassesTest-835078961 tempest-VolumeQuotaClassesTest-835078961-project-admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:27:56.886598 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1051/2110] 10.222.0.44 () {58 vars in 1152 bytes} [Thu Jun 16 12:27:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 12:27:56.898066 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6abf31-8dc4-4fd9-8c53-107511467106 tempest-VolumeQuotaClassesTest-835078961 tempest-VolumeQuotaClassesTest-835078961-project-admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:27:56.925303 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1060/2111] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 12:27:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:27:56.937153 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43d84ed-794c-49eb-8d05-cbf62ddaa2b6 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:27:56.939127 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-a43d84ed-794c-49eb-8d05-cbf62ddaa2b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:27:56.943398 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6abf31-8dc4-4fd9-8c53-107511467106 tempest-VolumeQuotaClassesTest-835078961 tempest-VolumeQuotaClassesTest-835078961-project-admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:27:56.961299 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26717e5-80f5-48a4-ba00-6ae565dbcc55 tempest-VolumeQuotaClassesTest-835078961 tempest-VolumeQuotaClassesTest-835078961-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8dd7bd4c2ccf4cb1a24f7809019fac80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81fe9c2ef932470dbe0ae92f118c7568', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:27:56.962218 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26717e5-80f5-48a4-ba00-6ae565dbcc55 tempest-VolumeQuotaClassesTest-835078961 tempest-VolumeQuotaClassesTest-835078961-project-admin] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:56.962688 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26717e5-80f5-48a4-ba00-6ae565dbcc55 tempest-VolumeQuotaClassesTest-835078961 tempest-VolumeQuotaClassesTest-835078961-project-admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:56.963122 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26717e5-80f5-48a4-ba00-6ae565dbcc55 tempest-VolumeQuotaClassesTest-835078961 tempest-VolumeQuotaClassesTest-835078961-project-admin] PATH_INFO: `/v3/projects` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:56.963983 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26717e5-80f5-48a4-ba00-6ae565dbcc55 tempest-VolumeQuotaClassesTest-835078961 tempest-VolumeQuotaClassesTest-835078961-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:27:56.966288 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26717e5-80f5-48a4-ba00-6ae565dbcc55 tempest-VolumeQuotaClassesTest-835078961 tempest-VolumeQuotaClassesTest-835078961-project-admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:27:57.006042 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1052/2112] 10.222.0.44 () {60 vars in 1152 bytes} [Thu Jun 16 12:27:56 2022] POST /identity/v3/projects => generated 354 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 12:27:57.008504 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26717e5-80f5-48a4-ba00-6ae565dbcc55 tempest-VolumeQuotaClassesTest-835078961 tempest-VolumeQuotaClassesTest-835078961-project-admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:27:57.088783 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43d84ed-794c-49eb-8d05-cbf62ddaa2b6 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:27:57.176238 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26717e5-80f5-48a4-ba00-6ae565dbcc55 tempest-VolumeQuotaClassesTest-835078961 tempest-VolumeQuotaClassesTest-835078961-project-admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:27:57.182641 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cee513-679a-4c45-b6e2-7033644037b9 tempest-VolumeQuotaClassesTest-835078961 tempest-VolumeQuotaClassesTest-835078961-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8dd7bd4c2ccf4cb1a24f7809019fac80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81fe9c2ef932470dbe0ae92f118c7568', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:27:57.183480 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cee513-679a-4c45-b6e2-7033644037b9 tempest-VolumeQuotaClassesTest-835078961 tempest-VolumeQuotaClassesTest-835078961-project-admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:57.183834 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cee513-679a-4c45-b6e2-7033644037b9 tempest-VolumeQuotaClassesTest-835078961 tempest-VolumeQuotaClassesTest-835078961-project-admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:57.184179 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cee513-679a-4c45-b6e2-7033644037b9 tempest-VolumeQuotaClassesTest-835078961 tempest-VolumeQuotaClassesTest-835078961-project-admin] PATH_INFO: `/v3/domains` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:57.185071 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cee513-679a-4c45-b6e2-7033644037b9 tempest-VolumeQuotaClassesTest-835078961 tempest-VolumeQuotaClassesTest-835078961-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:27:57.185495 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cee513-679a-4c45-b6e2-7033644037b9 tempest-VolumeQuotaClassesTest-835078961 tempest-VolumeQuotaClassesTest-835078961-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:27:57.187609 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cee513-679a-4c45-b6e2-7033644037b9 tempest-VolumeQuotaClassesTest-835078961 tempest-VolumeQuotaClassesTest-835078961-project-admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:27:57.189332 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6dd44ad-0968-4961-ab4a-35412e386e83 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1094729b25a4be7b0b394998c9ca681', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '601361df39e34fcca71175aa94e425c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:27:57.190204 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dd44ad-0968-4961-ab4a-35412e386e83 service neutron] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:57.190664 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dd44ad-0968-4961-ab4a-35412e386e83 service neutron] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:57.191265 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dd44ad-0968-4961-ab4a-35412e386e83 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:57.201880 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1053/2113] 10.222.0.44 () {58 vars in 1152 bytes} [Thu Jun 16 12:27:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:27:57.264015 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cee513-679a-4c45-b6e2-7033644037b9 tempest-VolumeQuotaClassesTest-835078961 tempest-VolumeQuotaClassesTest-835078961-project-admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:27:57.277014 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cee513-679a-4c45-b6e2-7033644037b9 tempest-VolumeQuotaClassesTest-835078961 tempest-VolumeQuotaClassesTest-835078961-project-admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:27:57.282851 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a9d510-0b58-4dfb-a681-ee57e16b7559 tempest-VolumeQuotaClassesTest-835078961 tempest-VolumeQuotaClassesTest-835078961-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8dd7bd4c2ccf4cb1a24f7809019fac80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81fe9c2ef932470dbe0ae92f118c7568', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:27:57.287382 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a9d510-0b58-4dfb-a681-ee57e16b7559 tempest-VolumeQuotaClassesTest-835078961 tempest-VolumeQuotaClassesTest-835078961-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:57.287787 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a9d510-0b58-4dfb-a681-ee57e16b7559 tempest-VolumeQuotaClassesTest-835078961 tempest-VolumeQuotaClassesTest-835078961-project-admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:57.288069 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a9d510-0b58-4dfb-a681-ee57e16b7559 tempest-VolumeQuotaClassesTest-835078961 tempest-VolumeQuotaClassesTest-835078961-project-admin] PATH_INFO: `/v3/projects/4df79e90f43946b8aa68ea77d595ba0a` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:57.289429 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a9d510-0b58-4dfb-a681-ee57e16b7559 tempest-VolumeQuotaClassesTest-835078961 tempest-VolumeQuotaClassesTest-835078961-project-admin] RBAC: Authorizing `identity:delete_project(project_id=4df79e90f43946b8aa68ea77d595ba0a)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:27:57.291908 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a9d510-0b58-4dfb-a681-ee57e16b7559 tempest-VolumeQuotaClassesTest-835078961 tempest-VolumeQuotaClassesTest-835078961-project-admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:27:57.361122 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6dd44ad-0968-4961-ab4a-35412e386e83 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:27:57.363911 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6dd44ad-0968-4961-ab4a-35412e386e83 service neutron] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:27:57.381835 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1061/2114] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 12:27:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 445 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 12:27:57.389640 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-79a9d510-0b58-4dfb-a681-ee57e16b7559 tempest-VolumeQuotaClassesTest-835078961 tempest-VolumeQuotaClassesTest-835078961-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4df79e90f43946b8aa68ea77d595ba0a', 'request_id': 'req-79a9d510-0b58-4dfb-a681-ee57e16b7559'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:27:57.402857 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-79a9d510-0b58-4dfb-a681-ee57e16b7559 tempest-VolumeQuotaClassesTest-835078961 tempest-VolumeQuotaClassesTest-835078961-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4df79e90f43946b8aa68ea77d595ba0a', 'request_id': 'req-79a9d510-0b58-4dfb-a681-ee57e16b7559'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:27:57.411917 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-79a9d510-0b58-4dfb-a681-ee57e16b7559 tempest-VolumeQuotaClassesTest-835078961 tempest-VolumeQuotaClassesTest-835078961-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4df79e90f43946b8aa68ea77d595ba0a', 'request_id': 'req-79a9d510-0b58-4dfb-a681-ee57e16b7559'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:27:57.433890 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-79a9d510-0b58-4dfb-a681-ee57e16b7559 tempest-VolumeQuotaClassesTest-835078961 tempest-VolumeQuotaClassesTest-835078961-project-admin] The token cache is being invalidate because project 4df79e90f43946b8aa68ea77d595ba0a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 12:27:57.434185 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-79a9d510-0b58-4dfb-a681-ee57e16b7559 tempest-VolumeQuotaClassesTest-835078961 tempest-VolumeQuotaClassesTest-835078961-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:27:57.434883 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-79a9d510-0b58-4dfb-a681-ee57e16b7559 tempest-VolumeQuotaClassesTest-835078961 tempest-VolumeQuotaClassesTest-835078961-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:27:57.436815 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1054/2115] 10.222.0.44 () {58 vars in 1232 bytes} [Thu Jun 16 12:27:57 2022] DELETE /identity/v3/projects/4df79e90f43946b8aa68ea77d595ba0a => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:27:57.565619 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3571291-516e-4e93-bea5-ba294617dbca None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:57.565915 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3571291-516e-4e93-bea5-ba294617dbca None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:57.566220 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3571291-516e-4e93-bea5-ba294617dbca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:57.587572 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-a3571291-516e-4e93-bea5-ba294617dbca None None] MFA Rules not processed for user `ec95d8dfa98b4d3db7edaad4e37925b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:27:57.589571 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-a3571291-516e-4e93-bea5-ba294617dbca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:27:57.639207 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:27:57.678882 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1062/2116] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 12:27:57 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 12:27:57.739582 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a9d510-0b58-4dfb-a681-ee57e16b7559 tempest-VolumeQuotaClassesTest-835078961 tempest-VolumeQuotaClassesTest-835078961-project-admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:27:57.741516 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-79a9d510-0b58-4dfb-a681-ee57e16b7559 tempest-VolumeQuotaClassesTest-835078961 tempest-VolumeQuotaClassesTest-835078961-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:27:57.749753 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:27:57.836787 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a9d510-0b58-4dfb-a681-ee57e16b7559 tempest-VolumeQuotaClassesTest-835078961 tempest-VolumeQuotaClassesTest-835078961-project-admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:27:57.841971 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecce932-114b-4ae1-aba0-7eb1369d8ae5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:27:57.843160 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecce932-114b-4ae1-aba0-7eb1369d8ae5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:57.843536 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecce932-114b-4ae1-aba0-7eb1369d8ae5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:57.843934 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecce932-114b-4ae1-aba0-7eb1369d8ae5 admin admin] PATH_INFO: `/v3/users/7d939a438a104a5897d08808991524e3` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:57.845927 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ecce932-114b-4ae1-aba0-7eb1369d8ae5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7d939a438a104a5897d08808991524e3)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:27:57.848256 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ecce932-114b-4ae1-aba0-7eb1369d8ae5 admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:27:57.944675 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-3ecce932-114b-4ae1-aba0-7eb1369d8ae5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7d939a438a104a5897d08808991524e3'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:27:57.974209 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-3ecce932-114b-4ae1-aba0-7eb1369d8ae5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7d939a438a104a5897d08808991524e3'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:27:57.986086 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-3ecce932-114b-4ae1-aba0-7eb1369d8ae5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7d939a438a104a5897d08808991524e3'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:27:57.987258 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-3ecce932-114b-4ae1-aba0-7eb1369d8ae5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7d939a438a104a5897d08808991524e3'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:27:57.988010 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-3ecce932-114b-4ae1-aba0-7eb1369d8ae5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7d939a438a104a5897d08808991524e3'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:27:58.005727 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1055/2117] 10.222.0.44 () {58 vars in 1223 bytes} [Thu Jun 16 12:27:57 2022] DELETE /identity/v3/users/7d939a438a104a5897d08808991524e3 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:27:58.011214 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240fc068-e4b4-4af9-964f-cd299d4a7df7 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:58.011706 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240fc068-e4b4-4af9-964f-cd299d4a7df7 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:58.011859 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240fc068-e4b4-4af9-964f-cd299d4a7df7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:58.043727 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-240fc068-e4b4-4af9-964f-cd299d4a7df7 None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:27:58.045297 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-240fc068-e4b4-4af9-964f-cd299d4a7df7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:27:58.131196 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1063/2118] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 12:27:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:27:58.149473 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecce932-114b-4ae1-aba0-7eb1369d8ae5 admin admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:27:58.150915 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-3ecce932-114b-4ae1-aba0-7eb1369d8ae5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:27:58.263333 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264cb386-04f9-461f-8d49-0c98b72479b5 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:58.263735 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264cb386-04f9-461f-8d49-0c98b72479b5 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:58.264120 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264cb386-04f9-461f-8d49-0c98b72479b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:58.265959 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecce932-114b-4ae1-aba0-7eb1369d8ae5 admin admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:27:58.270759 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7172fae6-cdde-487b-837b-ebcc80a3a5bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1094729b25a4be7b0b394998c9ca681', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '601361df39e34fcca71175aa94e425c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:27:58.271643 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7172fae6-cdde-487b-837b-ebcc80a3a5bc service neutron] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:58.272065 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7172fae6-cdde-487b-837b-ebcc80a3a5bc service neutron] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:58.272698 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7172fae6-cdde-487b-837b-ebcc80a3a5bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:58.291925 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7172fae6-cdde-487b-837b-ebcc80a3a5bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:27:58.293526 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7172fae6-cdde-487b-837b-ebcc80a3a5bc service neutron] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:27:58.315973 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-264cb386-04f9-461f-8d49-0c98b72479b5 None None] MFA Rules not processed for user `fc4d60019f15420898e9e5c3a527a0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:27:58.318510 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-264cb386-04f9-461f-8d49-0c98b72479b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:27:58.325333 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1056/2119] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 12:27:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 12:27:58.469647 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1064/2120] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 12:27:58 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 12:27:58.484808 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7172fae6-cdde-487b-837b-ebcc80a3a5bc service neutron] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:27:58.491620 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-7172fae6-cdde-487b-837b-ebcc80a3a5bc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:27:58.573428 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:27:58.623424 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7172fae6-cdde-487b-837b-ebcc80a3a5bc service neutron] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:27:58.630295 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426f8d97-24c8-42e6-89d6-f3fdfca62658 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f96fc14ed89478c8a8c2f11c87511e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '601361df39e34fcca71175aa94e425c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:27:58.631293 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426f8d97-24c8-42e6-89d6-f3fdfca62658 service cinder] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:58.631859 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426f8d97-24c8-42e6-89d6-f3fdfca62658 service cinder] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:58.632361 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426f8d97-24c8-42e6-89d6-f3fdfca62658 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:58.651829 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426f8d97-24c8-42e6-89d6-f3fdfca62658 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:27:58.653687 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426f8d97-24c8-42e6-89d6-f3fdfca62658 service cinder] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:27:58.709384 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1057/2121] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 12:27:58 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 12:27:58.986878 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264cb386-04f9-461f-8d49-0c98b72479b5 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:27:58.989531 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-264cb386-04f9-461f-8d49-0c98b72479b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:27:59.012114 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264cb386-04f9-461f-8d49-0c98b72479b5 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:27:59.020889 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c398de29-623f-48b7-8e2c-1f44e946c54b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:27:59.022011 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c398de29-623f-48b7-8e2c-1f44e946c54b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:59.022443 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c398de29-623f-48b7-8e2c-1f44e946c54b admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:59.022908 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c398de29-623f-48b7-8e2c-1f44e946c54b admin admin] PATH_INFO: `/v3/projects/ff4b27922238477f960849fa9b959dce` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:59.024560 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c398de29-623f-48b7-8e2c-1f44e946c54b admin admin] RBAC: Authorizing `identity:delete_project(project_id=ff4b27922238477f960849fa9b959dce)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:27:59.028191 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c398de29-623f-48b7-8e2c-1f44e946c54b admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:27:59.106004 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-c398de29-623f-48b7-8e2c-1f44e946c54b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ff4b27922238477f960849fa9b959dce', 'request_id': 'req-c398de29-623f-48b7-8e2c-1f44e946c54b'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:27:59.121669 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-c398de29-623f-48b7-8e2c-1f44e946c54b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ff4b27922238477f960849fa9b959dce', 'request_id': 'req-c398de29-623f-48b7-8e2c-1f44e946c54b'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:27:59.131363 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-c398de29-623f-48b7-8e2c-1f44e946c54b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ff4b27922238477f960849fa9b959dce', 'request_id': 'req-c398de29-623f-48b7-8e2c-1f44e946c54b'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:27:59.148528 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:27:59.154632 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-c398de29-623f-48b7-8e2c-1f44e946c54b admin admin] The token cache is being invalidate because project ff4b27922238477f960849fa9b959dce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 12:27:59.155458 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-c398de29-623f-48b7-8e2c-1f44e946c54b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:27:59.156471 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-c398de29-623f-48b7-8e2c-1f44e946c54b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:27:59.164500 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426f8d97-24c8-42e6-89d6-f3fdfca62658 service cinder] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:27:59.166896 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1065/2122] 10.222.0.44 () {58 vars in 1232 bytes} [Thu Jun 16 12:27:58 2022] DELETE /identity/v3/projects/ff4b27922238477f960849fa9b959dce => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:27:59.178470 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426f8d97-24c8-42e6-89d6-f3fdfca62658 service cinder] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:27:59.264879 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7475b7-05d5-486d-8446-4fe2d35fbd30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:27:59.266385 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7475b7-05d5-486d-8446-4fe2d35fbd30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:59.266739 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7475b7-05d5-486d-8446-4fe2d35fbd30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:59.267110 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7475b7-05d5-486d-8446-4fe2d35fbd30 admin admin] PATH_INFO: `/v3/users/8dd7bd4c2ccf4cb1a24f7809019fac80` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:59.272791 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7475b7-05d5-486d-8446-4fe2d35fbd30 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8dd7bd4c2ccf4cb1a24f7809019fac80)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:27:59.272791 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7475b7-05d5-486d-8446-4fe2d35fbd30 admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:27:59.389313 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-5c7475b7-05d5-486d-8446-4fe2d35fbd30 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8dd7bd4c2ccf4cb1a24f7809019fac80'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:27:59.411292 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-5c7475b7-05d5-486d-8446-4fe2d35fbd30 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8dd7bd4c2ccf4cb1a24f7809019fac80'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:27:59.421169 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-5c7475b7-05d5-486d-8446-4fe2d35fbd30 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8dd7bd4c2ccf4cb1a24f7809019fac80'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:27:59.422194 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-5c7475b7-05d5-486d-8446-4fe2d35fbd30 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8dd7bd4c2ccf4cb1a24f7809019fac80'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:27:59.423141 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-5c7475b7-05d5-486d-8446-4fe2d35fbd30 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8dd7bd4c2ccf4cb1a24f7809019fac80'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:27:59.442640 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1058/2123] 10.222.0.44 () {58 vars in 1223 bytes} [Thu Jun 16 12:27:59 2022] DELETE /identity/v3/users/8dd7bd4c2ccf4cb1a24f7809019fac80 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:27:59.776489 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c398de29-623f-48b7-8e2c-1f44e946c54b admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:27:59.778387 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-c398de29-623f-48b7-8e2c-1f44e946c54b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:27:59.793389 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c398de29-623f-48b7-8e2c-1f44e946c54b admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:27:59.859593 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa020139-0074-4900-81e3-83f22b5b43c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:27:59.860464 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa020139-0074-4900-81e3-83f22b5b43c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:59.860769 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa020139-0074-4900-81e3-83f22b5b43c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:59.861059 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa020139-0074-4900-81e3-83f22b5b43c1 admin admin] PATH_INFO: `/v3/projects/81fe9c2ef932470dbe0ae92f118c7568` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:59.862273 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa020139-0074-4900-81e3-83f22b5b43c1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=81fe9c2ef932470dbe0ae92f118c7568)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:27:59.864736 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa020139-0074-4900-81e3-83f22b5b43c1 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:27:59.917299 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-aa020139-0074-4900-81e3-83f22b5b43c1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '81fe9c2ef932470dbe0ae92f118c7568', 'request_id': 'req-aa020139-0074-4900-81e3-83f22b5b43c1'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:27:59.931386 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-aa020139-0074-4900-81e3-83f22b5b43c1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '81fe9c2ef932470dbe0ae92f118c7568', 'request_id': 'req-aa020139-0074-4900-81e3-83f22b5b43c1'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:27:59.943401 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-aa020139-0074-4900-81e3-83f22b5b43c1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '81fe9c2ef932470dbe0ae92f118c7568', 'request_id': 'req-aa020139-0074-4900-81e3-83f22b5b43c1'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:27:59.955517 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-aa020139-0074-4900-81e3-83f22b5b43c1 admin admin] The token cache is being invalidate because project 81fe9c2ef932470dbe0ae92f118c7568 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 12:27:59.955807 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-aa020139-0074-4900-81e3-83f22b5b43c1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:27:59.956491 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-aa020139-0074-4900-81e3-83f22b5b43c1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:27:59.958415 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1066/2124] 10.222.0.44 () {58 vars in 1232 bytes} [Thu Jun 16 12:27:59 2022] DELETE /identity/v3/projects/81fe9c2ef932470dbe0ae92f118c7568 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:27:59.963317 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3e97fc-40a7-4974-bdde-5463493dc140 None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:27:59.963973 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3e97fc-40a7-4974-bdde-5463493dc140 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:27:59.964445 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3e97fc-40a7-4974-bdde-5463493dc140 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:27:59.995882 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-4a3e97fc-40a7-4974-bdde-5463493dc140 None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:27:59.998112 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-4a3e97fc-40a7-4974-bdde-5463493dc140 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:28:00.046889 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:28:00.072223 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1059/2125] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 12:27:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 12:28:00.080329 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1421bdf0-b950-4b15-80b5-6878a5d1eb44 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:28:00.081849 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1421bdf0-b950-4b15-80b5-6878a5d1eb44 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:28:00.082301 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1421bdf0-b950-4b15-80b5-6878a5d1eb44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:28:00.105755 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-1421bdf0-b950-4b15-80b5-6878a5d1eb44 None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:28:00.106983 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-1421bdf0-b950-4b15-80b5-6878a5d1eb44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:28:00.120962 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1067/2126] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 12:28:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:28:00.126029 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3e97fc-40a7-4974-bdde-5463493dc140 None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:28:00.139526 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3e97fc-40a7-4974-bdde-5463493dc140 None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:28:00.153275 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5acda4-924c-454b-9240-e0940d0a836a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:28:00.154181 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5acda4-924c-454b-9240-e0940d0a836a admin admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:28:00.154537 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5acda4-924c-454b-9240-e0940d0a836a admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:28:00.154887 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5acda4-924c-454b-9240-e0940d0a836a admin admin] PATH_INFO: `/v3/domains` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:28:00.155745 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5acda4-924c-454b-9240-e0940d0a836a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:28:00.156116 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5acda4-924c-454b-9240-e0940d0a836a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:28:00.157920 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5acda4-924c-454b-9240-e0940d0a836a admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:28:00.174690 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1060/2127] 10.222.0.44 () {58 vars in 1152 bytes} [Thu Jun 16 12:28:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:28:00.177579 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1421bdf0-b950-4b15-80b5-6878a5d1eb44 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:28:00.187995 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1421bdf0-b950-4b15-80b5-6878a5d1eb44 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:28:00.198903 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e710ac-8f52-4fe4-8ffa-54d2edbc4d43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:28:00.199774 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e710ac-8f52-4fe4-8ffa-54d2edbc4d43 admin admin] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:28:00.200296 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e710ac-8f52-4fe4-8ffa-54d2edbc4d43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:28:00.200711 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e710ac-8f52-4fe4-8ffa-54d2edbc4d43 admin admin] PATH_INFO: `/v3/projects` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:28:00.201673 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e710ac-8f52-4fe4-8ffa-54d2edbc4d43 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:28:00.204403 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e710ac-8f52-4fe4-8ffa-54d2edbc4d43 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:28:00.243190 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1068/2128] 10.222.0.44 () {60 vars in 1152 bytes} [Thu Jun 16 12:28:00 2022] POST /identity/v3/projects => generated 385 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 12:28:00.247225 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5acda4-924c-454b-9240-e0940d0a836a admin admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:28:00.260189 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5acda4-924c-454b-9240-e0940d0a836a admin admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:28:00.334737 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a6e9ae-adde-454e-ba8e-fbeaab87c215 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:28:00.335410 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a6e9ae-adde-454e-ba8e-fbeaab87c215 admin admin] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:28:00.335691 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a6e9ae-adde-454e-ba8e-fbeaab87c215 admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:28:00.335965 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a6e9ae-adde-454e-ba8e-fbeaab87c215 admin admin] PATH_INFO: `/v3/users` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:28:00.336672 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a6e9ae-adde-454e-ba8e-fbeaab87c215 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:28:00.338643 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a6e9ae-adde-454e-ba8e-fbeaab87c215 admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:28:00.358990 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1061/2129] 10.222.0.44 () {60 vars in 1143 bytes} [Thu Jun 16 12:28:00 2022] POST /identity/v3/users => generated 293 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 12:28:00.363056 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e710ac-8f52-4fe4-8ffa-54d2edbc4d43 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:28:00.373179 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e710ac-8f52-4fe4-8ffa-54d2edbc4d43 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:28:00.377714 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df6fc0e-e030-4a06-bcbb-275769573f05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:28:00.378363 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df6fc0e-e030-4a06-bcbb-275769573f05 admin admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:28:00.378643 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df6fc0e-e030-4a06-bcbb-275769573f05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:28:00.378917 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df6fc0e-e030-4a06-bcbb-275769573f05 admin admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:28:00.380149 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df6fc0e-e030-4a06-bcbb-275769573f05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:28:00.381778 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df6fc0e-e030-4a06-bcbb-275769573f05 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:28:00.395021 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1069/2130] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 12:28:00 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 12:28:00.397321 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a6e9ae-adde-454e-ba8e-fbeaab87c215 admin admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:28:00.407789 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a6e9ae-adde-454e-ba8e-fbeaab87c215 admin admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:28:00.412876 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88ba7d5-ce3a-4e90-9dde-dec8ebc3ce1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:28:00.413532 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88ba7d5-ce3a-4e90-9dde-dec8ebc3ce1d admin admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:28:00.413804 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88ba7d5-ce3a-4e90-9dde-dec8ebc3ce1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:28:00.414079 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88ba7d5-ce3a-4e90-9dde-dec8ebc3ce1d admin admin] PATH_INFO: `/v3/roles` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:28:00.414860 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88ba7d5-ce3a-4e90-9dde-dec8ebc3ce1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:28:00.416551 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88ba7d5-ce3a-4e90-9dde-dec8ebc3ce1d admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:28:00.427009 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1062/2131] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 12:28:00 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 12:28:00.431127 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df6fc0e-e030-4a06-bcbb-275769573f05 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:28:00.447502 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df6fc0e-e030-4a06-bcbb-275769573f05 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:28:00.449507 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e522858-7186-4938-aef2-0a642a9db6e6 None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:28:00.449879 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e522858-7186-4938-aef2-0a642a9db6e6 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:28:00.450247 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e522858-7186-4938-aef2-0a642a9db6e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:28:00.453203 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe00eda-6722-42d8-83b2-2443591f96c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:28:00.454092 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe00eda-6722-42d8-83b2-2443591f96c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:28:00.454366 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe00eda-6722-42d8-83b2-2443591f96c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:28:00.454829 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe00eda-6722-42d8-83b2-2443591f96c3 admin admin] PATH_INFO: `/v3/projects/f65997ac695e400fbb6f02cf5841362c/users/43556b1b18974e909cc7f381fe08aa74/roles/c39882b202e942479a7cdac2fc6da72c` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:28:00.471965 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-9e522858-7186-4938-aef2-0a642a9db6e6 None None] MFA Rules not processed for user `fc4d60019f15420898e9e5c3a527a0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:28:00.473354 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-9e522858-7186-4938-aef2-0a642a9db6e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:28:00.479991 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe00eda-6722-42d8-83b2-2443591f96c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f65997ac695e400fbb6f02cf5841362c, user_id=43556b1b18974e909cc7f381fe08aa74, role_id=c39882b202e942479a7cdac2fc6da72c)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:28:00.484064 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe00eda-6722-42d8-83b2-2443591f96c3 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:28:00.509462 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1070/2132] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 16 12:28:00 2022] PUT /identity/v3/projects/f65997ac695e400fbb6f02cf5841362c/users/43556b1b18974e909cc7f381fe08aa74/roles/c39882b202e942479a7cdac2fc6da72c => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:28:00.523003 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4148f136-1b4e-4631-a670-b5c5cd0d3da8 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:28:00.523572 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4148f136-1b4e-4631-a670-b5c5cd0d3da8 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:28:00.524047 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4148f136-1b4e-4631-a670-b5c5cd0d3da8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:28:00.573054 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-4148f136-1b4e-4631-a670-b5c5cd0d3da8 None None] MFA Rules not processed for user `43556b1b18974e909cc7f381fe08aa74`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:28:00.574721 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-4148f136-1b4e-4631-a670-b5c5cd0d3da8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:28:00.588787 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1063/2133] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 12:28:00 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 12:28:00.596455 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:28:00.704008 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1071/2134] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 12:28:00 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:28:00.707307 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e522858-7186-4938-aef2-0a642a9db6e6 None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:28:00.719762 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e522858-7186-4938-aef2-0a642a9db6e6 None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:28:00.800282 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16a9fa5-4ff9-42a6-9c0d-2cbff8c8e7d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:28:00.800995 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16a9fa5-4ff9-42a6-9c0d-2cbff8c8e7d6 admin admin] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:28:00.801814 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16a9fa5-4ff9-42a6-9c0d-2cbff8c8e7d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:28:00.802089 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16a9fa5-4ff9-42a6-9c0d-2cbff8c8e7d6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:28:00.802801 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16a9fa5-4ff9-42a6-9c0d-2cbff8c8e7d6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:28:00.805387 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16a9fa5-4ff9-42a6-9c0d-2cbff8c8e7d6 admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:28:00.809313 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:28:00.842284 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1064/2135] 10.222.0.44 () {60 vars in 1152 bytes} [Thu Jun 16 12:28:00 2022] POST /identity/v3/projects => generated 385 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 12:28:00.845281 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4148f136-1b4e-4631-a670-b5c5cd0d3da8 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:28:00.855584 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4148f136-1b4e-4631-a670-b5c5cd0d3da8 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:28:00.919039 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6874c0c-1c90-4890-8a29-6983a7b119b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:28:00.919762 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6874c0c-1c90-4890-8a29-6983a7b119b4 admin admin] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:28:00.920048 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6874c0c-1c90-4890-8a29-6983a7b119b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:28:00.920339 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6874c0c-1c90-4890-8a29-6983a7b119b4 admin admin] PATH_INFO: `/v3/users` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:28:00.921082 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6874c0c-1c90-4890-8a29-6983a7b119b4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:28:00.923065 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6874c0c-1c90-4890-8a29-6983a7b119b4 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:28:00.944844 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1072/2136] 10.222.0.44 () {60 vars in 1143 bytes} [Thu Jun 16 12:28:00 2022] POST /identity/v3/users => generated 293 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 12:28:00.948762 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16a9fa5-4ff9-42a6-9c0d-2cbff8c8e7d6 admin admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:28:00.959093 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16a9fa5-4ff9-42a6-9c0d-2cbff8c8e7d6 admin admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:28:00.963666 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73f9db1-dfb8-486f-8b40-75c1f8025d1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:28:00.964316 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73f9db1-dfb8-486f-8b40-75c1f8025d1b admin admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:28:00.964599 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73f9db1-dfb8-486f-8b40-75c1f8025d1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:28:00.964909 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73f9db1-dfb8-486f-8b40-75c1f8025d1b admin admin] PATH_INFO: `/v3/roles` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:28:00.965638 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73f9db1-dfb8-486f-8b40-75c1f8025d1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:28:00.967230 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73f9db1-dfb8-486f-8b40-75c1f8025d1b admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:28:00.978159 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1065/2137] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 12:28:00 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 12:28:00.981958 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6874c0c-1c90-4890-8a29-6983a7b119b4 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:28:00.992365 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6874c0c-1c90-4890-8a29-6983a7b119b4 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:28:00.996986 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5022c2a5-86c5-4517-8114-e1a05be97df3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:28:00.997640 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5022c2a5-86c5-4517-8114-e1a05be97df3 admin admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:28:00.997927 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5022c2a5-86c5-4517-8114-e1a05be97df3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:28:00.998198 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5022c2a5-86c5-4517-8114-e1a05be97df3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:28:00.998920 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5022c2a5-86c5-4517-8114-e1a05be97df3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:28:01.000558 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5022c2a5-86c5-4517-8114-e1a05be97df3 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:28:01.011036 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1073/2138] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 12:28:00 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 12:28:01.015643 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73f9db1-dfb8-486f-8b40-75c1f8025d1b admin admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:28:01.025685 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73f9db1-dfb8-486f-8b40-75c1f8025d1b admin admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:28:01.030266 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5cada0-047a-4106-862e-50f368222592 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:28:01.031143 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5cada0-047a-4106-862e-50f368222592 admin admin] REQUEST_METHOD: `PUT` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:28:01.031427 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5cada0-047a-4106-862e-50f368222592 admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:28:01.031705 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5cada0-047a-4106-862e-50f368222592 admin admin] PATH_INFO: `/v3/projects/a06e7c8e492c46f5ac3b5baa68b8fe68/users/4a55208afcf242cc9daa5420505e4d16/roles/c39882b202e942479a7cdac2fc6da72c` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:28:01.046826 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5cada0-047a-4106-862e-50f368222592 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a06e7c8e492c46f5ac3b5baa68b8fe68, user_id=4a55208afcf242cc9daa5420505e4d16, role_id=c39882b202e942479a7cdac2fc6da72c)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:28:01.049521 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5cada0-047a-4106-862e-50f368222592 admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:28:01.062452 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1066/2139] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 16 12:28:01 2022] PUT /identity/v3/projects/a06e7c8e492c46f5ac3b5baa68b8fe68/users/4a55208afcf242cc9daa5420505e4d16/roles/c39882b202e942479a7cdac2fc6da72c => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:28:01.072678 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcda273-f916-4370-9484-b35d7043c5d2 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:28:01.073043 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcda273-f916-4370-9484-b35d7043c5d2 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:28:01.073341 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcda273-f916-4370-9484-b35d7043c5d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:28:01.101948 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-5fcda273-f916-4370-9484-b35d7043c5d2 None None] MFA Rules not processed for user `4a55208afcf242cc9daa5420505e4d16`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:28:01.103165 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-5fcda273-f916-4370-9484-b35d7043c5d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:28:01.168369 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1074/2140] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 12:28:01 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:28:01.172937 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5cada0-047a-4106-862e-50f368222592 admin admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:28:01.242197 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5cada0-047a-4106-862e-50f368222592 admin admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:28:01.246887 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8958a222-755e-4914-8462-fe7b9bc7e25d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:28:01.247542 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8958a222-755e-4914-8462-fe7b9bc7e25d admin admin] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:28:01.247824 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8958a222-755e-4914-8462-fe7b9bc7e25d admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:28:01.248097 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8958a222-755e-4914-8462-fe7b9bc7e25d admin admin] PATH_INFO: `/v3/projects` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:28:01.248811 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8958a222-755e-4914-8462-fe7b9bc7e25d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:28:01.250716 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8958a222-755e-4914-8462-fe7b9bc7e25d admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:28:01.278268 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1067/2141] 10.222.0.44 () {60 vars in 1152 bytes} [Thu Jun 16 12:28:01 2022] POST /identity/v3/projects => generated 387 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 12:28:01.282310 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcda273-f916-4370-9484-b35d7043c5d2 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:28:01.293977 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcda273-f916-4370-9484-b35d7043c5d2 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:28:01.315457 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:28:01.360343 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e59c8d1-a7d2-4a10-bc87-bf289e0ce0ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:28:01.361044 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e59c8d1-a7d2-4a10-bc87-bf289e0ce0ba admin admin] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:28:01.361324 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e59c8d1-a7d2-4a10-bc87-bf289e0ce0ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:28:01.361593 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e59c8d1-a7d2-4a10-bc87-bf289e0ce0ba admin admin] PATH_INFO: `/v3/users` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:28:01.362291 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e59c8d1-a7d2-4a10-bc87-bf289e0ce0ba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:28:01.364257 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e59c8d1-a7d2-4a10-bc87-bf289e0ce0ba admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:28:01.387682 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1075/2142] 10.222.0.44 () {60 vars in 1143 bytes} [Thu Jun 16 12:28:01 2022] POST /identity/v3/users => generated 300 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 12:28:01.391716 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8958a222-755e-4914-8462-fe7b9bc7e25d admin admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:28:01.406303 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8958a222-755e-4914-8462-fe7b9bc7e25d admin admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:28:01.412469 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9aa84d7-541a-4820-8de0-fe971dc75726 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:28:01.413161 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9aa84d7-541a-4820-8de0-fe971dc75726 admin admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:28:01.413448 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9aa84d7-541a-4820-8de0-fe971dc75726 admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:28:01.413723 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9aa84d7-541a-4820-8de0-fe971dc75726 admin admin] PATH_INFO: `/v3/roles` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:28:01.414455 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9aa84d7-541a-4820-8de0-fe971dc75726 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:28:01.416051 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9aa84d7-541a-4820-8de0-fe971dc75726 admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:28:01.427374 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1068/2143] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 12:28:01 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 12:28:01.431897 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e59c8d1-a7d2-4a10-bc87-bf289e0ce0ba admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:28:01.442851 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e59c8d1-a7d2-4a10-bc87-bf289e0ce0ba admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:28:01.447650 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f0e69a-8ba4-4f09-9ff0-cf18bbde08c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:28:01.448525 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f0e69a-8ba4-4f09-9ff0-cf18bbde08c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:28:01.448836 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f0e69a-8ba4-4f09-9ff0-cf18bbde08c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:28:01.449109 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f0e69a-8ba4-4f09-9ff0-cf18bbde08c4 admin admin] PATH_INFO: `/v3/projects/da243e5b46c947be90eb6040516d9e40/users/f011dc7141b549eb9917f807fc8d1a99/roles/0688968254744e3f9913653cafea3091` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:28:01.467327 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f0e69a-8ba4-4f09-9ff0-cf18bbde08c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=da243e5b46c947be90eb6040516d9e40, user_id=f011dc7141b549eb9917f807fc8d1a99, role_id=0688968254744e3f9913653cafea3091)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:28:01.470018 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f0e69a-8ba4-4f09-9ff0-cf18bbde08c4 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:28:01.483565 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1076/2144] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 16 12:28:01 2022] PUT /identity/v3/projects/da243e5b46c947be90eb6040516d9e40/users/f011dc7141b549eb9917f807fc8d1a99/roles/0688968254744e3f9913653cafea3091 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:28:01.488033 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9aa84d7-541a-4820-8de0-fe971dc75726 admin admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:28:01.498058 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9aa84d7-541a-4820-8de0-fe971dc75726 admin admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:28:01.578171 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1cb322-2933-4b7d-bdaf-afb9e39a8f02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:28:01.578840 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1cb322-2933-4b7d-bdaf-afb9e39a8f02 admin admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:28:01.579124 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1cb322-2933-4b7d-bdaf-afb9e39a8f02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:28:01.579401 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1cb322-2933-4b7d-bdaf-afb9e39a8f02 admin admin] PATH_INFO: `/v3/roles` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:28:01.580142 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1cb322-2933-4b7d-bdaf-afb9e39a8f02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:28:01.581810 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1cb322-2933-4b7d-bdaf-afb9e39a8f02 admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:28:01.592134 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1069/2145] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 12:28:01 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 12:28:01.596275 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f0e69a-8ba4-4f09-9ff0-cf18bbde08c4 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:28:01.607132 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f0e69a-8ba4-4f09-9ff0-cf18bbde08c4 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:28:01.612286 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b31afa-b4a5-475a-96a1-1c06c789df77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:28:01.613382 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b31afa-b4a5-475a-96a1-1c06c789df77 admin admin] REQUEST_METHOD: `PUT` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:28:01.613564 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b31afa-b4a5-475a-96a1-1c06c789df77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:28:01.613845 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b31afa-b4a5-475a-96a1-1c06c789df77 admin admin] PATH_INFO: `/v3/projects/da243e5b46c947be90eb6040516d9e40/users/f011dc7141b549eb9917f807fc8d1a99/roles/0688968254744e3f9913653cafea3091` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:28:01.615911 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b31afa-b4a5-475a-96a1-1c06c789df77 admin admin] RBAC: Authorizing `identity:create_grant(project_id=da243e5b46c947be90eb6040516d9e40, user_id=f011dc7141b549eb9917f807fc8d1a99, role_id=0688968254744e3f9913653cafea3091)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:28:01.618637 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b31afa-b4a5-475a-96a1-1c06c789df77 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:28:01.629401 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1077/2146] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 16 12:28:01 2022] PUT /identity/v3/projects/da243e5b46c947be90eb6040516d9e40/users/f011dc7141b549eb9917f807fc8d1a99/roles/0688968254744e3f9913653cafea3091 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 12:28:01.639801 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33dd663-4e84-4f09-9e55-181cc4ba05ac None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:28:01.640094 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33dd663-4e84-4f09-9e55-181cc4ba05ac None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:28:01.640373 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33dd663-4e84-4f09-9e55-181cc4ba05ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:28:01.669283 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-f33dd663-4e84-4f09-9e55-181cc4ba05ac None None] MFA Rules not processed for user `f011dc7141b549eb9917f807fc8d1a99`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:28:01.670513 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-f33dd663-4e84-4f09-9e55-181cc4ba05ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:28:01.678873 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:28:01.742072 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1070/2147] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 12:28:01 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:28:01.753435 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b31afa-b4a5-475a-96a1-1c06c789df77 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:28:01.755769 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-62b31afa-b4a5-475a-96a1-1c06c789df77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:28:01.815268 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b31afa-b4a5-475a-96a1-1c06c789df77 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:28:01.819429 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278f9e15-18ed-4189-80ff-d7b7f66decb6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f96fc14ed89478c8a8c2f11c87511e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '601361df39e34fcca71175aa94e425c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:28:01.820067 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278f9e15-18ed-4189-80ff-d7b7f66decb6 service cinder] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:28:01.820349 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278f9e15-18ed-4189-80ff-d7b7f66decb6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:28:01.820622 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278f9e15-18ed-4189-80ff-d7b7f66decb6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:28:01.829726 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278f9e15-18ed-4189-80ff-d7b7f66decb6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:28:01.831185 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278f9e15-18ed-4189-80ff-d7b7f66decb6 service cinder] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:28:01.841277 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1078/2148] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 12:28:01 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 12:28:02.448105 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33dd663-4e84-4f09-9e55-181cc4ba05ac None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:28:02.461743 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33dd663-4e84-4f09-9e55-181cc4ba05ac None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:28:02.465608 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d6177d-e784-4885-a6e8-2f288fc8dab3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f96fc14ed89478c8a8c2f11c87511e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '601361df39e34fcca71175aa94e425c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:28:02.466390 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d6177d-e784-4885-a6e8-2f288fc8dab3 service cinder] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:28:02.466775 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d6177d-e784-4885-a6e8-2f288fc8dab3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:28:02.467206 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d6177d-e784-4885-a6e8-2f288fc8dab3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:28:02.538686 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d6177d-e784-4885-a6e8-2f288fc8dab3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:28:02.540843 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d6177d-e784-4885-a6e8-2f288fc8dab3 service cinder] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:28:02.552116 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1071/2149] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 12:28:02 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 12:28:07.117822 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278f9e15-18ed-4189-80ff-d7b7f66decb6 service cinder] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:28:07.126747 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278f9e15-18ed-4189-80ff-d7b7f66decb6 service cinder] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:28:07.132396 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84849ba2-ec2d-4525-900c-7cfa558fa0af service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f96fc14ed89478c8a8c2f11c87511e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '601361df39e34fcca71175aa94e425c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:28:07.133141 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84849ba2-ec2d-4525-900c-7cfa558fa0af service cinder] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:28:07.133596 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84849ba2-ec2d-4525-900c-7cfa558fa0af service cinder] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:28:07.133943 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84849ba2-ec2d-4525-900c-7cfa558fa0af service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:28:07.223461 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84849ba2-ec2d-4525-900c-7cfa558fa0af service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:28:07.225206 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84849ba2-ec2d-4525-900c-7cfa558fa0af service cinder] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:28:07.252027 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1079/2150] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 12:28:07 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 12:28:09.793290 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d6177d-e784-4885-a6e8-2f288fc8dab3 service cinder] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:28:09.856807 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d6177d-e784-4885-a6e8-2f288fc8dab3 service cinder] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:28:09.861323 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86039451-236c-4a06-a8a3-181c68dcf382 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:28:09.862213 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86039451-236c-4a06-a8a3-181c68dcf382 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:28:09.862491 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86039451-236c-4a06-a8a3-181c68dcf382 admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:28:09.862763 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86039451-236c-4a06-a8a3-181c68dcf382 admin admin] PATH_INFO: `/v3/users/43556b1b18974e909cc7f381fe08aa74` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:28:09.863969 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86039451-236c-4a06-a8a3-181c68dcf382 admin admin] RBAC: Authorizing `identity:delete_user(user_id=43556b1b18974e909cc7f381fe08aa74)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:28:09.865914 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86039451-236c-4a06-a8a3-181c68dcf382 admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:28:09.912146 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:28:09.913611 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-86039451-236c-4a06-a8a3-181c68dcf382 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '43556b1b18974e909cc7f381fe08aa74'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:28:09.930389 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-86039451-236c-4a06-a8a3-181c68dcf382 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '43556b1b18974e909cc7f381fe08aa74'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:28:09.937547 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-86039451-236c-4a06-a8a3-181c68dcf382 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '43556b1b18974e909cc7f381fe08aa74'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:28:09.938245 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-86039451-236c-4a06-a8a3-181c68dcf382 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '43556b1b18974e909cc7f381fe08aa74'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:28:09.938957 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-86039451-236c-4a06-a8a3-181c68dcf382 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '43556b1b18974e909cc7f381fe08aa74'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:28:09.951921 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1072/2151] 10.222.0.44 () {58 vars in 1223 bytes} [Thu Jun 16 12:28:09 2022] DELETE /identity/v3/users/43556b1b18974e909cc7f381fe08aa74 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:28:09.956479 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85eb9aa5-8698-4d0c-9625-87894b87b93d None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:28:09.957444 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85eb9aa5-8698-4d0c-9625-87894b87b93d None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:28:09.957681 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85eb9aa5-8698-4d0c-9625-87894b87b93d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:28:09.975927 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-85eb9aa5-8698-4d0c-9625-87894b87b93d None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:28:09.977158 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-85eb9aa5-8698-4d0c-9625-87894b87b93d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:28:09.985995 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:28:10.039212 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1080/2152] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 12:28:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:28:10.067355 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86039451-236c-4a06-a8a3-181c68dcf382 admin admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:28:10.069422 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-86039451-236c-4a06-a8a3-181c68dcf382 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:28:10.132900 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86039451-236c-4a06-a8a3-181c68dcf382 admin admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:28:10.136847 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92d7808-9834-4a1b-9e24-c81247a74c00 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1094729b25a4be7b0b394998c9ca681', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '601361df39e34fcca71175aa94e425c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:28:10.137491 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92d7808-9834-4a1b-9e24-c81247a74c00 service neutron] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:28:10.137779 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92d7808-9834-4a1b-9e24-c81247a74c00 service neutron] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:28:10.138055 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92d7808-9834-4a1b-9e24-c81247a74c00 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:28:10.147908 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92d7808-9834-4a1b-9e24-c81247a74c00 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:28:10.149368 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92d7808-9834-4a1b-9e24-c81247a74c00 service neutron] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:28:10.158764 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1073/2153] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 12:28:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 12:28:10.440058 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85eb9aa5-8698-4d0c-9625-87894b87b93d None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:28:10.442120 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-85eb9aa5-8698-4d0c-9625-87894b87b93d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:28:10.455366 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85eb9aa5-8698-4d0c-9625-87894b87b93d None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:28:10.466662 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a4dc69-1b93-4ba0-8328-d4f3c73207c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:28:10.467540 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a4dc69-1b93-4ba0-8328-d4f3c73207c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:28:10.467937 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a4dc69-1b93-4ba0-8328-d4f3c73207c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:28:10.468083 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a4dc69-1b93-4ba0-8328-d4f3c73207c7 admin admin] PATH_INFO: `/v3/projects/f65997ac695e400fbb6f02cf5841362c` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:28:10.469314 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a4dc69-1b93-4ba0-8328-d4f3c73207c7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f65997ac695e400fbb6f02cf5841362c)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:28:10.471475 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a4dc69-1b93-4ba0-8328-d4f3c73207c7 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:28:10.546350 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-27a4dc69-1b93-4ba0-8328-d4f3c73207c7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f65997ac695e400fbb6f02cf5841362c', 'request_id': 'req-27a4dc69-1b93-4ba0-8328-d4f3c73207c7'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:28:10.555702 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-27a4dc69-1b93-4ba0-8328-d4f3c73207c7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f65997ac695e400fbb6f02cf5841362c', 'request_id': 'req-27a4dc69-1b93-4ba0-8328-d4f3c73207c7'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:28:10.565644 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-27a4dc69-1b93-4ba0-8328-d4f3c73207c7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f65997ac695e400fbb6f02cf5841362c', 'request_id': 'req-27a4dc69-1b93-4ba0-8328-d4f3c73207c7'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:28:10.582693 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-27a4dc69-1b93-4ba0-8328-d4f3c73207c7 admin admin] The token cache is being invalidate because project f65997ac695e400fbb6f02cf5841362c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 12:28:10.583182 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-27a4dc69-1b93-4ba0-8328-d4f3c73207c7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:28:10.584257 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-27a4dc69-1b93-4ba0-8328-d4f3c73207c7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:28:10.588856 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1081/2154] 10.222.0.44 () {58 vars in 1232 bytes} [Thu Jun 16 12:28:10 2022] DELETE /identity/v3/projects/f65997ac695e400fbb6f02cf5841362c => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:28:10.590080 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92d7808-9834-4a1b-9e24-c81247a74c00 service neutron] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:28:10.603729 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92d7808-9834-4a1b-9e24-c81247a74c00 service neutron] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:28:10.675531 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fce43e-0e9c-4c96-a544-53f166f6bf01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:28:10.677148 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fce43e-0e9c-4c96-a544-53f166f6bf01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:28:10.677590 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fce43e-0e9c-4c96-a544-53f166f6bf01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:28:10.677905 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fce43e-0e9c-4c96-a544-53f166f6bf01 admin admin] PATH_INFO: `/v3/users/4a55208afcf242cc9daa5420505e4d16` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:28:10.679189 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fce43e-0e9c-4c96-a544-53f166f6bf01 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4a55208afcf242cc9daa5420505e4d16)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:28:10.681308 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fce43e-0e9c-4c96-a544-53f166f6bf01 admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:28:10.738824 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-08fce43e-0e9c-4c96-a544-53f166f6bf01 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4a55208afcf242cc9daa5420505e4d16'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:28:10.750599 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-08fce43e-0e9c-4c96-a544-53f166f6bf01 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4a55208afcf242cc9daa5420505e4d16'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:28:10.752567 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:28:10.758503 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-08fce43e-0e9c-4c96-a544-53f166f6bf01 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4a55208afcf242cc9daa5420505e4d16'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:28:10.759671 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-08fce43e-0e9c-4c96-a544-53f166f6bf01 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4a55208afcf242cc9daa5420505e4d16'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:28:10.760570 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-08fce43e-0e9c-4c96-a544-53f166f6bf01 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4a55208afcf242cc9daa5420505e4d16'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:28:10.774620 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1074/2155] 10.222.0.44 () {58 vars in 1223 bytes} [Thu Jun 16 12:28:10 2022] DELETE /identity/v3/users/4a55208afcf242cc9daa5420505e4d16 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:28:11.073806 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a4dc69-1b93-4ba0-8328-d4f3c73207c7 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:28:11.075300 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-27a4dc69-1b93-4ba0-8328-d4f3c73207c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:28:11.090814 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a4dc69-1b93-4ba0-8328-d4f3c73207c7 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:28:11.179088 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73794f7c-0bb1-40d9-9184-0c00f8bf761a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:28:11.180302 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73794f7c-0bb1-40d9-9184-0c00f8bf761a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:28:11.180717 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73794f7c-0bb1-40d9-9184-0c00f8bf761a admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:28:11.181145 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73794f7c-0bb1-40d9-9184-0c00f8bf761a admin admin] PATH_INFO: `/v3/projects/a06e7c8e492c46f5ac3b5baa68b8fe68` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:28:11.182528 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73794f7c-0bb1-40d9-9184-0c00f8bf761a admin admin] RBAC: Authorizing `identity:delete_project(project_id=a06e7c8e492c46f5ac3b5baa68b8fe68)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:28:11.193065 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73794f7c-0bb1-40d9-9184-0c00f8bf761a admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:28:11.245674 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:28:11.259916 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-73794f7c-0bb1-40d9-9184-0c00f8bf761a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a06e7c8e492c46f5ac3b5baa68b8fe68', 'request_id': 'req-73794f7c-0bb1-40d9-9184-0c00f8bf761a'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:28:11.278282 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-73794f7c-0bb1-40d9-9184-0c00f8bf761a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a06e7c8e492c46f5ac3b5baa68b8fe68', 'request_id': 'req-73794f7c-0bb1-40d9-9184-0c00f8bf761a'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:28:11.287639 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-73794f7c-0bb1-40d9-9184-0c00f8bf761a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a06e7c8e492c46f5ac3b5baa68b8fe68', 'request_id': 'req-73794f7c-0bb1-40d9-9184-0c00f8bf761a'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:28:11.308785 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-73794f7c-0bb1-40d9-9184-0c00f8bf761a admin admin] The token cache is being invalidate because project a06e7c8e492c46f5ac3b5baa68b8fe68 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 12:28:11.309089 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-73794f7c-0bb1-40d9-9184-0c00f8bf761a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:28:11.309813 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-73794f7c-0bb1-40d9-9184-0c00f8bf761a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:28:11.311562 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1082/2156] 10.222.0.44 () {58 vars in 1232 bytes} [Thu Jun 16 12:28:11 2022] DELETE /identity/v3/projects/a06e7c8e492c46f5ac3b5baa68b8fe68 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:28:11.316184 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fce43e-0e9c-4c96-a544-53f166f6bf01 admin admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:28:11.318081 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-08fce43e-0e9c-4c96-a544-53f166f6bf01 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:28:11.335626 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fce43e-0e9c-4c96-a544-53f166f6bf01 admin admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:28:11.414697 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87c533d-2f17-4734-9003-c9e58a04005a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:28:11.415576 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87c533d-2f17-4734-9003-c9e58a04005a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:28:11.415855 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87c533d-2f17-4734-9003-c9e58a04005a admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:28:11.416128 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87c533d-2f17-4734-9003-c9e58a04005a admin admin] PATH_INFO: `/v3/users/f011dc7141b549eb9917f807fc8d1a99` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:28:11.417725 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87c533d-2f17-4734-9003-c9e58a04005a admin admin] RBAC: Authorizing `identity:delete_user(user_id=f011dc7141b549eb9917f807fc8d1a99)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:28:11.419904 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87c533d-2f17-4734-9003-c9e58a04005a admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:28:11.474670 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-e87c533d-2f17-4734-9003-c9e58a04005a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f011dc7141b549eb9917f807fc8d1a99'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:28:11.489345 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-e87c533d-2f17-4734-9003-c9e58a04005a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f011dc7141b549eb9917f807fc8d1a99'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:28:11.497781 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-e87c533d-2f17-4734-9003-c9e58a04005a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f011dc7141b549eb9917f807fc8d1a99'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:28:11.498788 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-e87c533d-2f17-4734-9003-c9e58a04005a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f011dc7141b549eb9917f807fc8d1a99'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:28:11.499446 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-e87c533d-2f17-4734-9003-c9e58a04005a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f011dc7141b549eb9917f807fc8d1a99'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:28:11.521829 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1075/2157] 10.222.0.44 () {58 vars in 1223 bytes} [Thu Jun 16 12:28:11 2022] DELETE /identity/v3/users/f011dc7141b549eb9917f807fc8d1a99 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:28:12.499037 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73794f7c-0bb1-40d9-9184-0c00f8bf761a admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:28:12.502774 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-73794f7c-0bb1-40d9-9184-0c00f8bf761a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:28:12.508552 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87c533d-2f17-4734-9003-c9e58a04005a admin admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:28:12.510581 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-e87c533d-2f17-4734-9003-c9e58a04005a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:28:12.521040 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73794f7c-0bb1-40d9-9184-0c00f8bf761a admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:28:12.608182 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87c533d-2f17-4734-9003-c9e58a04005a admin admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:28:12.614294 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3ed16f-907b-4e2d-9e84-166d8b063d2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:28:12.615176 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3ed16f-907b-4e2d-9e84-166d8b063d2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:28:12.615619 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3ed16f-907b-4e2d-9e84-166d8b063d2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:28:12.616041 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3ed16f-907b-4e2d-9e84-166d8b063d2d admin admin] PATH_INFO: `/v3/users/96fa57e99d8a48c884b4ae37ee569390` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:28:12.617541 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3ed16f-907b-4e2d-9e84-166d8b063d2d admin admin] RBAC: Authorizing `identity:delete_user(user_id=96fa57e99d8a48c884b4ae37ee569390)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:28:12.619676 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3ed16f-907b-4e2d-9e84-166d8b063d2d admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:28:12.626458 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:28:12.664445 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49ef41b-116f-47a3-8f93-23a7d3433108 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:28:12.665945 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49ef41b-116f-47a3-8f93-23a7d3433108 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:28:12.666358 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49ef41b-116f-47a3-8f93-23a7d3433108 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:28:12.667188 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49ef41b-116f-47a3-8f93-23a7d3433108 admin admin] PATH_INFO: `/v3/projects/da243e5b46c947be90eb6040516d9e40` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:28:12.671640 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49ef41b-116f-47a3-8f93-23a7d3433108 admin admin] RBAC: Authorizing `identity:delete_project(project_id=da243e5b46c947be90eb6040516d9e40)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:28:12.673625 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49ef41b-116f-47a3-8f93-23a7d3433108 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:28:12.711552 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-7b3ed16f-907b-4e2d-9e84-166d8b063d2d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '96fa57e99d8a48c884b4ae37ee569390'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:28:12.727343 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-7b3ed16f-907b-4e2d-9e84-166d8b063d2d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '96fa57e99d8a48c884b4ae37ee569390'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:28:12.736455 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-7b3ed16f-907b-4e2d-9e84-166d8b063d2d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '96fa57e99d8a48c884b4ae37ee569390'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:28:12.736836 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-d49ef41b-116f-47a3-8f93-23a7d3433108 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da243e5b46c947be90eb6040516d9e40', 'request_id': 'req-d49ef41b-116f-47a3-8f93-23a7d3433108'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:28:12.737270 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-7b3ed16f-907b-4e2d-9e84-166d8b063d2d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '96fa57e99d8a48c884b4ae37ee569390'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:28:12.738004 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-7b3ed16f-907b-4e2d-9e84-166d8b063d2d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '96fa57e99d8a48c884b4ae37ee569390'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:28:12.746226 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-d49ef41b-116f-47a3-8f93-23a7d3433108 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da243e5b46c947be90eb6040516d9e40', 'request_id': 'req-d49ef41b-116f-47a3-8f93-23a7d3433108'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:28:12.753481 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-d49ef41b-116f-47a3-8f93-23a7d3433108 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da243e5b46c947be90eb6040516d9e40', 'request_id': 'req-d49ef41b-116f-47a3-8f93-23a7d3433108'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:28:12.754650 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1076/2158] 10.222.0.44 () {58 vars in 1223 bytes} [Thu Jun 16 12:28:12 2022] DELETE /identity/v3/users/96fa57e99d8a48c884b4ae37ee569390 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:28:12.771250 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-d49ef41b-116f-47a3-8f93-23a7d3433108 admin admin] The token cache is being invalidate because project da243e5b46c947be90eb6040516d9e40 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 12:28:12.771544 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-d49ef41b-116f-47a3-8f93-23a7d3433108 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:28:12.772236 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-d49ef41b-116f-47a3-8f93-23a7d3433108 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:28:12.773932 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1083/2159] 10.222.0.44 () {58 vars in 1232 bytes} [Thu Jun 16 12:28:12 2022] DELETE /identity/v3/projects/da243e5b46c947be90eb6040516d9e40 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:28:12.780035 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5ceb42-0229-4bf5-8cf6-07f7b02e3f19 None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:28:12.780395 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5ceb42-0229-4bf5-8cf6-07f7b02e3f19 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:28:12.780839 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5ceb42-0229-4bf5-8cf6-07f7b02e3f19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:28:12.801792 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-6c5ceb42-0229-4bf5-8cf6-07f7b02e3f19 None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:28:12.803007 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-6c5ceb42-0229-4bf5-8cf6-07f7b02e3f19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:28:12.879290 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38e583d-700e-4d55-bbc6-67238268f7f6 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:28:12.879575 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38e583d-700e-4d55-bbc6-67238268f7f6 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:28:12.879859 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38e583d-700e-4d55-bbc6-67238268f7f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:28:12.880827 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1077/2160] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 12:28:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:28:12.899445 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-f38e583d-700e-4d55-bbc6-67238268f7f6 None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:28:12.900667 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-f38e583d-700e-4d55-bbc6-67238268f7f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:28:12.911182 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1084/2161] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 12:28:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 12:28:12.915220 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5ceb42-0229-4bf5-8cf6-07f7b02e3f19 None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:28:12.925805 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5ceb42-0229-4bf5-8cf6-07f7b02e3f19 None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:28:12.932077 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d373e2-59f8-404a-a5a8-205012890f08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:28:12.933018 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d373e2-59f8-404a-a5a8-205012890f08 admin admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:28:12.933251 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d373e2-59f8-404a-a5a8-205012890f08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:28:12.933443 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d373e2-59f8-404a-a5a8-205012890f08 admin admin] PATH_INFO: `/v3/domains` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:28:12.934278 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d373e2-59f8-404a-a5a8-205012890f08 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:28:12.934595 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d373e2-59f8-404a-a5a8-205012890f08 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:28:12.936281 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d373e2-59f8-404a-a5a8-205012890f08 admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:28:12.952546 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1078/2162] 10.222.0.44 () {58 vars in 1152 bytes} [Thu Jun 16 12:28:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:28:12.957298 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38e583d-700e-4d55-bbc6-67238268f7f6 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:28:12.974879 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38e583d-700e-4d55-bbc6-67238268f7f6 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:28:12.982748 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfaf188d-3773-4588-aef8-4ebfa54cfa92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:28:12.984128 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfaf188d-3773-4588-aef8-4ebfa54cfa92 admin admin] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:28:12.984735 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfaf188d-3773-4588-aef8-4ebfa54cfa92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:28:12.986523 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfaf188d-3773-4588-aef8-4ebfa54cfa92 admin admin] PATH_INFO: `/v3/projects` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:28:12.988076 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfaf188d-3773-4588-aef8-4ebfa54cfa92 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:28:12.990357 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfaf188d-3773-4588-aef8-4ebfa54cfa92 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:28:12.997244 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d373e2-59f8-404a-a5a8-205012890f08 admin admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:28:12.999253 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-24d373e2-59f8-404a-a5a8-205012890f08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:28:13.022627 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d373e2-59f8-404a-a5a8-205012890f08 admin admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:28:13.031600 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2787714d-720c-46ac-a7ca-c6b5b08b7fc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:28:13.032959 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2787714d-720c-46ac-a7ca-c6b5b08b7fc9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:28:13.033239 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2787714d-720c-46ac-a7ca-c6b5b08b7fc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:28:13.033613 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2787714d-720c-46ac-a7ca-c6b5b08b7fc9 admin admin] PATH_INFO: `/v3/projects/2207e7e10f284e948c39f4c2b34f025b` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:28:13.034923 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1085/2163] 10.222.0.44 () {60 vars in 1152 bytes} [Thu Jun 16 12:28:12 2022] POST /identity/v3/projects => generated 381 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 12:28:13.035360 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2787714d-720c-46ac-a7ca-c6b5b08b7fc9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2207e7e10f284e948c39f4c2b34f025b)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:28:13.037308 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2787714d-720c-46ac-a7ca-c6b5b08b7fc9 admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:28:13.041058 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfaf188d-3773-4588-aef8-4ebfa54cfa92 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:28:13.091384 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:28:13.100293 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-2787714d-720c-46ac-a7ca-c6b5b08b7fc9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2207e7e10f284e948c39f4c2b34f025b', 'request_id': 'req-2787714d-720c-46ac-a7ca-c6b5b08b7fc9'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:28:13.109507 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-2787714d-720c-46ac-a7ca-c6b5b08b7fc9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2207e7e10f284e948c39f4c2b34f025b', 'request_id': 'req-2787714d-720c-46ac-a7ca-c6b5b08b7fc9'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:28:13.116998 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-2787714d-720c-46ac-a7ca-c6b5b08b7fc9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2207e7e10f284e948c39f4c2b34f025b', 'request_id': 'req-2787714d-720c-46ac-a7ca-c6b5b08b7fc9'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:28:13.118384 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:28:13.136113 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfaf188d-3773-4588-aef8-4ebfa54cfa92 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:28:13.137221 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-2787714d-720c-46ac-a7ca-c6b5b08b7fc9 admin admin] The token cache is being invalidate because project 2207e7e10f284e948c39f4c2b34f025b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 12:28:13.137597 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-2787714d-720c-46ac-a7ca-c6b5b08b7fc9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:28:13.138451 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-2787714d-720c-46ac-a7ca-c6b5b08b7fc9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:28:13.144980 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1079/2164] 10.222.0.44 () {58 vars in 1232 bytes} [Thu Jun 16 12:28:12 2022] DELETE /identity/v3/projects/2207e7e10f284e948c39f4c2b34f025b => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 12:28:13.145934 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2787714d-720c-46ac-a7ca-c6b5b08b7fc9 admin admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:28:13.147848 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-2787714d-720c-46ac-a7ca-c6b5b08b7fc9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:28:13.210980 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723f50f7-1c49-427d-a405-1069b72f74e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:28:13.211658 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723f50f7-1c49-427d-a405-1069b72f74e6 admin admin] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:28:13.211939 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723f50f7-1c49-427d-a405-1069b72f74e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:28:13.212323 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723f50f7-1c49-427d-a405-1069b72f74e6 admin admin] PATH_INFO: `/v3/users` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:28:13.213584 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723f50f7-1c49-427d-a405-1069b72f74e6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:28:13.215814 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723f50f7-1c49-427d-a405-1069b72f74e6 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:28:13.259581 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1086/2165] 10.222.0.44 () {60 vars in 1143 bytes} [Thu Jun 16 12:28:13 2022] POST /identity/v3/users => generated 291 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 12:28:13.260437 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2787714d-720c-46ac-a7ca-c6b5b08b7fc9 admin admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:28:13.264733 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723f50f7-1c49-427d-a405-1069b72f74e6 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:28:13.265274 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3a4e23-d635-4131-9946-942511ebb645 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:28:13.266150 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3a4e23-d635-4131-9946-942511ebb645 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:28:13.266427 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3a4e23-d635-4131-9946-942511ebb645 admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:28:13.266529 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-723f50f7-1c49-427d-a405-1069b72f74e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:28:13.266694 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3a4e23-d635-4131-9946-942511ebb645 admin admin] PATH_INFO: `/v3/users/03dece240692471fa539e9f104afbc29` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:28:13.268060 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3a4e23-d635-4131-9946-942511ebb645 admin admin] RBAC: Authorizing `identity:delete_user(user_id=03dece240692471fa539e9f104afbc29)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:28:13.270548 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3a4e23-d635-4131-9946-942511ebb645 admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:28:13.281672 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723f50f7-1c49-427d-a405-1069b72f74e6 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:28:13.286822 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7499ce85-d575-42a5-bef9-fe04723e50a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:28:13.287494 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7499ce85-d575-42a5-bef9-fe04723e50a2 admin admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:28:13.287774 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7499ce85-d575-42a5-bef9-fe04723e50a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:28:13.288636 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7499ce85-d575-42a5-bef9-fe04723e50a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:28:13.288876 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7499ce85-d575-42a5-bef9-fe04723e50a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:28:13.290489 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7499ce85-d575-42a5-bef9-fe04723e50a2 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:28:13.302501 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1087/2166] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 12:28:13 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 12:28:13.307243 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7499ce85-d575-42a5-bef9-fe04723e50a2 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:28:13.322706 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7499ce85-d575-42a5-bef9-fe04723e50a2 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:28:13.330335 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4c7d33-f928-403b-8c34-6e06788196c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:28:13.331362 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4c7d33-f928-403b-8c34-6e06788196c9 admin admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:28:13.332360 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4c7d33-f928-403b-8c34-6e06788196c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:28:13.332611 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4c7d33-f928-403b-8c34-6e06788196c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:28:13.333510 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4c7d33-f928-403b-8c34-6e06788196c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:28:13.333741 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-6d3a4e23-d635-4131-9946-942511ebb645 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '03dece240692471fa539e9f104afbc29'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:28:13.335337 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4c7d33-f928-403b-8c34-6e06788196c9 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:28:13.349689 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-6d3a4e23-d635-4131-9946-942511ebb645 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '03dece240692471fa539e9f104afbc29'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:28:13.353977 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1088/2167] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 12:28:13 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 12:28:13.356500 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4c7d33-f928-403b-8c34-6e06788196c9 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:28:13.360679 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-6d3a4e23-d635-4131-9946-942511ebb645 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '03dece240692471fa539e9f104afbc29'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:28:13.361550 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-6d3a4e23-d635-4131-9946-942511ebb645 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '03dece240692471fa539e9f104afbc29'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:28:13.362239 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-6d3a4e23-d635-4131-9946-942511ebb645 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '03dece240692471fa539e9f104afbc29'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:28:13.373534 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4c7d33-f928-403b-8c34-6e06788196c9 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:28:13.382218 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8effcae-c23a-41ca-91e9-fef7b6f2ab77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:28:13.382960 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1080/2168] 10.222.0.44 () {58 vars in 1223 bytes} [Thu Jun 16 12:28:13 2022] DELETE /identity/v3/users/03dece240692471fa539e9f104afbc29 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:28:13.383891 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8effcae-c23a-41ca-91e9-fef7b6f2ab77 admin admin] REQUEST_METHOD: `PUT` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:28:13.384175 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8effcae-c23a-41ca-91e9-fef7b6f2ab77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:28:13.384447 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8effcae-c23a-41ca-91e9-fef7b6f2ab77 admin admin] PATH_INFO: `/v3/projects/e9b540ad47e844cebad95cdfaf11b8c3/users/ae7bf6b5191745cd8f4e05aa58aefd59/roles/c39882b202e942479a7cdac2fc6da72c` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:28:13.402055 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8effcae-c23a-41ca-91e9-fef7b6f2ab77 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e9b540ad47e844cebad95cdfaf11b8c3, user_id=ae7bf6b5191745cd8f4e05aa58aefd59, role_id=c39882b202e942479a7cdac2fc6da72c)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:28:13.404780 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8effcae-c23a-41ca-91e9-fef7b6f2ab77 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:28:13.418752 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1089/2169] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 16 12:28:13 2022] PUT /identity/v3/projects/e9b540ad47e844cebad95cdfaf11b8c3/users/ae7bf6b5191745cd8f4e05aa58aefd59/roles/c39882b202e942479a7cdac2fc6da72c => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 12:28:13.430609 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318d915e-fa95-4c8a-a721-8e61da7a2cce None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:28:13.430895 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318d915e-fa95-4c8a-a721-8e61da7a2cce None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:28:13.431170 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318d915e-fa95-4c8a-a721-8e61da7a2cce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:28:13.458260 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-318d915e-fa95-4c8a-a721-8e61da7a2cce None None] MFA Rules not processed for user `ae7bf6b5191745cd8f4e05aa58aefd59`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:28:13.459480 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-318d915e-fa95-4c8a-a721-8e61da7a2cce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:28:13.532260 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1081/2170] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 12:28:13 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:28:13.537175 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8effcae-c23a-41ca-91e9-fef7b6f2ab77 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:28:13.539062 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-c8effcae-c23a-41ca-91e9-fef7b6f2ab77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:28:13.579855 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318d915e-fa95-4c8a-a721-8e61da7a2cce None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:28:13.583760 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-318d915e-fa95-4c8a-a721-8e61da7a2cce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:28:13.590933 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:28:13.619502 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8effcae-c23a-41ca-91e9-fef7b6f2ab77 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:28:13.624203 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982e620c-0a38-42f8-80be-74859c01f3ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:28:13.624888 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982e620c-0a38-42f8-80be-74859c01f3ea admin admin] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:28:13.625167 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982e620c-0a38-42f8-80be-74859c01f3ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:28:13.625440 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982e620c-0a38-42f8-80be-74859c01f3ea admin admin] PATH_INFO: `/v3/projects` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:28:13.626136 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982e620c-0a38-42f8-80be-74859c01f3ea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:28:13.628338 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982e620c-0a38-42f8-80be-74859c01f3ea admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:28:13.661460 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318d915e-fa95-4c8a-a721-8e61da7a2cce None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:28:13.666461 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1090/2171] 10.222.0.44 () {60 vars in 1152 bytes} [Thu Jun 16 12:28:13 2022] POST /identity/v3/projects => generated 383 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 12:28:13.667571 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982e620c-0a38-42f8-80be-74859c01f3ea admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:28:13.677829 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:28:13.754135 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabcc758-794b-451b-b545-938ef79e0ff1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:28:13.755121 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabcc758-794b-451b-b545-938ef79e0ff1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:28:13.755388 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabcc758-794b-451b-b545-938ef79e0ff1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:28:13.755677 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabcc758-794b-451b-b545-938ef79e0ff1 admin admin] PATH_INFO: `/v3/projects/01a204ab334b454ab33b9a58fe17fcc4` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:28:13.757018 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabcc758-794b-451b-b545-938ef79e0ff1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=01a204ab334b454ab33b9a58fe17fcc4)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:28:13.760353 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabcc758-794b-451b-b545-938ef79e0ff1 admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:28:13.824689 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982e620c-0a38-42f8-80be-74859c01f3ea admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:28:13.832353 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723b299b-4a39-4fcc-9f32-61f61b39a27f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:28:13.834648 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723b299b-4a39-4fcc-9f32-61f61b39a27f admin admin] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:28:13.836600 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723b299b-4a39-4fcc-9f32-61f61b39a27f admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:28:13.837040 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723b299b-4a39-4fcc-9f32-61f61b39a27f admin admin] PATH_INFO: `/v3/users` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:28:13.837875 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723b299b-4a39-4fcc-9f32-61f61b39a27f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:28:13.840867 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723b299b-4a39-4fcc-9f32-61f61b39a27f admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:28:13.860019 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-cabcc758-794b-451b-b545-938ef79e0ff1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '01a204ab334b454ab33b9a58fe17fcc4', 'request_id': 'req-cabcc758-794b-451b-b545-938ef79e0ff1'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:28:13.872056 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-cabcc758-794b-451b-b545-938ef79e0ff1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '01a204ab334b454ab33b9a58fe17fcc4', 'request_id': 'req-cabcc758-794b-451b-b545-938ef79e0ff1'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:28:13.880765 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-cabcc758-794b-451b-b545-938ef79e0ff1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '01a204ab334b454ab33b9a58fe17fcc4', 'request_id': 'req-cabcc758-794b-451b-b545-938ef79e0ff1'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:28:13.882176 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1091/2172] 10.222.0.44 () {60 vars in 1143 bytes} [Thu Jun 16 12:28:13 2022] POST /identity/v3/users => generated 298 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 12:28:13.885089 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723b299b-4a39-4fcc-9f32-61f61b39a27f admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:28:13.891622 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-723b299b-4a39-4fcc-9f32-61f61b39a27f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:28:13.896175 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-cabcc758-794b-451b-b545-938ef79e0ff1 admin admin] The token cache is being invalidate because project 01a204ab334b454ab33b9a58fe17fcc4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 12:28:13.896694 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-cabcc758-794b-451b-b545-938ef79e0ff1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:28:13.897565 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-cabcc758-794b-451b-b545-938ef79e0ff1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:28:13.900950 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1082/2173] 10.222.0.44 () {58 vars in 1232 bytes} [Thu Jun 16 12:28:13 2022] DELETE /identity/v3/projects/01a204ab334b454ab33b9a58fe17fcc4 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 12:28:13.901917 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabcc758-794b-451b-b545-938ef79e0ff1 admin admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:28:13.904802 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-cabcc758-794b-451b-b545-938ef79e0ff1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:28:13.922863 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723b299b-4a39-4fcc-9f32-61f61b39a27f admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:28:13.979819 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:28:14.014951 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabcc758-794b-451b-b545-938ef79e0ff1 admin admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:28:14.019872 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15fed5a-13f0-442e-a041-f91459eba236 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:28:14.020619 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15fed5a-13f0-442e-a041-f91459eba236 admin admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:28:14.023076 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15fed5a-13f0-442e-a041-f91459eba236 admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:28:14.024803 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15fed5a-13f0-442e-a041-f91459eba236 admin admin] PATH_INFO: `/v3/roles` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:28:14.029850 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15fed5a-13f0-442e-a041-f91459eba236 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:28:14.033248 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15fed5a-13f0-442e-a041-f91459eba236 admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:28:14.046936 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fefc59d-184a-4097-81e3-3db626dfcd04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:28:14.048053 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fefc59d-184a-4097-81e3-3db626dfcd04 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:28:14.048175 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1083/2174] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 12:28:13 2022] GET /identity/v3/roles => generated 1420 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 12:28:14.048430 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fefc59d-184a-4097-81e3-3db626dfcd04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:28:14.048874 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fefc59d-184a-4097-81e3-3db626dfcd04 admin admin] PATH_INFO: `/v3/users/2eab41a3d7624cb6b9f64fa0cfc61a15` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:28:14.049325 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40e12f0-a984-4ed1-bde1-3a12964f7d2b None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:28:14.049613 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40e12f0-a984-4ed1-bde1-3a12964f7d2b None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:28:14.049888 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40e12f0-a984-4ed1-bde1-3a12964f7d2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:28:14.051599 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fefc59d-184a-4097-81e3-3db626dfcd04 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2eab41a3d7624cb6b9f64fa0cfc61a15)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:28:14.053672 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fefc59d-184a-4097-81e3-3db626dfcd04 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:28:14.071842 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-c40e12f0-a984-4ed1-bde1-3a12964f7d2b None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:28:14.073149 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-c40e12f0-a984-4ed1-bde1-3a12964f7d2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:28:14.084272 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1084/2175] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 12:28:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:28:14.085180 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40e12f0-a984-4ed1-bde1-3a12964f7d2b None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:28:14.097996 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40e12f0-a984-4ed1-bde1-3a12964f7d2b None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:28:14.103474 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e86b44-b4d6-45c9-8901-2586ed80e6a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:28:14.104512 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e86b44-b4d6-45c9-8901-2586ed80e6a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:28:14.104840 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e86b44-b4d6-45c9-8901-2586ed80e6a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:28:14.105290 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e86b44-b4d6-45c9-8901-2586ed80e6a1 admin admin] PATH_INFO: `/v3/projects/b847741457a74cf6886c88ff6b9d7dd7/users/95faeac8a5d24606a2cdf59a997e52d7/roles/0688968254744e3f9913653cafea3091` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:28:14.122289 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e86b44-b4d6-45c9-8901-2586ed80e6a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b847741457a74cf6886c88ff6b9d7dd7, user_id=95faeac8a5d24606a2cdf59a997e52d7, role_id=0688968254744e3f9913653cafea3091)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:28:14.125189 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e86b44-b4d6-45c9-8901-2586ed80e6a1 admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:28:14.127396 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-7fefc59d-184a-4097-81e3-3db626dfcd04 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2eab41a3d7624cb6b9f64fa0cfc61a15'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:28:14.128458 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-7fefc59d-184a-4097-81e3-3db626dfcd04 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2eab41a3d7624cb6b9f64fa0cfc61a15'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:28:14.142330 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-7fefc59d-184a-4097-81e3-3db626dfcd04 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2eab41a3d7624cb6b9f64fa0cfc61a15'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:28:14.143301 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-7fefc59d-184a-4097-81e3-3db626dfcd04 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2eab41a3d7624cb6b9f64fa0cfc61a15'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:28:14.146888 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1085/2176] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 16 12:28:14 2022] PUT /identity/v3/projects/b847741457a74cf6886c88ff6b9d7dd7/users/95faeac8a5d24606a2cdf59a997e52d7/roles/0688968254744e3f9913653cafea3091 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:28:14.146888 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409f8ab7-bc93-4161-bb89-39b24fa86f39 None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:28:14.146888 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409f8ab7-bc93-4161-bb89-39b24fa86f39 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:28:14.146888 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409f8ab7-bc93-4161-bb89-39b24fa86f39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:28:14.155800 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-7fefc59d-184a-4097-81e3-3db626dfcd04 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2eab41a3d7624cb6b9f64fa0cfc61a15'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:28:14.185127 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1092/2177] 10.222.0.44 () {58 vars in 1223 bytes} [Thu Jun 16 12:28:13 2022] DELETE /identity/v3/users/2eab41a3d7624cb6b9f64fa0cfc61a15 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:28:14.186400 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fefc59d-184a-4097-81e3-3db626dfcd04 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:28:14.187522 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-409f8ab7-bc93-4161-bb89-39b24fa86f39 None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:28:14.187821 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-7fefc59d-184a-4097-81e3-3db626dfcd04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:28:14.189294 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-409f8ab7-bc93-4161-bb89-39b24fa86f39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:28:14.212251 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:28:14.264774 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1086/2178] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 12:28:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:28:14.265975 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe02f21-cc9a-471e-ac38-3cc4c0c87fe0 None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:28:14.266269 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe02f21-cc9a-471e-ac38-3cc4c0c87fe0 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:28:14.266543 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe02f21-cc9a-471e-ac38-3cc4c0c87fe0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:28:14.273701 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fefc59d-184a-4097-81e3-3db626dfcd04 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:28:14.278811 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94e465f-6dbd-4d4d-be8b-61eaeb671e7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:28:14.279570 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94e465f-6dbd-4d4d-be8b-61eaeb671e7b admin admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:28:14.280623 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94e465f-6dbd-4d4d-be8b-61eaeb671e7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:28:14.280623 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94e465f-6dbd-4d4d-be8b-61eaeb671e7b admin admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:28:14.281050 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94e465f-6dbd-4d4d-be8b-61eaeb671e7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:28:14.282712 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94e465f-6dbd-4d4d-be8b-61eaeb671e7b admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:28:14.286358 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-efe02f21-cc9a-471e-ac38-3cc4c0c87fe0 None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:28:14.287569 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-efe02f21-cc9a-471e-ac38-3cc4c0c87fe0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:28:14.297037 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1093/2179] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 12:28:14 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 12:28:14.297198 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1087/2180] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 12:28:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:28:14.297297 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94e465f-6dbd-4d4d-be8b-61eaeb671e7b admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:28:14.298724 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe02f21-cc9a-471e-ac38-3cc4c0c87fe0 None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:28:14.309837 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94e465f-6dbd-4d4d-be8b-61eaeb671e7b admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:28:14.310083 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe02f21-cc9a-471e-ac38-3cc4c0c87fe0 None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:28:14.314535 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7b9757-bed2-4603-8f8e-5453a176371a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:28:14.316804 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc5c986-d28a-425a-991f-3bb748518bc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:28:14.316986 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7b9757-bed2-4603-8f8e-5453a176371a admin admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:28:14.316986 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7b9757-bed2-4603-8f8e-5453a176371a admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:28:14.316986 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7b9757-bed2-4603-8f8e-5453a176371a admin admin] PATH_INFO: `/v3/domains` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:28:14.317257 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc5c986-d28a-425a-991f-3bb748518bc4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:28:14.317257 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc5c986-d28a-425a-991f-3bb748518bc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:28:14.317419 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7b9757-bed2-4603-8f8e-5453a176371a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:28:14.317510 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc5c986-d28a-425a-991f-3bb748518bc4 admin admin] PATH_INFO: `/v3/projects/b847741457a74cf6886c88ff6b9d7dd7/users/95faeac8a5d24606a2cdf59a997e52d7/roles/0688968254744e3f9913653cafea3091` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:28:14.317600 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7b9757-bed2-4603-8f8e-5453a176371a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:28:14.318907 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7b9757-bed2-4603-8f8e-5453a176371a admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:28:14.320139 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc5c986-d28a-425a-991f-3bb748518bc4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b847741457a74cf6886c88ff6b9d7dd7, user_id=95faeac8a5d24606a2cdf59a997e52d7, role_id=0688968254744e3f9913653cafea3091)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:28:14.323615 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc5c986-d28a-425a-991f-3bb748518bc4 admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:28:14.334227 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1094/2181] 10.222.0.44 () {58 vars in 1152 bytes} [Thu Jun 16 12:28:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:28:14.335279 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7b9757-bed2-4603-8f8e-5453a176371a admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:28:14.337059 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-8b7b9757-bed2-4603-8f8e-5453a176371a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:28:14.345057 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1088/2182] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 16 12:28:14 2022] PUT /identity/v3/projects/b847741457a74cf6886c88ff6b9d7dd7/users/95faeac8a5d24606a2cdf59a997e52d7/roles/0688968254744e3f9913653cafea3091 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 12:28:14.346123 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc5c986-d28a-425a-991f-3bb748518bc4 admin admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:28:14.417694 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7b9757-bed2-4603-8f8e-5453a176371a admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:28:14.425161 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc5c986-d28a-425a-991f-3bb748518bc4 admin admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:28:14.436860 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b7c8c8-2e75-4b58-a7af-94b9123c5efa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:28:14.437882 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b7c8c8-2e75-4b58-a7af-94b9123c5efa admin admin] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:28:14.438319 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b7c8c8-2e75-4b58-a7af-94b9123c5efa admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:28:14.438775 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b7c8c8-2e75-4b58-a7af-94b9123c5efa admin admin] PATH_INFO: `/v3/projects` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:28:14.439576 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b7c8c8-2e75-4b58-a7af-94b9123c5efa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:28:14.442375 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b7c8c8-2e75-4b58-a7af-94b9123c5efa admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:28:14.474920 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1089/2183] 10.222.0.44 () {60 vars in 1152 bytes} [Thu Jun 16 12:28:14 2022] POST /identity/v3/projects => generated 385 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 12:28:14.476475 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b29eb5-f711-4b90-8a27-6b692a48edb7 None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:28:14.476902 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b29eb5-f711-4b90-8a27-6b692a48edb7 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:28:14.477692 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b29eb5-f711-4b90-8a27-6b692a48edb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:28:14.513416 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b3b471-7a60-4fc6-b41d-7ccf8dbd0165 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1094729b25a4be7b0b394998c9ca681', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '601361df39e34fcca71175aa94e425c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:28:14.514420 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:28:14.515092 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b3b471-7a60-4fc6-b41d-7ccf8dbd0165 service neutron] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:28:14.515528 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b3b471-7a60-4fc6-b41d-7ccf8dbd0165 service neutron] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:28:14.515994 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b3b471-7a60-4fc6-b41d-7ccf8dbd0165 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:28:14.527006 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-90b29eb5-f711-4b90-8a27-6b692a48edb7 None None] MFA Rules not processed for user `95faeac8a5d24606a2cdf59a997e52d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:28:14.529664 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-90b29eb5-f711-4b90-8a27-6b692a48edb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:28:14.532772 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b3b471-7a60-4fc6-b41d-7ccf8dbd0165 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:28:14.535924 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b3b471-7a60-4fc6-b41d-7ccf8dbd0165 service neutron] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:28:14.551257 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1095/2184] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 12:28:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 12:28:14.552005 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b3b471-7a60-4fc6-b41d-7ccf8dbd0165 service neutron] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:28:14.563195 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b3b471-7a60-4fc6-b41d-7ccf8dbd0165 service neutron] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:28:14.626551 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1090/2185] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 12:28:14 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:28:14.639862 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b29eb5-f711-4b90-8a27-6b692a48edb7 None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:28:14.641668 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-90b29eb5-f711-4b90-8a27-6b692a48edb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:28:14.643484 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:28:14.658637 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfe2bcb-cc18-418a-a154-1addafd2cd00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:28:14.661181 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfe2bcb-cc18-418a-a154-1addafd2cd00 admin admin] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:28:14.661646 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfe2bcb-cc18-418a-a154-1addafd2cd00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:28:14.662002 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfe2bcb-cc18-418a-a154-1addafd2cd00 admin admin] PATH_INFO: `/v3/users` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:28:14.663195 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfe2bcb-cc18-418a-a154-1addafd2cd00 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:28:14.665887 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfe2bcb-cc18-418a-a154-1addafd2cd00 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:28:14.691894 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1096/2186] 10.222.0.44 () {60 vars in 1143 bytes} [Thu Jun 16 12:28:14 2022] POST /identity/v3/users => generated 293 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 12:28:14.695978 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfe2bcb-cc18-418a-a154-1addafd2cd00 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:28:14.709018 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfe2bcb-cc18-418a-a154-1addafd2cd00 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:28:14.716042 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0146b0-ff02-4ba1-8360-576b5670b86a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:28:14.717079 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0146b0-ff02-4ba1-8360-576b5670b86a admin admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:28:14.717550 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0146b0-ff02-4ba1-8360-576b5670b86a admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:28:14.718039 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0146b0-ff02-4ba1-8360-576b5670b86a admin admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:28:14.720257 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0146b0-ff02-4ba1-8360-576b5670b86a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:28:14.722952 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0146b0-ff02-4ba1-8360-576b5670b86a admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:28:14.732417 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b29eb5-f711-4b90-8a27-6b692a48edb7 None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:28:14.736652 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb521aa-ba70-44fe-bb44-c0a29d458a13 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f96fc14ed89478c8a8c2f11c87511e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '601361df39e34fcca71175aa94e425c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:28:14.738458 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb521aa-ba70-44fe-bb44-c0a29d458a13 service cinder] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:28:14.738917 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb521aa-ba70-44fe-bb44-c0a29d458a13 service cinder] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:28:14.739287 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb521aa-ba70-44fe-bb44-c0a29d458a13 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:28:14.748476 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1097/2187] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 12:28:14 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 12:28:14.753318 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb521aa-ba70-44fe-bb44-c0a29d458a13 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:28:14.754960 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb521aa-ba70-44fe-bb44-c0a29d458a13 service cinder] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:28:14.758477 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0146b0-ff02-4ba1-8360-576b5670b86a admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:28:14.767181 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1091/2188] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 12:28:14 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 12:28:14.770146 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0146b0-ff02-4ba1-8360-576b5670b86a admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:28:14.774917 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b52a0b-429f-4bfb-891f-6c1f7c54b1fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:28:14.775953 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b52a0b-429f-4bfb-891f-6c1f7c54b1fc admin admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:28:14.776358 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b52a0b-429f-4bfb-891f-6c1f7c54b1fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:28:14.776773 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b52a0b-429f-4bfb-891f-6c1f7c54b1fc admin admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:28:14.777825 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b52a0b-429f-4bfb-891f-6c1f7c54b1fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:28:14.780159 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b52a0b-429f-4bfb-891f-6c1f7c54b1fc admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:28:14.802733 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1098/2189] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 12:28:14 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 12:28:14.807642 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb521aa-ba70-44fe-bb44-c0a29d458a13 service cinder] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:28:14.827464 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb521aa-ba70-44fe-bb44-c0a29d458a13 service cinder] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:28:14.833923 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c43f6a2-ee81-42d0-a31e-74a003dc0b6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:28:14.835054 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c43f6a2-ee81-42d0-a31e-74a003dc0b6e admin admin] REQUEST_METHOD: `PUT` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:28:14.835537 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c43f6a2-ee81-42d0-a31e-74a003dc0b6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:28:14.835999 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c43f6a2-ee81-42d0-a31e-74a003dc0b6e admin admin] PATH_INFO: `/v3/projects/64e40aa9032f471f97b404d4cb4e2444/users/d60fe3d585a54cc4b358cead1c42b72e/roles/c39882b202e942479a7cdac2fc6da72c` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:28:14.859232 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c43f6a2-ee81-42d0-a31e-74a003dc0b6e admin admin] RBAC: Authorizing `identity:create_grant(project_id=64e40aa9032f471f97b404d4cb4e2444, user_id=d60fe3d585a54cc4b358cead1c42b72e, role_id=c39882b202e942479a7cdac2fc6da72c)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:28:14.862630 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c43f6a2-ee81-42d0-a31e-74a003dc0b6e admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:28:14.906901 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1092/2190] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 16 12:28:14 2022] PUT /identity/v3/projects/64e40aa9032f471f97b404d4cb4e2444/users/d60fe3d585a54cc4b358cead1c42b72e/roles/c39882b202e942479a7cdac2fc6da72c => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:28:14.907228 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441bbc6b-f756-4e43-9a03-cd938587c407 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:28:14.907228 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441bbc6b-f756-4e43-9a03-cd938587c407 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:28:14.907228 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441bbc6b-f756-4e43-9a03-cd938587c407 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:28:14.919662 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c43f6a2-ee81-42d0-a31e-74a003dc0b6e admin admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:28:14.953866 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-441bbc6b-f756-4e43-9a03-cd938587c407 None None] MFA Rules not processed for user `d60fe3d585a54cc4b358cead1c42b72e`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:28:14.955250 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-441bbc6b-f756-4e43-9a03-cd938587c407 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:28:15.009598 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c43f6a2-ee81-42d0-a31e-74a003dc0b6e admin admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:28:15.013613 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095eacb3-0822-4683-91f5-6561a1aa36bf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f96fc14ed89478c8a8c2f11c87511e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '601361df39e34fcca71175aa94e425c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:28:15.014393 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095eacb3-0822-4683-91f5-6561a1aa36bf service cinder] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:28:15.014772 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095eacb3-0822-4683-91f5-6561a1aa36bf service cinder] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:28:15.015145 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095eacb3-0822-4683-91f5-6561a1aa36bf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:28:15.017228 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-095eacb3-0822-4683-91f5-6561a1aa36bf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:28:15.028990 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1099/2191] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 12:28:14 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:28:15.031086 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441bbc6b-f756-4e43-9a03-cd938587c407 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:28:15.040051 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-441bbc6b-f756-4e43-9a03-cd938587c407 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:28:15.059457 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:28:15.112655 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095eacb3-0822-4683-91f5-6561a1aa36bf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:28:15.116642 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095eacb3-0822-4683-91f5-6561a1aa36bf service cinder] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:28:15.127318 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441bbc6b-f756-4e43-9a03-cd938587c407 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:28:15.132984 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1093/2192] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 12:28:14 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 12:28:15.133344 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6be89b6-a0a1-4202-b538-ddbf241290d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:28:15.134154 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095eacb3-0822-4683-91f5-6561a1aa36bf service cinder] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:28:15.134776 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6be89b6-a0a1-4202-b538-ddbf241290d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:28:15.135064 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6be89b6-a0a1-4202-b538-ddbf241290d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:28:15.135336 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6be89b6-a0a1-4202-b538-ddbf241290d9 admin admin] PATH_INFO: `/v3/projects/435868f180cf4df39d4781f47fb6537e` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:28:15.135969 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-095eacb3-0822-4683-91f5-6561a1aa36bf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:28:15.136603 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6be89b6-a0a1-4202-b538-ddbf241290d9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=435868f180cf4df39d4781f47fb6537e)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:28:15.138678 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6be89b6-a0a1-4202-b538-ddbf241290d9 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:28:15.148519 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095eacb3-0822-4683-91f5-6561a1aa36bf service cinder] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:28:15.154317 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c28c3fa-3164-43d7-bb25-c248c58379b5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f96fc14ed89478c8a8c2f11c87511e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '601361df39e34fcca71175aa94e425c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:28:15.155483 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c28c3fa-3164-43d7-bb25-c248c58379b5 service cinder] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:28:15.155866 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c28c3fa-3164-43d7-bb25-c248c58379b5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:28:15.156652 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c28c3fa-3164-43d7-bb25-c248c58379b5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:28:15.177439 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c28c3fa-3164-43d7-bb25-c248c58379b5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:28:15.180847 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c28c3fa-3164-43d7-bb25-c248c58379b5 service cinder] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:28:15.204614 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1094/2193] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 12:28:15 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 12:28:15.215749 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-d6be89b6-a0a1-4202-b538-ddbf241290d9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '435868f180cf4df39d4781f47fb6537e', 'request_id': 'req-d6be89b6-a0a1-4202-b538-ddbf241290d9'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:28:15.231166 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c28c3fa-3164-43d7-bb25-c248c58379b5 service cinder] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:28:15.233560 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-d6be89b6-a0a1-4202-b538-ddbf241290d9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '435868f180cf4df39d4781f47fb6537e', 'request_id': 'req-d6be89b6-a0a1-4202-b538-ddbf241290d9'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:28:15.235061 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=91,keystone:INSERT=4,keystone:DELETE=5 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:28:15.242775 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-d6be89b6-a0a1-4202-b538-ddbf241290d9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '435868f180cf4df39d4781f47fb6537e', 'request_id': 'req-d6be89b6-a0a1-4202-b538-ddbf241290d9'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:28:15.248911 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c28c3fa-3164-43d7-bb25-c248c58379b5 service cinder] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:28:15.260719 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-d6be89b6-a0a1-4202-b538-ddbf241290d9 admin admin] The token cache is being invalidate because project 435868f180cf4df39d4781f47fb6537e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 12:28:15.261039 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-d6be89b6-a0a1-4202-b538-ddbf241290d9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:28:15.261705 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-d6be89b6-a0a1-4202-b538-ddbf241290d9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:28:15.263268 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1100/2194] 10.222.0.44 () {58 vars in 1232 bytes} [Thu Jun 16 12:28:15 2022] DELETE /identity/v3/projects/435868f180cf4df39d4781f47fb6537e => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:28:15.268018 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828c383c-b5e6-4594-85b5-947c3dcd5068 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:28:15.268286 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828c383c-b5e6-4594-85b5-947c3dcd5068 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:28:15.268566 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828c383c-b5e6-4594-85b5-947c3dcd5068 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:28:15.293370 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-828c383c-b5e6-4594-85b5-947c3dcd5068 None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:28:15.294626 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-828c383c-b5e6-4594-85b5-947c3dcd5068 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:28:15.329110 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bbb192-f1ee-40b5-8126-0ec76214eca2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:28:15.329746 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bbb192-f1ee-40b5-8126-0ec76214eca2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:28:15.330023 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bbb192-f1ee-40b5-8126-0ec76214eca2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:28:15.330325 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bbb192-f1ee-40b5-8126-0ec76214eca2 admin admin] PATH_INFO: `/v3/users/d60fe3d585a54cc4b358cead1c42b72e` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:28:15.331696 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bbb192-f1ee-40b5-8126-0ec76214eca2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d60fe3d585a54cc4b358cead1c42b72e)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:28:15.333645 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bbb192-f1ee-40b5-8126-0ec76214eca2 admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:28:15.361705 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1101/2195] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 12:28:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 12:28:15.370652 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41131bb6-65eb-424e-a03f-633b1e34b128 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:28:15.370963 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41131bb6-65eb-424e-a03f-633b1e34b128 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:28:15.371225 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41131bb6-65eb-424e-a03f-633b1e34b128 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:28:15.390265 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-41131bb6-65eb-424e-a03f-633b1e34b128 None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:28:15.390760 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-00bbb192-f1ee-40b5-8126-0ec76214eca2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd60fe3d585a54cc4b358cead1c42b72e'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:28:15.391477 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-41131bb6-65eb-424e-a03f-633b1e34b128 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:28:15.400461 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1102/2196] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 12:28:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 12:28:15.406338 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-00bbb192-f1ee-40b5-8126-0ec76214eca2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd60fe3d585a54cc4b358cead1c42b72e'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:28:15.421003 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41131bb6-65eb-424e-a03f-633b1e34b128 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:28:15.423433 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41131bb6-65eb-424e-a03f-633b1e34b128 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:28:15.429923 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-00bbb192-f1ee-40b5-8126-0ec76214eca2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd60fe3d585a54cc4b358cead1c42b72e'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:28:15.430528 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe32883-91e0-41ce-8731-dc507af0dd0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:28:15.431078 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-00bbb192-f1ee-40b5-8126-0ec76214eca2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd60fe3d585a54cc4b358cead1c42b72e'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:28:15.431616 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe32883-91e0-41ce-8731-dc507af0dd0c admin admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:28:15.431736 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-00bbb192-f1ee-40b5-8126-0ec76214eca2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd60fe3d585a54cc4b358cead1c42b72e'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:28:15.432020 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe32883-91e0-41ce-8731-dc507af0dd0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:28:15.432642 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe32883-91e0-41ce-8731-dc507af0dd0c admin admin] PATH_INFO: `/v3/domains` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:28:15.433577 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe32883-91e0-41ce-8731-dc507af0dd0c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:28:15.433944 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe32883-91e0-41ce-8731-dc507af0dd0c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:28:15.435972 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe32883-91e0-41ce-8731-dc507af0dd0c admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:28:15.449583 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1103/2197] 10.222.0.44 () {58 vars in 1152 bytes} [Thu Jun 16 12:28:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:28:15.454233 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe32883-91e0-41ce-8731-dc507af0dd0c admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:28:15.456864 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-dbe32883-91e0-41ce-8731-dc507af0dd0c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:28:15.465718 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1095/2198] 10.222.0.44 () {58 vars in 1223 bytes} [Thu Jun 16 12:28:15 2022] DELETE /identity/v3/users/d60fe3d585a54cc4b358cead1c42b72e => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:28:15.469891 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd13a9e-537e-4d66-862d-fd5c14a29ab7 None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:28:15.469991 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd13a9e-537e-4d66-862d-fd5c14a29ab7 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:28:15.470282 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd13a9e-537e-4d66-862d-fd5c14a29ab7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:28:15.476268 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe32883-91e0-41ce-8731-dc507af0dd0c admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:28:15.509970 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-4dd13a9e-537e-4d66-862d-fd5c14a29ab7 None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:28:15.511957 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-4dd13a9e-537e-4d66-862d-fd5c14a29ab7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:28:15.552989 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:28:15.558450 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb31979-fc0d-43ed-bf93-0e17e497e30d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:28:15.558971 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb31979-fc0d-43ed-bf93-0e17e497e30d admin admin] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:28:15.559125 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb31979-fc0d-43ed-bf93-0e17e497e30d admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:28:15.559404 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb31979-fc0d-43ed-bf93-0e17e497e30d admin admin] PATH_INFO: `/v3/projects` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:28:15.560135 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb31979-fc0d-43ed-bf93-0e17e497e30d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:28:15.562122 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb31979-fc0d-43ed-bf93-0e17e497e30d admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:28:15.589269 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1096/2199] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 12:28:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 12:28:15.592374 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1104/2200] 10.222.0.44 () {60 vars in 1152 bytes} [Thu Jun 16 12:28:15 2022] POST /identity/v3/projects => generated 383 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 12:28:15.594529 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd13a9e-537e-4d66-862d-fd5c14a29ab7 None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:28:15.603902 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb31979-fc0d-43ed-bf93-0e17e497e30d admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:28:15.606606 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd13a9e-537e-4d66-862d-fd5c14a29ab7 None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:28:15.607519 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-4fb31979-fc0d-43ed-bf93-0e17e497e30d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:28:15.696582 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc807b67-6003-45ae-bd7f-ce9a7e2c15c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:28:15.697698 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc807b67-6003-45ae-bd7f-ce9a7e2c15c9 admin admin] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:28:15.698025 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc807b67-6003-45ae-bd7f-ce9a7e2c15c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:28:15.698433 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc807b67-6003-45ae-bd7f-ce9a7e2c15c9 admin admin] PATH_INFO: `/v3/users` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:28:15.699193 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc807b67-6003-45ae-bd7f-ce9a7e2c15c9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:28:15.701433 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc807b67-6003-45ae-bd7f-ce9a7e2c15c9 admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:28:15.729573 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1097/2201] 10.222.0.44 () {60 vars in 1143 bytes} [Thu Jun 16 12:28:15 2022] POST /identity/v3/users => generated 292 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 12:28:15.734622 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc807b67-6003-45ae-bd7f-ce9a7e2c15c9 admin admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:28:15.739066 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb31979-fc0d-43ed-bf93-0e17e497e30d admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:28:15.746114 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc807b67-6003-45ae-bd7f-ce9a7e2c15c9 admin admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:28:15.751281 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58dccd1-b1d5-421d-98fc-8745258c8026 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1094729b25a4be7b0b394998c9ca681', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '601361df39e34fcca71175aa94e425c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:28:15.752061 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58dccd1-b1d5-421d-98fc-8745258c8026 service neutron] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:28:15.752441 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58dccd1-b1d5-421d-98fc-8745258c8026 service neutron] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:28:15.752864 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58dccd1-b1d5-421d-98fc-8745258c8026 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:28:15.754199 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe10682d-18a3-48f8-9596-f98c5d821723 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:28:15.755087 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe10682d-18a3-48f8-9596-f98c5d821723 admin admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:28:15.755641 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe10682d-18a3-48f8-9596-f98c5d821723 admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:28:15.756123 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe10682d-18a3-48f8-9596-f98c5d821723 admin admin] PATH_INFO: `/v3/roles` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:28:15.757096 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe10682d-18a3-48f8-9596-f98c5d821723 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:28:15.759588 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe10682d-18a3-48f8-9596-f98c5d821723 admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:28:15.766959 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:DELETE=2,keystone:SELECT=97,keystone:INSERT=1 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:28:15.773623 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1098/2202] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 12:28:15 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 12:28:15.776917 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58dccd1-b1d5-421d-98fc-8745258c8026 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:28:15.778090 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe10682d-18a3-48f8-9596-f98c5d821723 admin admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:28:15.779784 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58dccd1-b1d5-421d-98fc-8745258c8026 service neutron] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:28:15.798824 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe10682d-18a3-48f8-9596-f98c5d821723 admin admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:28:15.806272 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42e42a5-0e9c-411a-aaeb-df04e7c587b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:28:15.807349 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1105/2203] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 12:28:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 12:28:15.807523 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42e42a5-0e9c-411a-aaeb-df04e7c587b9 admin admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:28:15.807822 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42e42a5-0e9c-411a-aaeb-df04e7c587b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:28:15.808100 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42e42a5-0e9c-411a-aaeb-df04e7c587b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:28:15.808869 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42e42a5-0e9c-411a-aaeb-df04e7c587b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:28:15.810543 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42e42a5-0e9c-411a-aaeb-df04e7c587b9 admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:28:15.827345 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1099/2204] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 12:28:15 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 12:28:15.828625 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58dccd1-b1d5-421d-98fc-8745258c8026 service neutron] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:28:15.839678 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58dccd1-b1d5-421d-98fc-8745258c8026 service neutron] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:28:15.845526 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03881ef-5ed3-43cf-85a8-f10e7526469b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:28:15.846239 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03881ef-5ed3-43cf-85a8-f10e7526469b admin admin] REQUEST_METHOD: `PUT` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:28:15.846524 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03881ef-5ed3-43cf-85a8-f10e7526469b admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:28:15.846802 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03881ef-5ed3-43cf-85a8-f10e7526469b admin admin] PATH_INFO: `/v3/projects/89b2d968bec347409331b58e8e339ad7/users/852b229f01114e849463c2e4e820510c/roles/c39882b202e942479a7cdac2fc6da72c` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:28:15.865529 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03881ef-5ed3-43cf-85a8-f10e7526469b admin admin] RBAC: Authorizing `identity:create_grant(project_id=89b2d968bec347409331b58e8e339ad7, user_id=852b229f01114e849463c2e4e820510c, role_id=c39882b202e942479a7cdac2fc6da72c)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:28:15.868695 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03881ef-5ed3-43cf-85a8-f10e7526469b admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:28:15.886348 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1106/2205] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 16 12:28:15 2022] PUT /identity/v3/projects/89b2d968bec347409331b58e8e339ad7/users/852b229f01114e849463c2e4e820510c/roles/c39882b202e942479a7cdac2fc6da72c => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:28:15.897779 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c129e2-2ae4-491e-9e6a-47a87b3a7fce None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:28:15.898169 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c129e2-2ae4-491e-9e6a-47a87b3a7fce None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:28:15.898578 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c129e2-2ae4-491e-9e6a-47a87b3a7fce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:28:15.940202 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-66c129e2-2ae4-491e-9e6a-47a87b3a7fce None None] MFA Rules not processed for user `852b229f01114e849463c2e4e820510c`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:28:15.942770 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-66c129e2-2ae4-491e-9e6a-47a87b3a7fce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:28:16.046235 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1100/2206] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 12:28:15 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:28:16.054837 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03881ef-5ed3-43cf-85a8-f10e7526469b admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:28:16.057065 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-e03881ef-5ed3-43cf-85a8-f10e7526469b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:28:16.171476 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c129e2-2ae4-491e-9e6a-47a87b3a7fce None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:28:16.173198 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-66c129e2-2ae4-491e-9e6a-47a87b3a7fce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:28:16.216467 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03881ef-5ed3-43cf-85a8-f10e7526469b admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:28:16.223734 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35288311-d679-4759-aba1-297fca1458a2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f96fc14ed89478c8a8c2f11c87511e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '601361df39e34fcca71175aa94e425c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:28:16.224701 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35288311-d679-4759-aba1-297fca1458a2 service cinder] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:28:16.225083 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35288311-d679-4759-aba1-297fca1458a2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:28:16.225219 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35288311-d679-4759-aba1-297fca1458a2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:28:16.234656 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:28:16.241859 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35288311-d679-4759-aba1-297fca1458a2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:28:16.243628 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35288311-d679-4759-aba1-297fca1458a2 service cinder] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:28:16.264285 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1107/2207] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 12:28:16 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 12:28:16.283619 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c129e2-2ae4-491e-9e6a-47a87b3a7fce None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:28:16.299961 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b9e0ac-2d88-4682-ae0a-a55d403d0685 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:28:16.301525 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b9e0ac-2d88-4682-ae0a-a55d403d0685 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:28:16.303368 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b9e0ac-2d88-4682-ae0a-a55d403d0685 admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:28:16.304068 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b9e0ac-2d88-4682-ae0a-a55d403d0685 admin admin] PATH_INFO: `/v3/projects/64e40aa9032f471f97b404d4cb4e2444` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:28:16.309611 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b9e0ac-2d88-4682-ae0a-a55d403d0685 admin admin] RBAC: Authorizing `identity:delete_project(project_id=64e40aa9032f471f97b404d4cb4e2444)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:28:16.311670 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b9e0ac-2d88-4682-ae0a-a55d403d0685 admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:28:16.403137 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-26b9e0ac-2d88-4682-ae0a-a55d403d0685 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '64e40aa9032f471f97b404d4cb4e2444', 'request_id': 'req-26b9e0ac-2d88-4682-ae0a-a55d403d0685'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:28:16.421375 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-26b9e0ac-2d88-4682-ae0a-a55d403d0685 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '64e40aa9032f471f97b404d4cb4e2444', 'request_id': 'req-26b9e0ac-2d88-4682-ae0a-a55d403d0685'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:28:16.435266 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-26b9e0ac-2d88-4682-ae0a-a55d403d0685 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '64e40aa9032f471f97b404d4cb4e2444', 'request_id': 'req-26b9e0ac-2d88-4682-ae0a-a55d403d0685'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:28:16.459450 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-26b9e0ac-2d88-4682-ae0a-a55d403d0685 admin admin] The token cache is being invalidate because project 64e40aa9032f471f97b404d4cb4e2444 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 12:28:16.459814 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-26b9e0ac-2d88-4682-ae0a-a55d403d0685 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:28:16.460625 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-26b9e0ac-2d88-4682-ae0a-a55d403d0685 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:28:16.463130 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1101/2208] 10.222.0.44 () {58 vars in 1232 bytes} [Thu Jun 16 12:28:16 2022] DELETE /identity/v3/projects/64e40aa9032f471f97b404d4cb4e2444 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 12:28:16.468722 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439f0f8a-7665-4666-8de4-86e0c86e9768 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:28:16.470260 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439f0f8a-7665-4666-8de4-86e0c86e9768 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:28:16.470572 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439f0f8a-7665-4666-8de4-86e0c86e9768 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:28:16.499671 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-439f0f8a-7665-4666-8de4-86e0c86e9768 None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:28:16.502574 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-439f0f8a-7665-4666-8de4-86e0c86e9768 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:28:16.588945 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1108/2209] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 12:28:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:28:16.598257 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b32012-84a9-4a08-bc19-59a3c8105856 None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:28:16.598778 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b32012-84a9-4a08-bc19-59a3c8105856 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:28:16.599248 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b32012-84a9-4a08-bc19-59a3c8105856 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:28:16.621796 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-46b32012-84a9-4a08-bc19-59a3c8105856 None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:28:16.623101 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-46b32012-84a9-4a08-bc19-59a3c8105856 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:28:16.632736 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1102/2210] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 12:28:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:28:16.637880 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439f0f8a-7665-4666-8de4-86e0c86e9768 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:28:16.650673 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439f0f8a-7665-4666-8de4-86e0c86e9768 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:28:16.661228 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368aa8ff-f617-4eaa-82a0-d2fcfb906e74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:28:16.662013 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368aa8ff-f617-4eaa-82a0-d2fcfb906e74 admin admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:28:16.662348 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368aa8ff-f617-4eaa-82a0-d2fcfb906e74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:28:16.662623 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368aa8ff-f617-4eaa-82a0-d2fcfb906e74 admin admin] PATH_INFO: `/v3/domains` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:28:16.663632 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368aa8ff-f617-4eaa-82a0-d2fcfb906e74 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:28:16.663981 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368aa8ff-f617-4eaa-82a0-d2fcfb906e74 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:28:16.665753 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368aa8ff-f617-4eaa-82a0-d2fcfb906e74 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:28:16.713942 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1109/2211] 10.222.0.44 () {58 vars in 1152 bytes} [Thu Jun 16 12:28:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:28:16.718258 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b32012-84a9-4a08-bc19-59a3c8105856 None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:28:16.732618 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b32012-84a9-4a08-bc19-59a3c8105856 None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:28:16.743259 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2d4f11-2ec0-4014-999d-d5adb9e37e75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:28:16.744329 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2d4f11-2ec0-4014-999d-d5adb9e37e75 admin admin] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:28:16.744708 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2d4f11-2ec0-4014-999d-d5adb9e37e75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:28:16.745108 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2d4f11-2ec0-4014-999d-d5adb9e37e75 admin admin] PATH_INFO: `/v3/projects` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:28:16.746347 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2d4f11-2ec0-4014-999d-d5adb9e37e75 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:28:16.748781 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2d4f11-2ec0-4014-999d-d5adb9e37e75 admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:28:16.801385 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1103/2212] 10.222.0.44 () {60 vars in 1152 bytes} [Thu Jun 16 12:28:16 2022] POST /identity/v3/projects => generated 385 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 12:28:16.803706 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368aa8ff-f617-4eaa-82a0-d2fcfb906e74 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:28:16.819583 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368aa8ff-f617-4eaa-82a0-d2fcfb906e74 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:28:16.897679 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8fc781-5443-4caa-b2d3-e824156149b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:28:16.898447 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8fc781-5443-4caa-b2d3-e824156149b1 admin admin] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:28:16.898790 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8fc781-5443-4caa-b2d3-e824156149b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:28:16.899136 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8fc781-5443-4caa-b2d3-e824156149b1 admin admin] PATH_INFO: `/v3/users` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:28:16.900073 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8fc781-5443-4caa-b2d3-e824156149b1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:28:16.905399 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8fc781-5443-4caa-b2d3-e824156149b1 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:28:16.913096 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:28:16.932197 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1110/2213] 10.222.0.44 () {60 vars in 1143 bytes} [Thu Jun 16 12:28:16 2022] POST /identity/v3/users => generated 293 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 12:28:16.935997 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2d4f11-2ec0-4014-999d-d5adb9e37e75 admin admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:28:16.947128 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2d4f11-2ec0-4014-999d-d5adb9e37e75 admin admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:28:16.953187 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17e44ad-e75f-4a75-b17b-adb13d289f0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:28:16.954122 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17e44ad-e75f-4a75-b17b-adb13d289f0f admin admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:28:16.954399 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17e44ad-e75f-4a75-b17b-adb13d289f0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:28:16.954672 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17e44ad-e75f-4a75-b17b-adb13d289f0f admin admin] PATH_INFO: `/v3/roles` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:28:16.955400 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17e44ad-e75f-4a75-b17b-adb13d289f0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:28:16.957684 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17e44ad-e75f-4a75-b17b-adb13d289f0f admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:28:16.968339 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1104/2214] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 12:28:16 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 12:28:16.972579 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8fc781-5443-4caa-b2d3-e824156149b1 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:28:16.983296 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8fc781-5443-4caa-b2d3-e824156149b1 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:28:16.988033 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcc23ae-896a-4dd7-9125-2ee7d794e47b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:28:16.988683 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcc23ae-896a-4dd7-9125-2ee7d794e47b admin admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:28:16.988994 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcc23ae-896a-4dd7-9125-2ee7d794e47b admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:28:16.989267 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcc23ae-896a-4dd7-9125-2ee7d794e47b admin admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:28:16.989984 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcc23ae-896a-4dd7-9125-2ee7d794e47b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:28:16.991613 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcc23ae-896a-4dd7-9125-2ee7d794e47b admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:28:17.001573 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1111/2215] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 12:28:16 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 12:28:17.006503 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17e44ad-e75f-4a75-b17b-adb13d289f0f admin admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:28:17.016458 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17e44ad-e75f-4a75-b17b-adb13d289f0f admin admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:28:17.021914 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8180ba-a1af-4b4f-9a4b-87eef4b590f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:28:17.022787 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8180ba-a1af-4b4f-9a4b-87eef4b590f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:28:17.023069 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8180ba-a1af-4b4f-9a4b-87eef4b590f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:28:17.023345 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8180ba-a1af-4b4f-9a4b-87eef4b590f2 admin admin] PATH_INFO: `/v3/projects/a19cd72b481b418e809bdedaac1c9df1/users/53812587c4db487bb4306ebcd47d4ad3/roles/c39882b202e942479a7cdac2fc6da72c` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:28:17.039621 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8180ba-a1af-4b4f-9a4b-87eef4b590f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a19cd72b481b418e809bdedaac1c9df1, user_id=53812587c4db487bb4306ebcd47d4ad3, role_id=c39882b202e942479a7cdac2fc6da72c)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:28:17.042299 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8180ba-a1af-4b4f-9a4b-87eef4b590f2 admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:28:17.054712 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1105/2216] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 16 12:28:17 2022] PUT /identity/v3/projects/a19cd72b481b418e809bdedaac1c9df1/users/53812587c4db487bb4306ebcd47d4ad3/roles/c39882b202e942479a7cdac2fc6da72c => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 12:28:17.064596 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028ef425-a270-4a06-9914-e0ad16cfea0f None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:28:17.064977 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028ef425-a270-4a06-9914-e0ad16cfea0f None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:28:17.065257 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028ef425-a270-4a06-9914-e0ad16cfea0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:28:17.092497 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-028ef425-a270-4a06-9914-e0ad16cfea0f None None] MFA Rules not processed for user `53812587c4db487bb4306ebcd47d4ad3`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:28:17.093735 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-028ef425-a270-4a06-9914-e0ad16cfea0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:28:17.155468 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1112/2217] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 12:28:17 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:28:17.166212 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8180ba-a1af-4b4f-9a4b-87eef4b590f2 admin admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:28:17.167893 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-cf8180ba-a1af-4b4f-9a4b-87eef4b590f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:28:17.224616 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8180ba-a1af-4b4f-9a4b-87eef4b590f2 admin admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:28:17.228377 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8736291-bbf3-4995-8527-240d771b421c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f96fc14ed89478c8a8c2f11c87511e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '601361df39e34fcca71175aa94e425c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:28:17.229043 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8736291-bbf3-4995-8527-240d771b421c service cinder] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:28:17.229326 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8736291-bbf3-4995-8527-240d771b421c service cinder] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:28:17.229601 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8736291-bbf3-4995-8527-240d771b421c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:28:17.238390 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8736291-bbf3-4995-8527-240d771b421c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:28:17.239815 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8736291-bbf3-4995-8527-240d771b421c service cinder] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:28:17.248895 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1106/2218] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 12:28:17 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 12:28:17.922505 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028ef425-a270-4a06-9914-e0ad16cfea0f None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:28:17.928293 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-028ef425-a270-4a06-9914-e0ad16cfea0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:28:18.013221 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8736291-bbf3-4995-8527-240d771b421c service cinder] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:28:18.015227 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-a8736291-bbf3-4995-8527-240d771b421c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:28:18.021041 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:28:18.051109 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028ef425-a270-4a06-9914-e0ad16cfea0f None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:28:18.072318 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53723d74-2e63-4926-9987-fa3b00f8e9ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:28:18.073411 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53723d74-2e63-4926-9987-fa3b00f8e9ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:28:18.074221 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53723d74-2e63-4926-9987-fa3b00f8e9ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:28:18.074597 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53723d74-2e63-4926-9987-fa3b00f8e9ce admin admin] PATH_INFO: `/v3/users/ae7bf6b5191745cd8f4e05aa58aefd59` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:28:18.076957 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53723d74-2e63-4926-9987-fa3b00f8e9ce admin admin] RBAC: Authorizing `identity:delete_user(user_id=ae7bf6b5191745cd8f4e05aa58aefd59)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:28:18.079528 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53723d74-2e63-4926-9987-fa3b00f8e9ce admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:28:18.137491 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8736291-bbf3-4995-8527-240d771b421c service cinder] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:28:18.143073 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aaa361a-e020-46a9-bfd5-17eee45d4bee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:28:18.144105 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaa361a-e020-46a9-bfd5-17eee45d4bee admin admin] REQUEST_METHOD: `DELETE` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:28:18.144378 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaa361a-e020-46a9-bfd5-17eee45d4bee admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:28:18.144658 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaa361a-e020-46a9-bfd5-17eee45d4bee admin admin] PATH_INFO: `/v3/users/ee47d81e557a45de98c74f692a0eac95` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:28:18.146123 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aaa361a-e020-46a9-bfd5-17eee45d4bee admin admin] RBAC: Authorizing `identity:delete_user(user_id=ee47d81e557a45de98c74f692a0eac95)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:28:18.148267 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aaa361a-e020-46a9-bfd5-17eee45d4bee admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:28:18.192800 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-53723d74-2e63-4926-9987-fa3b00f8e9ce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ae7bf6b5191745cd8f4e05aa58aefd59'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:28:18.193895 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-53723d74-2e63-4926-9987-fa3b00f8e9ce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ae7bf6b5191745cd8f4e05aa58aefd59'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:28:18.203515 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-53723d74-2e63-4926-9987-fa3b00f8e9ce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ae7bf6b5191745cd8f4e05aa58aefd59'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:28:18.204917 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-53723d74-2e63-4926-9987-fa3b00f8e9ce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ae7bf6b5191745cd8f4e05aa58aefd59'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:28:18.214648 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-53723d74-2e63-4926-9987-fa3b00f8e9ce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ae7bf6b5191745cd8f4e05aa58aefd59'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:28:18.221909 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:INSERT=4,keystone:SELECT=87,keystone:DELETE=9 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:28:18.225439 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-9aaa361a-e020-46a9-bfd5-17eee45d4bee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ee47d81e557a45de98c74f692a0eac95'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:28:18.248299 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1113/2219] 10.222.0.44 () {58 vars in 1223 bytes} [Thu Jun 16 12:28:17 2022] DELETE /identity/v3/users/ae7bf6b5191745cd8f4e05aa58aefd59 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:28:18.248507 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-9aaa361a-e020-46a9-bfd5-17eee45d4bee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ee47d81e557a45de98c74f692a0eac95'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:28:18.250477 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d8d8dc-0464-4788-8901-3b9e692c4157 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:28:18.251007 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d8d8dc-0464-4788-8901-3b9e692c4157 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:28:18.252526 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d8d8dc-0464-4788-8901-3b9e692c4157 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:28:18.265127 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-9aaa361a-e020-46a9-bfd5-17eee45d4bee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ee47d81e557a45de98c74f692a0eac95'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:28:18.266179 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-9aaa361a-e020-46a9-bfd5-17eee45d4bee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ee47d81e557a45de98c74f692a0eac95'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:28:18.267334 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-9aaa361a-e020-46a9-bfd5-17eee45d4bee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ee47d81e557a45de98c74f692a0eac95'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:28:18.272418 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-d2d8d8dc-0464-4788-8901-3b9e692c4157 None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:28:18.274036 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-d2d8d8dc-0464-4788-8901-3b9e692c4157 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:28:18.282997 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1107/2220] 10.222.0.44 () {58 vars in 1223 bytes} [Thu Jun 16 12:28:18 2022] DELETE /identity/v3/users/ee47d81e557a45de98c74f692a0eac95 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:28:18.288121 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa78090e-d998-4198-8fa3-41d3a1dc1241 None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:28:18.288406 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa78090e-d998-4198-8fa3-41d3a1dc1241 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:28:18.289604 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa78090e-d998-4198-8fa3-41d3a1dc1241 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:28:18.310805 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-fa78090e-d998-4198-8fa3-41d3a1dc1241 None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:28:18.312085 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-fa78090e-d998-4198-8fa3-41d3a1dc1241 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:28:18.343886 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1114/2221] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 12:28:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 12:28:18.354536 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d8d8dc-0464-4788-8901-3b9e692c4157 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:28:18.356147 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-d2d8d8dc-0464-4788-8901-3b9e692c4157 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:28:18.372703 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1108/2222] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 12:28:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 12:28:18.382446 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa78090e-d998-4198-8fa3-41d3a1dc1241 None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:28:18.383793 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-fa78090e-d998-4198-8fa3-41d3a1dc1241 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:28:18.410982 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:28:18.416630 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d8d8dc-0464-4788-8901-3b9e692c4157 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:28:18.451405 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa78090e-d998-4198-8fa3-41d3a1dc1241 None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:28:18.455055 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb61e01-e11a-478a-998e-f34c74e7e246 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1094729b25a4be7b0b394998c9ca681', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '601361df39e34fcca71175aa94e425c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:28:18.455707 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb61e01-e11a-478a-998e-f34c74e7e246 service neutron] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:28:18.456068 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb61e01-e11a-478a-998e-f34c74e7e246 service neutron] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:28:18.456800 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb61e01-e11a-478a-998e-f34c74e7e246 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:28:18.468056 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb61e01-e11a-478a-998e-f34c74e7e246 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:28:18.469509 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb61e01-e11a-478a-998e-f34c74e7e246 service neutron] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:28:18.470034 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04a7401-1eca-422a-9ebc-9c82eb1d7293 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1094729b25a4be7b0b394998c9ca681', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '601361df39e34fcca71175aa94e425c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:28:18.470688 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04a7401-1eca-422a-9ebc-9c82eb1d7293 service neutron] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:28:18.470966 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04a7401-1eca-422a-9ebc-9c82eb1d7293 service neutron] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:28:18.471244 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04a7401-1eca-422a-9ebc-9c82eb1d7293 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:28:18.479780 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1109/2223] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 12:28:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 12:28:18.481374 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04a7401-1eca-422a-9ebc-9c82eb1d7293 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:28:18.482840 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04a7401-1eca-422a-9ebc-9c82eb1d7293 service neutron] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:28:18.493241 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1115/2224] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 12:28:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 12:28:18.925257 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb61e01-e11a-478a-998e-f34c74e7e246 service neutron] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:28:18.929876 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-cfb61e01-e11a-478a-998e-f34c74e7e246 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:28:18.930800 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04a7401-1eca-422a-9ebc-9c82eb1d7293 service neutron] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:28:18.932935 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-d04a7401-1eca-422a-9ebc-9c82eb1d7293 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:28:18.961546 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04a7401-1eca-422a-9ebc-9c82eb1d7293 service neutron] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:28:18.975000 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8f5564-2a59-44d2-b019-03ba9ed2f230 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:28:18.976444 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8f5564-2a59-44d2-b019-03ba9ed2f230 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:28:18.977272 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8f5564-2a59-44d2-b019-03ba9ed2f230 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:28:18.978077 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8f5564-2a59-44d2-b019-03ba9ed2f230 admin admin] PATH_INFO: `/v3/projects/0bd76d02107648569df494c8d9ee2fc7` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:28:18.979720 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8f5564-2a59-44d2-b019-03ba9ed2f230 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0bd76d02107648569df494c8d9ee2fc7)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:28:18.980029 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb61e01-e11a-478a-998e-f34c74e7e246 service neutron] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:28:18.981932 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8f5564-2a59-44d2-b019-03ba9ed2f230 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:28:18.993686 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f996c91-6c76-491c-94f7-c4046a4f8eb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:28:18.994659 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f996c91-6c76-491c-94f7-c4046a4f8eb4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:28:18.994951 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f996c91-6c76-491c-94f7-c4046a4f8eb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:28:18.995257 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f996c91-6c76-491c-94f7-c4046a4f8eb4 admin admin] PATH_INFO: `/v3/projects/e9b540ad47e844cebad95cdfaf11b8c3` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:28:18.996801 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f996c91-6c76-491c-94f7-c4046a4f8eb4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e9b540ad47e844cebad95cdfaf11b8c3)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:28:18.998884 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f996c91-6c76-491c-94f7-c4046a4f8eb4 admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:28:19.079542 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-5f996c91-6c76-491c-94f7-c4046a4f8eb4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e9b540ad47e844cebad95cdfaf11b8c3', 'request_id': 'req-5f996c91-6c76-491c-94f7-c4046a4f8eb4'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:28:19.102368 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-5f996c91-6c76-491c-94f7-c4046a4f8eb4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e9b540ad47e844cebad95cdfaf11b8c3', 'request_id': 'req-5f996c91-6c76-491c-94f7-c4046a4f8eb4'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:28:19.104113 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:28:19.115535 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-5f996c91-6c76-491c-94f7-c4046a4f8eb4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e9b540ad47e844cebad95cdfaf11b8c3', 'request_id': 'req-5f996c91-6c76-491c-94f7-c4046a4f8eb4'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:28:19.118450 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-6d8f5564-2a59-44d2-b019-03ba9ed2f230 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0bd76d02107648569df494c8d9ee2fc7', 'request_id': 'req-6d8f5564-2a59-44d2-b019-03ba9ed2f230'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:28:19.130198 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-5f996c91-6c76-491c-94f7-c4046a4f8eb4 admin admin] The token cache is being invalidate because project e9b540ad47e844cebad95cdfaf11b8c3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 12:28:19.130697 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-5f996c91-6c76-491c-94f7-c4046a4f8eb4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:28:19.131618 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-5f996c91-6c76-491c-94f7-c4046a4f8eb4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:28:19.133689 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-6d8f5564-2a59-44d2-b019-03ba9ed2f230 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0bd76d02107648569df494c8d9ee2fc7', 'request_id': 'req-6d8f5564-2a59-44d2-b019-03ba9ed2f230'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:28:19.137185 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1110/2225] 10.222.0.44 () {58 vars in 1232 bytes} [Thu Jun 16 12:28:18 2022] DELETE /identity/v3/projects/e9b540ad47e844cebad95cdfaf11b8c3 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:28:19.137951 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f996c91-6c76-491c-94f7-c4046a4f8eb4 admin admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:28:19.141698 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-5f996c91-6c76-491c-94f7-c4046a4f8eb4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:28:19.143485 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-6d8f5564-2a59-44d2-b019-03ba9ed2f230 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0bd76d02107648569df494c8d9ee2fc7', 'request_id': 'req-6d8f5564-2a59-44d2-b019-03ba9ed2f230'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:28:19.166542 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-6d8f5564-2a59-44d2-b019-03ba9ed2f230 admin admin] The token cache is being invalidate because project 0bd76d02107648569df494c8d9ee2fc7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 12:28:19.166908 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-6d8f5564-2a59-44d2-b019-03ba9ed2f230 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:28:19.167817 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-6d8f5564-2a59-44d2-b019-03ba9ed2f230 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:28:19.169922 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1116/2226] 10.222.0.44 () {58 vars in 1232 bytes} [Thu Jun 16 12:28:18 2022] DELETE /identity/v3/projects/0bd76d02107648569df494c8d9ee2fc7 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 12:28:19.180771 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8f5564-2a59-44d2-b019-03ba9ed2f230 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:28:19.180771 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-6d8f5564-2a59-44d2-b019-03ba9ed2f230 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:28:19.234330 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f996c91-6c76-491c-94f7-c4046a4f8eb4 admin admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:28:19.258304 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8f5564-2a59-44d2-b019-03ba9ed2f230 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:28:19.265853 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d480b4-0de3-4d03-981a-2087ea455e6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:28:19.266834 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d480b4-0de3-4d03-981a-2087ea455e6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:28:19.268592 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d480b4-0de3-4d03-981a-2087ea455e6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:28:19.269462 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d480b4-0de3-4d03-981a-2087ea455e6c admin admin] PATH_INFO: `/v3/users/95faeac8a5d24606a2cdf59a997e52d7` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:28:19.273262 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d480b4-0de3-4d03-981a-2087ea455e6c admin admin] RBAC: Authorizing `identity:delete_user(user_id=95faeac8a5d24606a2cdf59a997e52d7)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:28:19.279482 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d480b4-0de3-4d03-981a-2087ea455e6c admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:28:19.297647 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:28:19.304986 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553e6740-b018-4044-93b8-04f51e979790 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:28:19.306500 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553e6740-b018-4044-93b8-04f51e979790 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:28:19.306500 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553e6740-b018-4044-93b8-04f51e979790 admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:28:19.306500 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553e6740-b018-4044-93b8-04f51e979790 admin admin] PATH_INFO: `/v3/users/852b229f01114e849463c2e4e820510c` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:28:19.308727 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553e6740-b018-4044-93b8-04f51e979790 admin admin] RBAC: Authorizing `identity:delete_user(user_id=852b229f01114e849463c2e4e820510c)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:28:19.310893 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553e6740-b018-4044-93b8-04f51e979790 admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:28:19.333660 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-d0d480b4-0de3-4d03-981a-2087ea455e6c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '95faeac8a5d24606a2cdf59a997e52d7'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:28:19.334335 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-d0d480b4-0de3-4d03-981a-2087ea455e6c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '95faeac8a5d24606a2cdf59a997e52d7'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:28:19.341769 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-d0d480b4-0de3-4d03-981a-2087ea455e6c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '95faeac8a5d24606a2cdf59a997e52d7'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:28:19.343750 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-d0d480b4-0de3-4d03-981a-2087ea455e6c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '95faeac8a5d24606a2cdf59a997e52d7'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:28:19.357767 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-d0d480b4-0de3-4d03-981a-2087ea455e6c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '95faeac8a5d24606a2cdf59a997e52d7'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:28:19.380311 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1117/2227] 10.222.0.44 () {58 vars in 1223 bytes} [Thu Jun 16 12:28:19 2022] DELETE /identity/v3/users/95faeac8a5d24606a2cdf59a997e52d7 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:28:19.380568 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-553e6740-b018-4044-93b8-04f51e979790 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '852b229f01114e849463c2e4e820510c'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:28:19.382129 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1245c51-e97b-4de2-8687-3e5ea2f1552f None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:28:19.382591 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1245c51-e97b-4de2-8687-3e5ea2f1552f None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:28:19.383153 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1245c51-e97b-4de2-8687-3e5ea2f1552f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:28:19.400777 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-553e6740-b018-4044-93b8-04f51e979790 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '852b229f01114e849463c2e4e820510c'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:28:19.403682 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-a1245c51-e97b-4de2-8687-3e5ea2f1552f None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:28:19.405051 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-a1245c51-e97b-4de2-8687-3e5ea2f1552f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:28:19.411164 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-553e6740-b018-4044-93b8-04f51e979790 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '852b229f01114e849463c2e4e820510c'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:28:19.412916 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-553e6740-b018-4044-93b8-04f51e979790 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '852b229f01114e849463c2e4e820510c'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:28:19.413989 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-553e6740-b018-4044-93b8-04f51e979790 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '852b229f01114e849463c2e4e820510c'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:28:19.433645 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1111/2228] 10.222.0.44 () {58 vars in 1223 bytes} [Thu Jun 16 12:28:19 2022] DELETE /identity/v3/users/852b229f01114e849463c2e4e820510c => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:28:19.442810 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd39aaf5-78ff-459d-ac22-2b6a01473a41 None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:28:19.442810 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd39aaf5-78ff-459d-ac22-2b6a01473a41 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:28:19.442810 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd39aaf5-78ff-459d-ac22-2b6a01473a41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:28:19.466903 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-bd39aaf5-78ff-459d-ac22-2b6a01473a41 None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:28:19.468394 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-bd39aaf5-78ff-459d-ac22-2b6a01473a41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:28:19.470356 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:28:19.494380 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1118/2229] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 12:28:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:28:19.502077 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d73fbf2-c8de-4888-b04a-7fffe5246282 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:28:19.502622 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d73fbf2-c8de-4888-b04a-7fffe5246282 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:28:19.503105 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d73fbf2-c8de-4888-b04a-7fffe5246282 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:28:19.524319 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-0d73fbf2-c8de-4888-b04a-7fffe5246282 None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:28:19.525726 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-0d73fbf2-c8de-4888-b04a-7fffe5246282 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:28:19.560613 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1112/2230] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 12:28:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:28:19.571030 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd39aaf5-78ff-459d-ac22-2b6a01473a41 None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:28:19.574719 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-bd39aaf5-78ff-459d-ac22-2b6a01473a41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:28:19.603022 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1119/2231] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 12:28:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 12:28:19.607156 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d73fbf2-c8de-4888-b04a-7fffe5246282 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:28:19.617862 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d73fbf2-c8de-4888-b04a-7fffe5246282 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:28:19.623350 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd24a3e-5500-45ef-addf-4ee4aff0d8a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:28:19.624160 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd24a3e-5500-45ef-addf-4ee4aff0d8a9 admin admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:28:19.624300 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd24a3e-5500-45ef-addf-4ee4aff0d8a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:28:19.624506 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd24a3e-5500-45ef-addf-4ee4aff0d8a9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:28:19.625269 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd24a3e-5500-45ef-addf-4ee4aff0d8a9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:28:19.625574 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd24a3e-5500-45ef-addf-4ee4aff0d8a9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:28:19.627261 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd24a3e-5500-45ef-addf-4ee4aff0d8a9 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:28:19.640541 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1120/2232] 10.222.0.44 () {58 vars in 1152 bytes} [Thu Jun 16 12:28:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:28:19.646776 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd24a3e-5500-45ef-addf-4ee4aff0d8a9 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:28:19.648549 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd39aaf5-78ff-459d-ac22-2b6a01473a41 None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:28:19.653196 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b97b3b-efb0-497f-b3df-b2d398f6a0c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1094729b25a4be7b0b394998c9ca681', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '601361df39e34fcca71175aa94e425c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:28:19.653857 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b97b3b-efb0-497f-b3df-b2d398f6a0c5 service neutron] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:28:19.654138 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b97b3b-efb0-497f-b3df-b2d398f6a0c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:28:19.654410 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b97b3b-efb0-497f-b3df-b2d398f6a0c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:28:19.663172 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd24a3e-5500-45ef-addf-4ee4aff0d8a9 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:28:19.664380 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b97b3b-efb0-497f-b3df-b2d398f6a0c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:28:19.665858 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b97b3b-efb0-497f-b3df-b2d398f6a0c5 service neutron] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:28:19.668272 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2565bd8e-8090-4593-8393-11e55f3eba90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:28:19.669093 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2565bd8e-8090-4593-8393-11e55f3eba90 admin admin] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:28:19.669436 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2565bd8e-8090-4593-8393-11e55f3eba90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:28:19.669780 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2565bd8e-8090-4593-8393-11e55f3eba90 admin admin] PATH_INFO: `/v3/projects` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:28:19.670409 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2565bd8e-8090-4593-8393-11e55f3eba90 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:28:19.672335 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2565bd8e-8090-4593-8393-11e55f3eba90 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:28:19.676809 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1113/2233] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 12:28:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 12:28:19.699836 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1121/2234] 10.222.0.44 () {60 vars in 1152 bytes} [Thu Jun 16 12:28:19 2022] POST /identity/v3/projects => generated 365 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 12:28:19.704208 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b97b3b-efb0-497f-b3df-b2d398f6a0c5 service neutron] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:28:19.714382 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b97b3b-efb0-497f-b3df-b2d398f6a0c5 service neutron] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:28:19.729851 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:28:19.746917 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2565bd8e-8090-4593-8393-11e55f3eba90 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:28:19.750072 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-2565bd8e-8090-4593-8393-11e55f3eba90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:28:19.806058 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a04564e-4797-4dc0-bd69-3e1c1e461600 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:28:19.807701 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a04564e-4797-4dc0-bd69-3e1c1e461600 admin admin] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:28:19.808019 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a04564e-4797-4dc0-bd69-3e1c1e461600 admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:28:19.808300 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a04564e-4797-4dc0-bd69-3e1c1e461600 admin admin] PATH_INFO: `/v3/users` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:28:19.809061 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a04564e-4797-4dc0-bd69-3e1c1e461600 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:28:19.812074 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a04564e-4797-4dc0-bd69-3e1c1e461600 admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:28:19.839295 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1114/2235] 10.222.0.44 () {60 vars in 1143 bytes} [Thu Jun 16 12:28:19 2022] POST /identity/v3/users => generated 283 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 12:28:19.844920 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a04564e-4797-4dc0-bd69-3e1c1e461600 admin admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:28:19.845356 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2565bd8e-8090-4593-8393-11e55f3eba90 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:28:19.852961 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f97d6d-58bb-4a93-ad2c-4eb483c4f44a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:28:19.854231 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f97d6d-58bb-4a93-ad2c-4eb483c4f44a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:28:19.854578 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f97d6d-58bb-4a93-ad2c-4eb483c4f44a admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:28:19.854924 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f97d6d-58bb-4a93-ad2c-4eb483c4f44a admin admin] PATH_INFO: `/v3/projects/b847741457a74cf6886c88ff6b9d7dd7` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:28:19.856288 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f97d6d-58bb-4a93-ad2c-4eb483c4f44a admin admin] RBAC: Authorizing `identity:delete_project(project_id=b847741457a74cf6886c88ff6b9d7dd7)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:28:19.856401 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a04564e-4797-4dc0-bd69-3e1c1e461600 admin admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:28:19.859130 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f97d6d-58bb-4a93-ad2c-4eb483c4f44a admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:28:19.861969 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88b1579-922c-4ab7-8d17-a02788831dfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:28:19.863275 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88b1579-922c-4ab7-8d17-a02788831dfa admin admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:28:19.863800 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88b1579-922c-4ab7-8d17-a02788831dfa admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:28:19.864458 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88b1579-922c-4ab7-8d17-a02788831dfa admin admin] PATH_INFO: `/v3/roles` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:28:19.865252 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88b1579-922c-4ab7-8d17-a02788831dfa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:28:19.866905 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88b1579-922c-4ab7-8d17-a02788831dfa admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:28:19.884209 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1115/2236] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 12:28:19 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 12:28:19.885456 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88b1579-922c-4ab7-8d17-a02788831dfa admin admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:28:19.898035 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88b1579-922c-4ab7-8d17-a02788831dfa admin admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:28:19.905187 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0541d7c-e3d6-4a1f-a3e4-30a46a2d8068 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:28:19.905843 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0541d7c-e3d6-4a1f-a3e4-30a46a2d8068 admin admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:28:19.906511 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0541d7c-e3d6-4a1f-a3e4-30a46a2d8068 admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:28:19.906511 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0541d7c-e3d6-4a1f-a3e4-30a46a2d8068 admin admin] PATH_INFO: `/v3/roles` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:28:19.907209 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0541d7c-e3d6-4a1f-a3e4-30a46a2d8068 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:28:19.909053 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0541d7c-e3d6-4a1f-a3e4-30a46a2d8068 admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:28:19.927974 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1116/2237] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 12:28:19 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 12:28:19.928875 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0541d7c-e3d6-4a1f-a3e4-30a46a2d8068 admin admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:28:19.940296 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0541d7c-e3d6-4a1f-a3e4-30a46a2d8068 admin admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:28:19.952114 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-e9f97d6d-58bb-4a93-ad2c-4eb483c4f44a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b847741457a74cf6886c88ff6b9d7dd7', 'request_id': 'req-e9f97d6d-58bb-4a93-ad2c-4eb483c4f44a'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:28:19.961706 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-e9f97d6d-58bb-4a93-ad2c-4eb483c4f44a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b847741457a74cf6886c88ff6b9d7dd7', 'request_id': 'req-e9f97d6d-58bb-4a93-ad2c-4eb483c4f44a'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:28:19.968595 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:28:19.976644 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-e9f97d6d-58bb-4a93-ad2c-4eb483c4f44a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b847741457a74cf6886c88ff6b9d7dd7', 'request_id': 'req-e9f97d6d-58bb-4a93-ad2c-4eb483c4f44a'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:28:19.992897 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-e9f97d6d-58bb-4a93-ad2c-4eb483c4f44a admin admin] The token cache is being invalidate because project b847741457a74cf6886c88ff6b9d7dd7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 12:28:19.993432 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-e9f97d6d-58bb-4a93-ad2c-4eb483c4f44a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:28:19.994370 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-e9f97d6d-58bb-4a93-ad2c-4eb483c4f44a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:28:19.997887 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1122/2238] 10.222.0.44 () {58 vars in 1232 bytes} [Thu Jun 16 12:28:19 2022] DELETE /identity/v3/projects/b847741457a74cf6886c88ff6b9d7dd7 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 12:28:20.002473 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb8d000-4523-4e89-b374-968115784fb0 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:28:20.002764 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb8d000-4523-4e89-b374-968115784fb0 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:28:20.003094 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb8d000-4523-4e89-b374-968115784fb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:28:20.016517 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf93850d-6cfa-4beb-9a50-af43b60dd219 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:28:20.017783 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf93850d-6cfa-4beb-9a50-af43b60dd219 admin admin] REQUEST_METHOD: `PUT` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:28:20.018194 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf93850d-6cfa-4beb-9a50-af43b60dd219 admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:28:20.018541 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf93850d-6cfa-4beb-9a50-af43b60dd219 admin admin] PATH_INFO: `/v3/projects/1e4273e21bfd4d62ae87c8efdc3bc76b/users/e4a67e956c0d44439ea5aba3e7ce12e6/roles/c39882b202e942479a7cdac2fc6da72c` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:28:20.024877 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-adb8d000-4523-4e89-b374-968115784fb0 None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:28:20.026423 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-adb8d000-4523-4e89-b374-968115784fb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:28:20.042421 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1123/2239] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 12:28:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:28:20.043930 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ac46e9-69a0-4b0c-bbf3-cccbb167bbde None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:28:20.044216 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ac46e9-69a0-4b0c-bbf3-cccbb167bbde None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:28:20.044630 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ac46e9-69a0-4b0c-bbf3-cccbb167bbde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:28:20.049487 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf93850d-6cfa-4beb-9a50-af43b60dd219 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e4273e21bfd4d62ae87c8efdc3bc76b, user_id=e4a67e956c0d44439ea5aba3e7ce12e6, role_id=c39882b202e942479a7cdac2fc6da72c)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:28:20.056474 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf93850d-6cfa-4beb-9a50-af43b60dd219 admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:28:20.088116 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1117/2240] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 16 12:28:19 2022] PUT /identity/v3/projects/1e4273e21bfd4d62ae87c8efdc3bc76b/users/e4a67e956c0d44439ea5aba3e7ce12e6/roles/c39882b202e942479a7cdac2fc6da72c => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 12:28:20.089087 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-b3ac46e9-69a0-4b0c-bbf3-cccbb167bbde None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:28:20.089087 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-b3ac46e9-69a0-4b0c-bbf3-cccbb167bbde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:28:20.091346 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f20eda2-af23-4261-af35-e870cef2e9f2 None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:28:20.091713 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f20eda2-af23-4261-af35-e870cef2e9f2 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:28:20.092241 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f20eda2-af23-4261-af35-e870cef2e9f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:28:20.130729 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-8f20eda2-af23-4261-af35-e870cef2e9f2 None None] MFA Rules not processed for user `e4a67e956c0d44439ea5aba3e7ce12e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:28:20.130729 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-8f20eda2-af23-4261-af35-e870cef2e9f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:28:20.181414 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1124/2241] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 12:28:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 12:28:20.182454 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ac46e9-69a0-4b0c-bbf3-cccbb167bbde None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:28:20.184057 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-b3ac46e9-69a0-4b0c-bbf3-cccbb167bbde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:28:20.197155 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ac46e9-69a0-4b0c-bbf3-cccbb167bbde None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:28:20.202470 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ec094a-66f7-4dbb-bc0d-3f693bee110b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:28:20.203538 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ec094a-66f7-4dbb-bc0d-3f693bee110b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:28:20.203723 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ec094a-66f7-4dbb-bc0d-3f693bee110b admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:28:20.203996 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ec094a-66f7-4dbb-bc0d-3f693bee110b admin admin] PATH_INFO: `/v3/projects/89b2d968bec347409331b58e8e339ad7` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:28:20.205386 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ec094a-66f7-4dbb-bc0d-3f693bee110b admin admin] RBAC: Authorizing `identity:delete_project(project_id=89b2d968bec347409331b58e8e339ad7)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:28:20.207973 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ec094a-66f7-4dbb-bc0d-3f693bee110b admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:28:20.265150 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:28:20.287195 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1118/2242] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 12:28:20 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 12:28:20.290969 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f20eda2-af23-4261-af35-e870cef2e9f2 None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:28:20.311156 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f20eda2-af23-4261-af35-e870cef2e9f2 None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:28:20.339997 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-24ec094a-66f7-4dbb-bc0d-3f693bee110b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '89b2d968bec347409331b58e8e339ad7', 'request_id': 'req-24ec094a-66f7-4dbb-bc0d-3f693bee110b'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:28:20.355979 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-24ec094a-66f7-4dbb-bc0d-3f693bee110b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '89b2d968bec347409331b58e8e339ad7', 'request_id': 'req-24ec094a-66f7-4dbb-bc0d-3f693bee110b'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:28:20.368861 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-24ec094a-66f7-4dbb-bc0d-3f693bee110b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '89b2d968bec347409331b58e8e339ad7', 'request_id': 'req-24ec094a-66f7-4dbb-bc0d-3f693bee110b'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:28:20.387079 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-24ec094a-66f7-4dbb-bc0d-3f693bee110b admin admin] The token cache is being invalidate because project 89b2d968bec347409331b58e8e339ad7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 12:28:20.387797 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-24ec094a-66f7-4dbb-bc0d-3f693bee110b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:28:20.404863 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f7395c-cd7d-451f-9296-ca085d63d4c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:28:20.405957 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f7395c-cd7d-451f-9296-ca085d63d4c6 admin admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:28:20.406522 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f7395c-cd7d-451f-9296-ca085d63d4c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:28:20.406895 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f7395c-cd7d-451f-9296-ca085d63d4c6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:28:20.407824 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f7395c-cd7d-451f-9296-ca085d63d4c6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:28:20.408324 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f7395c-cd7d-451f-9296-ca085d63d4c6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:28:20.411117 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f7395c-cd7d-451f-9296-ca085d63d4c6 admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:28:20.413004 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-24ec094a-66f7-4dbb-bc0d-3f693bee110b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:28:20.415207 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1125/2243] 10.222.0.44 () {58 vars in 1232 bytes} [Thu Jun 16 12:28:20 2022] DELETE /identity/v3/projects/89b2d968bec347409331b58e8e339ad7 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:28:20.416257 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ec094a-66f7-4dbb-bc0d-3f693bee110b admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:28:20.418479 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-24ec094a-66f7-4dbb-bc0d-3f693bee110b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:28:20.454145 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1119/2244] 10.222.0.44 () {58 vars in 1152 bytes} [Thu Jun 16 12:28:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:28:20.456933 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f7395c-cd7d-451f-9296-ca085d63d4c6 admin admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:28:20.461729 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-10f7395c-cd7d-451f-9296-ca085d63d4c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:28:20.503031 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f7395c-cd7d-451f-9296-ca085d63d4c6 admin admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:28:20.515801 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de67ad68-3b44-4123-85ed-e74ec5165a3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:28:20.520094 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de67ad68-3b44-4123-85ed-e74ec5165a3d admin admin] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:28:20.520502 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de67ad68-3b44-4123-85ed-e74ec5165a3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:28:20.520850 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de67ad68-3b44-4123-85ed-e74ec5165a3d admin admin] PATH_INFO: `/v3/projects` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:28:20.521603 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de67ad68-3b44-4123-85ed-e74ec5165a3d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:28:20.533786 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de67ad68-3b44-4123-85ed-e74ec5165a3d admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:28:20.551152 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ec094a-66f7-4dbb-bc0d-3f693bee110b admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:28:20.561492 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845adea1-4332-4ae5-9d9e-7000db099442 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f96fc14ed89478c8a8c2f11c87511e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '601361df39e34fcca71175aa94e425c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:28:20.563544 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845adea1-4332-4ae5-9d9e-7000db099442 service cinder] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:28:20.566428 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845adea1-4332-4ae5-9d9e-7000db099442 service cinder] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:28:20.567740 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845adea1-4332-4ae5-9d9e-7000db099442 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:28:20.573215 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-845adea1-4332-4ae5-9d9e-7000db099442 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:28:20.584195 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1120/2245] 10.222.0.44 () {60 vars in 1152 bytes} [Thu Jun 16 12:28:20 2022] POST /identity/v3/projects => generated 373 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 12:28:20.588226 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de67ad68-3b44-4123-85ed-e74ec5165a3d admin admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:28:20.621348 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:28:20.714507 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de67ad68-3b44-4123-85ed-e74ec5165a3d admin admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:28:20.719889 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22697ea6-b02d-43c0-9518-2f0c293f077a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:28:20.720686 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22697ea6-b02d-43c0-9518-2f0c293f077a admin admin] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:28:20.721112 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22697ea6-b02d-43c0-9518-2f0c293f077a admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:28:20.721493 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22697ea6-b02d-43c0-9518-2f0c293f077a admin admin] PATH_INFO: `/v3/users` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:28:20.722989 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22697ea6-b02d-43c0-9518-2f0c293f077a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:28:20.725426 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22697ea6-b02d-43c0-9518-2f0c293f077a admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:28:20.741511 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845adea1-4332-4ae5-9d9e-7000db099442 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:28:20.743079 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845adea1-4332-4ae5-9d9e-7000db099442 service cinder] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:28:20.756016 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1121/2246] 10.222.0.44 () {60 vars in 1143 bytes} [Thu Jun 16 12:28:20 2022] POST /identity/v3/users => generated 287 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 12:28:20.760324 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22697ea6-b02d-43c0-9518-2f0c293f077a admin admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:28:20.762002 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1126/2247] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 12:28:20 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 12:28:20.775365 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22697ea6-b02d-43c0-9518-2f0c293f077a admin admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:28:20.782396 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1af95df-7364-4a91-838d-392e44034b3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:28:20.783656 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1af95df-7364-4a91-838d-392e44034b3a admin admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:28:20.790573 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1af95df-7364-4a91-838d-392e44034b3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:28:20.790573 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1af95df-7364-4a91-838d-392e44034b3a admin admin] PATH_INFO: `/v3/roles` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:28:20.790573 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1af95df-7364-4a91-838d-392e44034b3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:28:20.796266 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1af95df-7364-4a91-838d-392e44034b3a admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:28:20.812483 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1122/2248] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 12:28:20 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 12:28:20.817405 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845adea1-4332-4ae5-9d9e-7000db099442 service cinder] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:28:20.831696 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845adea1-4332-4ae5-9d9e-7000db099442 service cinder] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:28:20.836979 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4033b6f4-2547-4620-856d-bdf1881dc4eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:28:20.837577 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4033b6f4-2547-4620-856d-bdf1881dc4eb admin admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:28:20.837857 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4033b6f4-2547-4620-856d-bdf1881dc4eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:28:20.838132 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4033b6f4-2547-4620-856d-bdf1881dc4eb admin admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:28:20.839974 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4033b6f4-2547-4620-856d-bdf1881dc4eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:28:20.841655 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4033b6f4-2547-4620-856d-bdf1881dc4eb admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:28:20.861494 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1127/2249] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 12:28:20 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 12:28:20.864304 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1af95df-7364-4a91-838d-392e44034b3a admin admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:28:20.878348 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1af95df-7364-4a91-838d-392e44034b3a admin admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:28:20.883993 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4b0630-2296-4422-a1e1-5127c37749f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:28:20.885036 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4b0630-2296-4422-a1e1-5127c37749f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:28:20.885345 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4b0630-2296-4422-a1e1-5127c37749f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:28:20.885650 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4b0630-2296-4422-a1e1-5127c37749f0 admin admin] PATH_INFO: `/v3/projects/6193dfa0106f40699034a4e29143786f/users/65c04af9ce1448b3a88daf1a895db44a/roles/c39882b202e942479a7cdac2fc6da72c` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:28:20.908325 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4b0630-2296-4422-a1e1-5127c37749f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6193dfa0106f40699034a4e29143786f, user_id=65c04af9ce1448b3a88daf1a895db44a, role_id=c39882b202e942479a7cdac2fc6da72c)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:28:20.912239 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4b0630-2296-4422-a1e1-5127c37749f0 admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:28:20.937730 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1123/2250] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 16 12:28:20 2022] PUT /identity/v3/projects/6193dfa0106f40699034a4e29143786f/users/65c04af9ce1448b3a88daf1a895db44a/roles/c39882b202e942479a7cdac2fc6da72c => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:28:20.948166 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc2e183-b6f4-43e2-8952-6c3520d46dda None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:28:20.948452 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc2e183-b6f4-43e2-8952-6c3520d46dda None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:28:20.948733 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc2e183-b6f4-43e2-8952-6c3520d46dda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:28:20.980869 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-7bc2e183-b6f4-43e2-8952-6c3520d46dda None None] MFA Rules not processed for user `65c04af9ce1448b3a88daf1a895db44a`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:28:20.982190 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-7bc2e183-b6f4-43e2-8952-6c3520d46dda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:28:21.063987 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1128/2251] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 12:28:20 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:28:21.068791 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4b0630-2296-4422-a1e1-5127c37749f0 admin admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:28:21.110345 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:28:21.181498 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4b0630-2296-4422-a1e1-5127c37749f0 admin admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:28:21.187003 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea1ec8e-5576-466d-b63d-64f4ac12cd06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:28:21.187828 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea1ec8e-5576-466d-b63d-64f4ac12cd06 admin admin] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:28:21.188125 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea1ec8e-5576-466d-b63d-64f4ac12cd06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:28:21.188402 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea1ec8e-5576-466d-b63d-64f4ac12cd06 admin admin] PATH_INFO: `/v3/projects` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:28:21.189218 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea1ec8e-5576-466d-b63d-64f4ac12cd06 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:28:21.191335 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea1ec8e-5576-466d-b63d-64f4ac12cd06 admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:28:21.219086 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1124/2252] 10.222.0.44 () {60 vars in 1152 bytes} [Thu Jun 16 12:28:21 2022] POST /identity/v3/projects => generated 375 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 12:28:21.223714 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc2e183-b6f4-43e2-8952-6c3520d46dda None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:28:21.234624 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc2e183-b6f4-43e2-8952-6c3520d46dda None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:28:21.297580 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c978f49a-27ce-42c3-935a-3ef2deffcdc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:28:21.298252 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c978f49a-27ce-42c3-935a-3ef2deffcdc1 admin admin] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:28:21.298532 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c978f49a-27ce-42c3-935a-3ef2deffcdc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:28:21.298805 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c978f49a-27ce-42c3-935a-3ef2deffcdc1 admin admin] PATH_INFO: `/v3/users` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:28:21.299494 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c978f49a-27ce-42c3-935a-3ef2deffcdc1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:28:21.301491 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c978f49a-27ce-42c3-935a-3ef2deffcdc1 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:28:21.325658 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1129/2253] 10.222.0.44 () {60 vars in 1143 bytes} [Thu Jun 16 12:28:21 2022] POST /identity/v3/users => generated 294 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 12:28:21.326824 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea1ec8e-5576-466d-b63d-64f4ac12cd06 admin admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:28:21.337825 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea1ec8e-5576-466d-b63d-64f4ac12cd06 admin admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:28:21.342562 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8263a3f-3f1f-470e-9e3c-38a56a94ffad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:28:21.343303 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8263a3f-3f1f-470e-9e3c-38a56a94ffad admin admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:28:21.343593 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8263a3f-3f1f-470e-9e3c-38a56a94ffad admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:28:21.343871 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8263a3f-3f1f-470e-9e3c-38a56a94ffad admin admin] PATH_INFO: `/v3/roles` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:28:21.344599 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8263a3f-3f1f-470e-9e3c-38a56a94ffad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:28:21.346236 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8263a3f-3f1f-470e-9e3c-38a56a94ffad admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:28:21.358656 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1125/2254] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 12:28:21 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 12:28:21.363087 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c978f49a-27ce-42c3-935a-3ef2deffcdc1 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:28:21.373394 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c978f49a-27ce-42c3-935a-3ef2deffcdc1 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:28:21.380815 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a769bcec-52c8-4664-89b7-5cda8deaaf71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:28:21.380815 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a769bcec-52c8-4664-89b7-5cda8deaaf71 admin admin] REQUEST_METHOD: `PUT` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:28:21.381078 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a769bcec-52c8-4664-89b7-5cda8deaaf71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:28:21.381350 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a769bcec-52c8-4664-89b7-5cda8deaaf71 admin admin] PATH_INFO: `/v3/projects/d0a9b7550db44c42a442a5b202894c91/users/68d13523e82d45019ad0c51bfb85ea63/roles/0688968254744e3f9913653cafea3091` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:28:21.399799 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a769bcec-52c8-4664-89b7-5cda8deaaf71 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d0a9b7550db44c42a442a5b202894c91, user_id=68d13523e82d45019ad0c51bfb85ea63, role_id=0688968254744e3f9913653cafea3091)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:28:21.404272 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a769bcec-52c8-4664-89b7-5cda8deaaf71 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:28:21.415417 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:28:21.423564 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1130/2255] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 16 12:28:21 2022] PUT /identity/v3/projects/d0a9b7550db44c42a442a5b202894c91/users/68d13523e82d45019ad0c51bfb85ea63/roles/0688968254744e3f9913653cafea3091 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 12:28:21.427892 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8263a3f-3f1f-470e-9e3c-38a56a94ffad admin admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:28:21.452549 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8263a3f-3f1f-470e-9e3c-38a56a94ffad admin admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:28:21.511553 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20830501-9445-4ec9-8073-981b611ca424 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:28:21.512235 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20830501-9445-4ec9-8073-981b611ca424 admin admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:28:21.512517 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20830501-9445-4ec9-8073-981b611ca424 admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:28:21.512981 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20830501-9445-4ec9-8073-981b611ca424 admin admin] PATH_INFO: `/v3/roles` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:28:21.513730 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20830501-9445-4ec9-8073-981b611ca424 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:28:21.515437 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20830501-9445-4ec9-8073-981b611ca424 admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:28:21.529849 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1126/2256] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 12:28:21 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 12:28:21.530877 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a769bcec-52c8-4664-89b7-5cda8deaaf71 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:28:21.541962 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a769bcec-52c8-4664-89b7-5cda8deaaf71 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:28:21.546707 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04937688-e395-471d-a04d-0d60c6e2edce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:28:21.547591 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04937688-e395-471d-a04d-0d60c6e2edce admin admin] REQUEST_METHOD: `PUT` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:28:21.547876 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04937688-e395-471d-a04d-0d60c6e2edce admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:28:21.548153 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04937688-e395-471d-a04d-0d60c6e2edce admin admin] PATH_INFO: `/v3/projects/d0a9b7550db44c42a442a5b202894c91/users/68d13523e82d45019ad0c51bfb85ea63/roles/0688968254744e3f9913653cafea3091` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:28:21.550196 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04937688-e395-471d-a04d-0d60c6e2edce admin admin] RBAC: Authorizing `identity:create_grant(project_id=d0a9b7550db44c42a442a5b202894c91, user_id=68d13523e82d45019ad0c51bfb85ea63, role_id=0688968254744e3f9913653cafea3091)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:28:21.552872 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04937688-e395-471d-a04d-0d60c6e2edce admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:28:21.563206 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1131/2257] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 16 12:28:21 2022] PUT /identity/v3/projects/d0a9b7550db44c42a442a5b202894c91/users/68d13523e82d45019ad0c51bfb85ea63/roles/0688968254744e3f9913653cafea3091 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 12:28:21.574847 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed369d96-90d5-4c9c-8587-6be5bbfa20fc None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:28:21.575202 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed369d96-90d5-4c9c-8587-6be5bbfa20fc None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:28:21.575588 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed369d96-90d5-4c9c-8587-6be5bbfa20fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:28:21.607157 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-ed369d96-90d5-4c9c-8587-6be5bbfa20fc None None] MFA Rules not processed for user `68d13523e82d45019ad0c51bfb85ea63`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:28:21.608489 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-ed369d96-90d5-4c9c-8587-6be5bbfa20fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:28:21.683989 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1127/2258] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 12:28:21 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:28:21.695813 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04937688-e395-471d-a04d-0d60c6e2edce admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:28:21.697549 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-04937688-e395-471d-a04d-0d60c6e2edce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:28:21.777123 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04937688-e395-471d-a04d-0d60c6e2edce admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:28:21.782715 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df380826-63cc-4d3e-ae57-ed7bee198b63 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f96fc14ed89478c8a8c2f11c87511e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '601361df39e34fcca71175aa94e425c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:28:21.783435 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df380826-63cc-4d3e-ae57-ed7bee198b63 service cinder] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:28:21.783765 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df380826-63cc-4d3e-ae57-ed7bee198b63 service cinder] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:28:21.784078 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df380826-63cc-4d3e-ae57-ed7bee198b63 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:28:21.851257 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df380826-63cc-4d3e-ae57-ed7bee198b63 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:28:21.852901 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df380826-63cc-4d3e-ae57-ed7bee198b63 service cinder] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:28:21.863362 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1132/2259] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 12:28:21 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 12:28:23.183050 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed369d96-90d5-4c9c-8587-6be5bbfa20fc None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:28:23.189413 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-ed369d96-90d5-4c9c-8587-6be5bbfa20fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:28:23.212160 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:28:23.260432 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed369d96-90d5-4c9c-8587-6be5bbfa20fc None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:28:23.265512 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec09e69-73b4-4ab6-8d3c-2d3f863f9e2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:28:23.266581 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec09e69-73b4-4ab6-8d3c-2d3f863f9e2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:28:23.266881 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec09e69-73b4-4ab6-8d3c-2d3f863f9e2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:28:23.267163 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec09e69-73b4-4ab6-8d3c-2d3f863f9e2e admin admin] PATH_INFO: `/v3/users/53812587c4db487bb4306ebcd47d4ad3` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:28:23.269089 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec09e69-73b4-4ab6-8d3c-2d3f863f9e2e admin admin] RBAC: Authorizing `identity:delete_user(user_id=53812587c4db487bb4306ebcd47d4ad3)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:28:23.271231 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec09e69-73b4-4ab6-8d3c-2d3f863f9e2e admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:28:23.326817 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-bec09e69-73b4-4ab6-8d3c-2d3f863f9e2e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '53812587c4db487bb4306ebcd47d4ad3'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:28:23.340150 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-bec09e69-73b4-4ab6-8d3c-2d3f863f9e2e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '53812587c4db487bb4306ebcd47d4ad3'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:28:23.347960 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-bec09e69-73b4-4ab6-8d3c-2d3f863f9e2e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '53812587c4db487bb4306ebcd47d4ad3'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:28:23.348678 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-bec09e69-73b4-4ab6-8d3c-2d3f863f9e2e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '53812587c4db487bb4306ebcd47d4ad3'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:28:23.349442 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-bec09e69-73b4-4ab6-8d3c-2d3f863f9e2e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '53812587c4db487bb4306ebcd47d4ad3'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:28:23.372951 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1128/2260] 10.222.0.44 () {58 vars in 1223 bytes} [Thu Jun 16 12:28:23 2022] DELETE /identity/v3/users/53812587c4db487bb4306ebcd47d4ad3 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:28:23.377539 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2493322-b47a-462a-9e55-28a846320698 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:28:23.378057 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2493322-b47a-462a-9e55-28a846320698 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:28:23.378283 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2493322-b47a-462a-9e55-28a846320698 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:28:23.397642 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-a2493322-b47a-462a-9e55-28a846320698 None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:28:23.399108 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-a2493322-b47a-462a-9e55-28a846320698 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:28:23.481193 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1133/2261] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 12:28:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:28:23.491407 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec09e69-73b4-4ab6-8d3c-2d3f863f9e2e admin admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:28:23.493046 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-bec09e69-73b4-4ab6-8d3c-2d3f863f9e2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:28:23.571575 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec09e69-73b4-4ab6-8d3c-2d3f863f9e2e admin admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:28:23.575224 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0977d44c-89d8-4a28-b2f9-8550d7153d04 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1094729b25a4be7b0b394998c9ca681', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '601361df39e34fcca71175aa94e425c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:28:23.575861 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0977d44c-89d8-4a28-b2f9-8550d7153d04 service neutron] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:28:23.576137 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0977d44c-89d8-4a28-b2f9-8550d7153d04 service neutron] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:28:23.576403 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0977d44c-89d8-4a28-b2f9-8550d7153d04 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:28:23.585468 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0977d44c-89d8-4a28-b2f9-8550d7153d04 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:28:23.586821 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0977d44c-89d8-4a28-b2f9-8550d7153d04 service neutron] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:28:23.596283 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1129/2262] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 12:28:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 12:28:23.886748 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2493322-b47a-462a-9e55-28a846320698 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:28:23.888955 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-a2493322-b47a-462a-9e55-28a846320698 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:28:23.907602 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2493322-b47a-462a-9e55-28a846320698 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:28:23.921334 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f46f6a5-98bc-4f75-96fe-0c4c37597644 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:28:23.922291 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f46f6a5-98bc-4f75-96fe-0c4c37597644 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:28:23.922578 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f46f6a5-98bc-4f75-96fe-0c4c37597644 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:28:23.922857 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f46f6a5-98bc-4f75-96fe-0c4c37597644 admin admin] PATH_INFO: `/v3/projects/a19cd72b481b418e809bdedaac1c9df1` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:28:23.924388 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f46f6a5-98bc-4f75-96fe-0c4c37597644 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a19cd72b481b418e809bdedaac1c9df1)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:28:23.929325 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f46f6a5-98bc-4f75-96fe-0c4c37597644 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:28:23.973670 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:28:23.984773 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-4f46f6a5-98bc-4f75-96fe-0c4c37597644 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a19cd72b481b418e809bdedaac1c9df1', 'request_id': 'req-4f46f6a5-98bc-4f75-96fe-0c4c37597644'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:28:23.993006 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-4f46f6a5-98bc-4f75-96fe-0c4c37597644 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a19cd72b481b418e809bdedaac1c9df1', 'request_id': 'req-4f46f6a5-98bc-4f75-96fe-0c4c37597644'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:28:23.998652 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-4f46f6a5-98bc-4f75-96fe-0c4c37597644 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a19cd72b481b418e809bdedaac1c9df1', 'request_id': 'req-4f46f6a5-98bc-4f75-96fe-0c4c37597644'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:28:24.009555 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-4f46f6a5-98bc-4f75-96fe-0c4c37597644 admin admin] The token cache is being invalidate because project a19cd72b481b418e809bdedaac1c9df1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 12:28:24.009844 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-4f46f6a5-98bc-4f75-96fe-0c4c37597644 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:28:24.010503 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-4f46f6a5-98bc-4f75-96fe-0c4c37597644 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:28:24.012028 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1134/2263] 10.222.0.44 () {58 vars in 1232 bytes} [Thu Jun 16 12:28:23 2022] DELETE /identity/v3/projects/a19cd72b481b418e809bdedaac1c9df1 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:28:24.016736 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd9bf3d-022a-4180-a35f-c5acb5fc8901 None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:28:24.017044 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd9bf3d-022a-4180-a35f-c5acb5fc8901 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:28:24.017339 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd9bf3d-022a-4180-a35f-c5acb5fc8901 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:28:24.036517 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-2fd9bf3d-022a-4180-a35f-c5acb5fc8901 None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:28:24.037758 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-2fd9bf3d-022a-4180-a35f-c5acb5fc8901 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:28:24.074879 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:28:24.099129 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1130/2264] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 12:28:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:28:24.107751 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b87a7d-d71b-40ee-875a-b98c301e6ee0 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:28:24.108060 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b87a7d-d71b-40ee-875a-b98c301e6ee0 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:28:24.108320 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b87a7d-d71b-40ee-875a-b98c301e6ee0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:28:24.127437 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-51b87a7d-d71b-40ee-875a-b98c301e6ee0 None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:28:24.128650 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-51b87a7d-d71b-40ee-875a-b98c301e6ee0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:28:24.136879 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1135/2265] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 12:28:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:28:24.141075 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd9bf3d-022a-4180-a35f-c5acb5fc8901 None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:28:24.151556 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd9bf3d-022a-4180-a35f-c5acb5fc8901 None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:28:24.156473 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d047a6dd-8767-412d-8c9c-65e26189cf29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:28:24.157166 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d047a6dd-8767-412d-8c9c-65e26189cf29 admin admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:28:24.157461 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d047a6dd-8767-412d-8c9c-65e26189cf29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:28:24.157735 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d047a6dd-8767-412d-8c9c-65e26189cf29 admin admin] PATH_INFO: `/v3/domains` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:28:24.158486 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d047a6dd-8767-412d-8c9c-65e26189cf29 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:28:24.158789 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d047a6dd-8767-412d-8c9c-65e26189cf29 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:28:24.161224 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d047a6dd-8767-412d-8c9c-65e26189cf29 admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:28:24.174211 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1131/2266] 10.222.0.44 () {58 vars in 1152 bytes} [Thu Jun 16 12:28:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:28:24.178928 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b87a7d-d71b-40ee-875a-b98c301e6ee0 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:28:24.190910 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b87a7d-d71b-40ee-875a-b98c301e6ee0 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:28:24.196539 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91f7322-9bef-4256-ab72-4643e533e5af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:28:24.197258 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91f7322-9bef-4256-ab72-4643e533e5af admin admin] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:28:24.197859 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91f7322-9bef-4256-ab72-4643e533e5af admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:28:24.198153 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91f7322-9bef-4256-ab72-4643e533e5af admin admin] PATH_INFO: `/v3/projects` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:28:24.198927 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91f7322-9bef-4256-ab72-4643e533e5af admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:28:24.201150 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91f7322-9bef-4256-ab72-4643e533e5af admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:28:24.232788 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1136/2267] 10.222.0.44 () {60 vars in 1152 bytes} [Thu Jun 16 12:28:24 2022] POST /identity/v3/projects => generated 373 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 12:28:24.235428 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d047a6dd-8767-412d-8c9c-65e26189cf29 admin admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:28:24.245819 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d047a6dd-8767-412d-8c9c-65e26189cf29 admin admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:28:24.309254 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46e8df8-a85b-43d7-b84c-7cf3168fa406 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:28:24.309924 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46e8df8-a85b-43d7-b84c-7cf3168fa406 admin admin] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:28:24.310205 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46e8df8-a85b-43d7-b84c-7cf3168fa406 admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:28:24.310476 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46e8df8-a85b-43d7-b84c-7cf3168fa406 admin admin] PATH_INFO: `/v3/users` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:28:24.311158 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46e8df8-a85b-43d7-b84c-7cf3168fa406 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:28:24.313095 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46e8df8-a85b-43d7-b84c-7cf3168fa406 admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:28:24.340603 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1132/2268] 10.222.0.44 () {60 vars in 1143 bytes} [Thu Jun 16 12:28:24 2022] POST /identity/v3/users => generated 287 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 12:28:24.344649 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91f7322-9bef-4256-ab72-4643e533e5af admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:28:24.354957 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91f7322-9bef-4256-ab72-4643e533e5af admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:28:24.359487 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a07366f-f9a7-4f4f-bc6f-f14d9c62d45e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:28:24.360143 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a07366f-f9a7-4f4f-bc6f-f14d9c62d45e admin admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:28:24.360463 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a07366f-f9a7-4f4f-bc6f-f14d9c62d45e admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:28:24.360828 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a07366f-f9a7-4f4f-bc6f-f14d9c62d45e admin admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:28:24.361583 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a07366f-f9a7-4f4f-bc6f-f14d9c62d45e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:28:24.363191 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a07366f-f9a7-4f4f-bc6f-f14d9c62d45e admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:28:24.373726 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1137/2269] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 12:28:24 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 12:28:24.377685 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46e8df8-a85b-43d7-b84c-7cf3168fa406 admin admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:28:24.388055 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46e8df8-a85b-43d7-b84c-7cf3168fa406 admin admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:28:24.392891 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f9e785-f138-42db-93dd-c0c969a45b3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:28:24.394175 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f9e785-f138-42db-93dd-c0c969a45b3d admin admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:28:24.394458 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f9e785-f138-42db-93dd-c0c969a45b3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:28:24.394727 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f9e785-f138-42db-93dd-c0c969a45b3d admin admin] PATH_INFO: `/v3/roles` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:28:24.395473 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f9e785-f138-42db-93dd-c0c969a45b3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:28:24.397077 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f9e785-f138-42db-93dd-c0c969a45b3d admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:28:24.407103 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1133/2270] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 12:28:24 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 12:28:24.411364 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a07366f-f9a7-4f4f-bc6f-f14d9c62d45e admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:28:24.421520 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a07366f-f9a7-4f4f-bc6f-f14d9c62d45e admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:28:24.426332 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01873fd5-2432-48b3-baad-36fdbe6a2eb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:28:24.427240 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01873fd5-2432-48b3-baad-36fdbe6a2eb4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:28:24.427517 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01873fd5-2432-48b3-baad-36fdbe6a2eb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:28:24.427788 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01873fd5-2432-48b3-baad-36fdbe6a2eb4 admin admin] PATH_INFO: `/v3/projects/da24ac3ea2e643dcbc24210cf708c91a/users/806853ac7c384f97a1043cb9d21bc963/roles/c39882b202e942479a7cdac2fc6da72c` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:28:24.444038 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01873fd5-2432-48b3-baad-36fdbe6a2eb4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=da24ac3ea2e643dcbc24210cf708c91a, user_id=806853ac7c384f97a1043cb9d21bc963, role_id=c39882b202e942479a7cdac2fc6da72c)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:28:24.446727 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01873fd5-2432-48b3-baad-36fdbe6a2eb4 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:28:24.460664 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1138/2271] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 16 12:28:24 2022] PUT /identity/v3/projects/da24ac3ea2e643dcbc24210cf708c91a/users/806853ac7c384f97a1043cb9d21bc963/roles/c39882b202e942479a7cdac2fc6da72c => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:28:24.471448 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a05a9e-1867-4119-8ed7-a93953a54bc6 None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:28:24.471770 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a05a9e-1867-4119-8ed7-a93953a54bc6 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:28:24.472053 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a05a9e-1867-4119-8ed7-a93953a54bc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:28:24.499351 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-09a05a9e-1867-4119-8ed7-a93953a54bc6 None None] MFA Rules not processed for user `806853ac7c384f97a1043cb9d21bc963`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:28:24.501097 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-09a05a9e-1867-4119-8ed7-a93953a54bc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:28:24.546473 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01873fd5-2432-48b3-baad-36fdbe6a2eb4 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:28:24.548190 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-01873fd5-2432-48b3-baad-36fdbe6a2eb4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:28:24.567922 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1134/2272] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 12:28:24 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 12:28:24.585474 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a05a9e-1867-4119-8ed7-a93953a54bc6 None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:28:24.587256 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-09a05a9e-1867-4119-8ed7-a93953a54bc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:28:24.623126 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01873fd5-2432-48b3-baad-36fdbe6a2eb4 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:28:24.627788 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24c79a9-568d-45d6-8b40-9892c1029f3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:28:24.629364 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24c79a9-568d-45d6-8b40-9892c1029f3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:28:24.629671 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24c79a9-568d-45d6-8b40-9892c1029f3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:28:24.629942 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24c79a9-568d-45d6-8b40-9892c1029f3a admin admin] PATH_INFO: `/v3/users/65c04af9ce1448b3a88daf1a895db44a` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:28:24.631176 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24c79a9-568d-45d6-8b40-9892c1029f3a admin admin] RBAC: Authorizing `identity:delete_user(user_id=65c04af9ce1448b3a88daf1a895db44a)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:28:24.633278 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24c79a9-568d-45d6-8b40-9892c1029f3a admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:28:24.649965 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:28:24.668612 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a05a9e-1867-4119-8ed7-a93953a54bc6 None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:28:24.672650 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f293bf7-7c70-41a1-be34-6bb32fedb86e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f96fc14ed89478c8a8c2f11c87511e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '601361df39e34fcca71175aa94e425c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:28:24.673346 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f293bf7-7c70-41a1-be34-6bb32fedb86e service cinder] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:28:24.673652 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f293bf7-7c70-41a1-be34-6bb32fedb86e service cinder] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:28:24.673958 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f293bf7-7c70-41a1-be34-6bb32fedb86e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:28:24.680242 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-d24c79a9-568d-45d6-8b40-9892c1029f3a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '65c04af9ce1448b3a88daf1a895db44a'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:28:24.681029 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-d24c79a9-568d-45d6-8b40-9892c1029f3a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '65c04af9ce1448b3a88daf1a895db44a'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:28:24.683243 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f293bf7-7c70-41a1-be34-6bb32fedb86e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:28:24.684659 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f293bf7-7c70-41a1-be34-6bb32fedb86e service cinder] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:28:24.687864 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-d24c79a9-568d-45d6-8b40-9892c1029f3a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '65c04af9ce1448b3a88daf1a895db44a'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:28:24.688518 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-d24c79a9-568d-45d6-8b40-9892c1029f3a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '65c04af9ce1448b3a88daf1a895db44a'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:28:24.694746 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1135/2273] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 12:28:24 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 12:28:24.696535 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-d24c79a9-568d-45d6-8b40-9892c1029f3a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '65c04af9ce1448b3a88daf1a895db44a'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:28:24.697709 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=84,keystone:DELETE=12,keystone:INSERT=4 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:28:24.718107 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1139/2274] 10.222.0.44 () {58 vars in 1223 bytes} [Thu Jun 16 12:28:24 2022] DELETE /identity/v3/users/65c04af9ce1448b3a88daf1a895db44a => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 12:28:24.722974 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b186a9a-00d0-47a8-b4b5-2a8a285615b2 None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:28:24.723573 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b186a9a-00d0-47a8-b4b5-2a8a285615b2 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:28:24.724130 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b186a9a-00d0-47a8-b4b5-2a8a285615b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:28:24.743327 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-3b186a9a-00d0-47a8-b4b5-2a8a285615b2 None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:28:24.744546 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-3b186a9a-00d0-47a8-b4b5-2a8a285615b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:28:24.809925 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1136/2275] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 12:28:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 12:28:24.820524 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24c79a9-568d-45d6-8b40-9892c1029f3a admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:28:24.822223 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-d24c79a9-568d-45d6-8b40-9892c1029f3a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:28:24.885822 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24c79a9-568d-45d6-8b40-9892c1029f3a admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:28:24.889521 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2100a7f-117b-4a53-90a3-a1e3cd079cd8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1094729b25a4be7b0b394998c9ca681', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '601361df39e34fcca71175aa94e425c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:28:24.890163 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2100a7f-117b-4a53-90a3-a1e3cd079cd8 service neutron] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:28:24.890437 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2100a7f-117b-4a53-90a3-a1e3cd079cd8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:28:24.890713 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2100a7f-117b-4a53-90a3-a1e3cd079cd8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:28:24.903452 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2100a7f-117b-4a53-90a3-a1e3cd079cd8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:28:24.905157 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2100a7f-117b-4a53-90a3-a1e3cd079cd8 service neutron] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:28:24.916947 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1140/2276] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 12:28:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 12:28:25.223601 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b186a9a-00d0-47a8-b4b5-2a8a285615b2 None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:28:25.225834 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-3b186a9a-00d0-47a8-b4b5-2a8a285615b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:28:25.237798 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b186a9a-00d0-47a8-b4b5-2a8a285615b2 None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:28:25.242583 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f42553-c6ac-427c-a15b-0791cb2c9d46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:28:25.243465 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f42553-c6ac-427c-a15b-0791cb2c9d46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:28:25.243743 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f42553-c6ac-427c-a15b-0791cb2c9d46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:28:25.244014 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f42553-c6ac-427c-a15b-0791cb2c9d46 admin admin] PATH_INFO: `/v3/projects/6193dfa0106f40699034a4e29143786f` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:28:25.245364 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f42553-c6ac-427c-a15b-0791cb2c9d46 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6193dfa0106f40699034a4e29143786f)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:28:25.247353 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f42553-c6ac-427c-a15b-0791cb2c9d46 admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:28:25.293526 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-30f42553-c6ac-427c-a15b-0791cb2c9d46 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6193dfa0106f40699034a4e29143786f', 'request_id': 'req-30f42553-c6ac-427c-a15b-0791cb2c9d46'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:28:25.300938 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-30f42553-c6ac-427c-a15b-0791cb2c9d46 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6193dfa0106f40699034a4e29143786f', 'request_id': 'req-30f42553-c6ac-427c-a15b-0791cb2c9d46'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:28:25.306493 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-30f42553-c6ac-427c-a15b-0791cb2c9d46 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6193dfa0106f40699034a4e29143786f', 'request_id': 'req-30f42553-c6ac-427c-a15b-0791cb2c9d46'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:28:25.317397 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-30f42553-c6ac-427c-a15b-0791cb2c9d46 admin admin] The token cache is being invalidate because project 6193dfa0106f40699034a4e29143786f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 12:28:25.317679 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-30f42553-c6ac-427c-a15b-0791cb2c9d46 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:28:25.318362 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-30f42553-c6ac-427c-a15b-0791cb2c9d46 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:28:25.320225 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1137/2277] 10.222.0.44 () {58 vars in 1232 bytes} [Thu Jun 16 12:28:25 2022] DELETE /identity/v3/projects/6193dfa0106f40699034a4e29143786f => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 12:28:25.323992 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2100a7f-117b-4a53-90a3-a1e3cd079cd8 service neutron] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:28:25.333986 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2100a7f-117b-4a53-90a3-a1e3cd079cd8 service neutron] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:28:25.397090 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de7d514-fb14-489e-b9e1-67f04dcbce64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:28:25.397608 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de7d514-fb14-489e-b9e1-67f04dcbce64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:28:25.397887 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de7d514-fb14-489e-b9e1-67f04dcbce64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:28:25.398165 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de7d514-fb14-489e-b9e1-67f04dcbce64 admin admin] PATH_INFO: `/v3/users/68d13523e82d45019ad0c51bfb85ea63` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:28:25.399447 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de7d514-fb14-489e-b9e1-67f04dcbce64 admin admin] RBAC: Authorizing `identity:delete_user(user_id=68d13523e82d45019ad0c51bfb85ea63)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:28:25.401402 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de7d514-fb14-489e-b9e1-67f04dcbce64 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:28:25.451745 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-5de7d514-fb14-489e-b9e1-67f04dcbce64 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '68d13523e82d45019ad0c51bfb85ea63'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:28:25.452447 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-5de7d514-fb14-489e-b9e1-67f04dcbce64 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '68d13523e82d45019ad0c51bfb85ea63'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:28:25.460399 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-5de7d514-fb14-489e-b9e1-67f04dcbce64 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '68d13523e82d45019ad0c51bfb85ea63'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:28:25.461177 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-5de7d514-fb14-489e-b9e1-67f04dcbce64 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '68d13523e82d45019ad0c51bfb85ea63'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:28:25.469371 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-5de7d514-fb14-489e-b9e1-67f04dcbce64 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '68d13523e82d45019ad0c51bfb85ea63'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:28:25.488401 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1141/2278] 10.222.0.44 () {58 vars in 1223 bytes} [Thu Jun 16 12:28:25 2022] DELETE /identity/v3/users/68d13523e82d45019ad0c51bfb85ea63 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 12:28:25.767216 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f42553-c6ac-427c-a15b-0791cb2c9d46 admin admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:28:25.768711 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-30f42553-c6ac-427c-a15b-0791cb2c9d46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:28:25.784723 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f42553-c6ac-427c-a15b-0791cb2c9d46 admin admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:28:25.842029 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542255ad-4249-4c16-ba10-d0c41e8ae64b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:28:25.842878 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542255ad-4249-4c16-ba10-d0c41e8ae64b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:28:25.843161 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542255ad-4249-4c16-ba10-d0c41e8ae64b admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:28:25.843438 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542255ad-4249-4c16-ba10-d0c41e8ae64b admin admin] PATH_INFO: `/v3/projects/d0a9b7550db44c42a442a5b202894c91` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:28:25.844618 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542255ad-4249-4c16-ba10-d0c41e8ae64b admin admin] RBAC: Authorizing `identity:delete_project(project_id=d0a9b7550db44c42a442a5b202894c91)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:28:25.847179 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542255ad-4249-4c16-ba10-d0c41e8ae64b admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:28:25.853196 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:28:25.897391 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-542255ad-4249-4c16-ba10-d0c41e8ae64b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd0a9b7550db44c42a442a5b202894c91', 'request_id': 'req-542255ad-4249-4c16-ba10-d0c41e8ae64b'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:28:25.904318 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-542255ad-4249-4c16-ba10-d0c41e8ae64b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd0a9b7550db44c42a442a5b202894c91', 'request_id': 'req-542255ad-4249-4c16-ba10-d0c41e8ae64b'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:28:25.910423 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-542255ad-4249-4c16-ba10-d0c41e8ae64b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd0a9b7550db44c42a442a5b202894c91', 'request_id': 'req-542255ad-4249-4c16-ba10-d0c41e8ae64b'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:28:25.921353 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-542255ad-4249-4c16-ba10-d0c41e8ae64b admin admin] The token cache is being invalidate because project d0a9b7550db44c42a442a5b202894c91 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 12:28:25.921635 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-542255ad-4249-4c16-ba10-d0c41e8ae64b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:28:25.922276 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-542255ad-4249-4c16-ba10-d0c41e8ae64b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:28:25.923811 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1138/2279] 10.222.0.44 () {58 vars in 1232 bytes} [Thu Jun 16 12:28:25 2022] DELETE /identity/v3/projects/d0a9b7550db44c42a442a5b202894c91 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:28:25.929794 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a978bc-d680-47a7-848c-23e1a39faac1 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:28:25.929794 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a978bc-d680-47a7-848c-23e1a39faac1 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:28:25.930059 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a978bc-d680-47a7-848c-23e1a39faac1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:28:25.936341 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:28:25.952549 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-b1a978bc-d680-47a7-848c-23e1a39faac1 None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:28:25.953794 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-b1a978bc-d680-47a7-848c-23e1a39faac1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:28:26.015552 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1142/2280] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 12:28:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 12:28:26.023412 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111bd67d-c0b6-46b3-aa5e-eb86202d8010 None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:28:26.023696 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111bd67d-c0b6-46b3-aa5e-eb86202d8010 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:28:26.023968 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111bd67d-c0b6-46b3-aa5e-eb86202d8010 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:28:26.043178 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-111bd67d-c0b6-46b3-aa5e-eb86202d8010 None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:28:26.044389 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-111bd67d-c0b6-46b3-aa5e-eb86202d8010 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:28:26.053061 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1139/2281] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 12:28:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:28:26.057229 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a978bc-d680-47a7-848c-23e1a39faac1 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:28:26.067001 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a978bc-d680-47a7-848c-23e1a39faac1 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:28:26.071541 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03037c8e-c166-4752-aa69-9b547dd6acc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:28:26.072190 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03037c8e-c166-4752-aa69-9b547dd6acc8 admin admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:28:26.072463 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03037c8e-c166-4752-aa69-9b547dd6acc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:28:26.072731 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03037c8e-c166-4752-aa69-9b547dd6acc8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:28:26.073480 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03037c8e-c166-4752-aa69-9b547dd6acc8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:28:26.073784 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03037c8e-c166-4752-aa69-9b547dd6acc8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:28:26.075361 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03037c8e-c166-4752-aa69-9b547dd6acc8 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:28:26.087648 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1143/2282] 10.222.0.44 () {58 vars in 1152 bytes} [Thu Jun 16 12:28:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:28:26.091902 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111bd67d-c0b6-46b3-aa5e-eb86202d8010 None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:28:26.101799 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111bd67d-c0b6-46b3-aa5e-eb86202d8010 None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:28:26.107601 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4376a35b-ec3c-4951-936a-04ae47d76c46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:28:26.108259 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4376a35b-ec3c-4951-936a-04ae47d76c46 admin admin] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:28:26.108543 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4376a35b-ec3c-4951-936a-04ae47d76c46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:28:26.108842 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4376a35b-ec3c-4951-936a-04ae47d76c46 admin admin] PATH_INFO: `/v3/projects` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:28:26.109534 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4376a35b-ec3c-4951-936a-04ae47d76c46 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:28:26.111450 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4376a35b-ec3c-4951-936a-04ae47d76c46 admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:28:26.141435 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1140/2283] 10.222.0.44 () {60 vars in 1152 bytes} [Thu Jun 16 12:28:26 2022] POST /identity/v3/projects => generated 375 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 12:28:26.142488 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03037c8e-c166-4752-aa69-9b547dd6acc8 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:28:26.157923 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03037c8e-c166-4752-aa69-9b547dd6acc8 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:28:26.224089 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3ce3a8-e4cd-41e7-8170-a1bc309f0dab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:28:26.224971 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3ce3a8-e4cd-41e7-8170-a1bc309f0dab admin admin] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:28:26.225324 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3ce3a8-e4cd-41e7-8170-a1bc309f0dab admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:28:26.225674 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3ce3a8-e4cd-41e7-8170-a1bc309f0dab admin admin] PATH_INFO: `/v3/users` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:28:26.226451 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3ce3a8-e4cd-41e7-8170-a1bc309f0dab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:28:26.228613 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3ce3a8-e4cd-41e7-8170-a1bc309f0dab admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:28:26.251979 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1144/2284] 10.222.0.44 () {60 vars in 1143 bytes} [Thu Jun 16 12:28:26 2022] POST /identity/v3/users => generated 288 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 12:28:26.256362 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4376a35b-ec3c-4951-936a-04ae47d76c46 admin admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:28:26.267722 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4376a35b-ec3c-4951-936a-04ae47d76c46 admin admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:28:26.279138 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5028ccba-4fcf-41fe-9ad8-152ef59ced3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:28:26.279989 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5028ccba-4fcf-41fe-9ad8-152ef59ced3f admin admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:28:26.280240 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5028ccba-4fcf-41fe-9ad8-152ef59ced3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:28:26.280502 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5028ccba-4fcf-41fe-9ad8-152ef59ced3f admin admin] PATH_INFO: `/v3/roles` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:28:26.281332 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5028ccba-4fcf-41fe-9ad8-152ef59ced3f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:28:26.283653 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5028ccba-4fcf-41fe-9ad8-152ef59ced3f admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:28:26.300023 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1141/2285] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 12:28:26 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 12:28:26.301355 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3ce3a8-e4cd-41e7-8170-a1bc309f0dab admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:28:26.311356 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3ce3a8-e4cd-41e7-8170-a1bc309f0dab admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:28:26.316075 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33c9489-58c1-474c-ae5f-7e0410bb829a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:28:26.316731 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33c9489-58c1-474c-ae5f-7e0410bb829a admin admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:28:26.317046 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33c9489-58c1-474c-ae5f-7e0410bb829a admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:28:26.317320 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33c9489-58c1-474c-ae5f-7e0410bb829a admin admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:28:26.318047 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33c9489-58c1-474c-ae5f-7e0410bb829a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:28:26.319727 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33c9489-58c1-474c-ae5f-7e0410bb829a admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:28:26.333874 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1145/2286] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 12:28:26 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 12:28:26.335021 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5028ccba-4fcf-41fe-9ad8-152ef59ced3f admin admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:28:26.347246 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5028ccba-4fcf-41fe-9ad8-152ef59ced3f admin admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:28:26.352494 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77cd5b9-2060-4154-9e4b-1e2eed416645 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:28:26.353670 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77cd5b9-2060-4154-9e4b-1e2eed416645 admin admin] REQUEST_METHOD: `PUT` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:28:26.354398 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77cd5b9-2060-4154-9e4b-1e2eed416645 admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:28:26.354398 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77cd5b9-2060-4154-9e4b-1e2eed416645 admin admin] PATH_INFO: `/v3/projects/d6316553663e45e4a504dc08bc05ba48/users/6eb4aee8cdd747f9b555487362713011/roles/c39882b202e942479a7cdac2fc6da72c` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:28:26.372018 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77cd5b9-2060-4154-9e4b-1e2eed416645 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d6316553663e45e4a504dc08bc05ba48, user_id=6eb4aee8cdd747f9b555487362713011, role_id=c39882b202e942479a7cdac2fc6da72c)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:28:26.375006 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77cd5b9-2060-4154-9e4b-1e2eed416645 admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:28:26.392171 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1142/2287] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 16 12:28:26 2022] PUT /identity/v3/projects/d6316553663e45e4a504dc08bc05ba48/users/6eb4aee8cdd747f9b555487362713011/roles/c39882b202e942479a7cdac2fc6da72c => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:28:26.402875 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8374e5a-46d9-45f5-a761-602c73392c61 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:28:26.403115 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8374e5a-46d9-45f5-a761-602c73392c61 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:28:26.403392 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8374e5a-46d9-45f5-a761-602c73392c61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:28:26.442908 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-c8374e5a-46d9-45f5-a761-602c73392c61 None None] MFA Rules not processed for user `6eb4aee8cdd747f9b555487362713011`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:28:26.444560 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-c8374e5a-46d9-45f5-a761-602c73392c61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:28:26.550988 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:28:26.560692 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1146/2288] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 12:28:26 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:28:26.565177 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77cd5b9-2060-4154-9e4b-1e2eed416645 admin admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:28:26.651662 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77cd5b9-2060-4154-9e4b-1e2eed416645 admin admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:28:26.656474 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da647d4-f8ec-4fb2-98eb-a4cece6991ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:28:26.657178 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da647d4-f8ec-4fb2-98eb-a4cece6991ae admin admin] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:28:26.657553 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da647d4-f8ec-4fb2-98eb-a4cece6991ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:28:26.657724 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da647d4-f8ec-4fb2-98eb-a4cece6991ae admin admin] PATH_INFO: `/v3/projects` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:28:26.658444 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da647d4-f8ec-4fb2-98eb-a4cece6991ae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:28:26.660990 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da647d4-f8ec-4fb2-98eb-a4cece6991ae admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:28:26.693796 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1143/2289] 10.222.0.44 () {60 vars in 1152 bytes} [Thu Jun 16 12:28:26 2022] POST /identity/v3/projects => generated 377 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 12:28:26.697745 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8374e5a-46d9-45f5-a761-602c73392c61 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:28:26.710538 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8374e5a-46d9-45f5-a761-602c73392c61 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:28:26.797950 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5104e530-9c1b-4c05-b1bc-5b949d0af5d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:28:26.798634 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5104e530-9c1b-4c05-b1bc-5b949d0af5d9 admin admin] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:28:26.798907 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5104e530-9c1b-4c05-b1bc-5b949d0af5d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:28:26.799196 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5104e530-9c1b-4c05-b1bc-5b949d0af5d9 admin admin] PATH_INFO: `/v3/users` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:28:26.800536 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5104e530-9c1b-4c05-b1bc-5b949d0af5d9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:28:26.803136 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5104e530-9c1b-4c05-b1bc-5b949d0af5d9 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:28:26.822705 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1147/2290] 10.222.0.44 () {60 vars in 1143 bytes} [Thu Jun 16 12:28:26 2022] POST /identity/v3/users => generated 289 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 12:28:26.826757 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da647d4-f8ec-4fb2-98eb-a4cece6991ae admin admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:28:26.838101 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da647d4-f8ec-4fb2-98eb-a4cece6991ae admin admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:28:26.842695 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d0f3d4-696d-47ae-b068-c0fe8c559b74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:28:26.843348 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d0f3d4-696d-47ae-b068-c0fe8c559b74 admin admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:28:26.843630 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d0f3d4-696d-47ae-b068-c0fe8c559b74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:28:26.843906 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d0f3d4-696d-47ae-b068-c0fe8c559b74 admin admin] PATH_INFO: `/v3/roles` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:28:26.844637 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d0f3d4-696d-47ae-b068-c0fe8c559b74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:28:26.846260 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d0f3d4-696d-47ae-b068-c0fe8c559b74 admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:28:26.857679 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1144/2291] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 12:28:26 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 12:28:26.861811 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5104e530-9c1b-4c05-b1bc-5b949d0af5d9 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:28:26.872920 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5104e530-9c1b-4c05-b1bc-5b949d0af5d9 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:28:26.877691 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723bf870-20a3-4550-9bde-ff5fd9eba35c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:28:26.878430 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723bf870-20a3-4550-9bde-ff5fd9eba35c admin admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:28:26.878706 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723bf870-20a3-4550-9bde-ff5fd9eba35c admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:28:26.879019 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723bf870-20a3-4550-9bde-ff5fd9eba35c admin admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:28:26.879925 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723bf870-20a3-4550-9bde-ff5fd9eba35c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:28:26.881666 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723bf870-20a3-4550-9bde-ff5fd9eba35c admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:28:26.892138 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1148/2292] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 12:28:26 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 12:28:26.896812 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d0f3d4-696d-47ae-b068-c0fe8c559b74 admin admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:28:26.903073 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:28:26.907203 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d0f3d4-696d-47ae-b068-c0fe8c559b74 admin admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:28:26.913800 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b10c825-9d9f-4b5c-8e5a-0a2a22180a57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:28:26.914853 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b10c825-9d9f-4b5c-8e5a-0a2a22180a57 admin admin] REQUEST_METHOD: `PUT` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:28:26.915356 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b10c825-9d9f-4b5c-8e5a-0a2a22180a57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:28:26.915635 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b10c825-9d9f-4b5c-8e5a-0a2a22180a57 admin admin] PATH_INFO: `/v3/projects/9c4ce822e60447fabb96bd43ae49b01c/users/de0457ababa84086a1ffc38360260e74/roles/c39882b202e942479a7cdac2fc6da72c` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:28:26.930797 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b10c825-9d9f-4b5c-8e5a-0a2a22180a57 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c4ce822e60447fabb96bd43ae49b01c, user_id=de0457ababa84086a1ffc38360260e74, role_id=c39882b202e942479a7cdac2fc6da72c)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:28:26.933784 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b10c825-9d9f-4b5c-8e5a-0a2a22180a57 admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:28:26.947157 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1145/2293] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 16 12:28:26 2022] PUT /identity/v3/projects/9c4ce822e60447fabb96bd43ae49b01c/users/de0457ababa84086a1ffc38360260e74/roles/c39882b202e942479a7cdac2fc6da72c => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:28:27.014229 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b91892-3c0d-4506-811f-83f1490a8c21 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:28:27.014512 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b91892-3c0d-4506-811f-83f1490a8c21 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:28:27.014787 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b91892-3c0d-4506-811f-83f1490a8c21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:28:27.041524 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-23b91892-3c0d-4506-811f-83f1490a8c21 None None] MFA Rules not processed for user `de0457ababa84086a1ffc38360260e74`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:28:27.042711 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-23b91892-3c0d-4506-811f-83f1490a8c21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:28:27.106183 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1149/2294] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 12:28:27 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:28:27.110610 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b10c825-9d9f-4b5c-8e5a-0a2a22180a57 admin admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:28:27.176018 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b10c825-9d9f-4b5c-8e5a-0a2a22180a57 admin admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:28:27.180605 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6a65e3-77fd-4a31-a8b9-fbc92e218644 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:28:27.181283 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6a65e3-77fd-4a31-a8b9-fbc92e218644 admin admin] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:28:27.181563 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6a65e3-77fd-4a31-a8b9-fbc92e218644 admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:28:27.181835 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6a65e3-77fd-4a31-a8b9-fbc92e218644 admin admin] PATH_INFO: `/v3/projects` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:28:27.182542 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6a65e3-77fd-4a31-a8b9-fbc92e218644 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:28:27.184494 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6a65e3-77fd-4a31-a8b9-fbc92e218644 admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:28:27.209343 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1146/2295] 10.222.0.44 () {60 vars in 1152 bytes} [Thu Jun 16 12:28:27 2022] POST /identity/v3/projects => generated 377 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 12:28:27.213503 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b91892-3c0d-4506-811f-83f1490a8c21 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:28:27.224680 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b91892-3c0d-4506-811f-83f1490a8c21 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:28:27.281687 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e1def2-753a-4483-a240-71f87a198c13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:28:27.282346 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e1def2-753a-4483-a240-71f87a198c13 admin admin] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:28:27.282622 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e1def2-753a-4483-a240-71f87a198c13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:28:27.282892 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e1def2-753a-4483-a240-71f87a198c13 admin admin] PATH_INFO: `/v3/users` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:28:27.283599 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e1def2-753a-4483-a240-71f87a198c13 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:28:27.285836 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e1def2-753a-4483-a240-71f87a198c13 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:28:27.295019 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:28:27.306370 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1150/2296] 10.222.0.44 () {60 vars in 1143 bytes} [Thu Jun 16 12:28:27 2022] POST /identity/v3/users => generated 295 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 12:28:27.310281 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6a65e3-77fd-4a31-a8b9-fbc92e218644 admin admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:28:27.320844 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6a65e3-77fd-4a31-a8b9-fbc92e218644 admin admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:28:27.325339 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b1876c-3e08-4fee-b233-d6188ba27153 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:28:27.325981 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b1876c-3e08-4fee-b233-d6188ba27153 admin admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:28:27.326260 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b1876c-3e08-4fee-b233-d6188ba27153 admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:28:27.326531 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b1876c-3e08-4fee-b233-d6188ba27153 admin admin] PATH_INFO: `/v3/roles` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:28:27.327245 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b1876c-3e08-4fee-b233-d6188ba27153 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:28:27.328859 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b1876c-3e08-4fee-b233-d6188ba27153 admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:28:27.339830 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1147/2297] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 12:28:27 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 12:28:27.343550 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e1def2-753a-4483-a240-71f87a198c13 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:28:27.353250 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e1def2-753a-4483-a240-71f87a198c13 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:28:27.357779 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3951f3-8879-4c1e-bdf9-057eaed44639 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:28:27.358643 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3951f3-8879-4c1e-bdf9-057eaed44639 admin admin] REQUEST_METHOD: `PUT` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:28:27.358930 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3951f3-8879-4c1e-bdf9-057eaed44639 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:28:27.359202 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3951f3-8879-4c1e-bdf9-057eaed44639 admin admin] PATH_INFO: `/v3/projects/8fe7272b782e49339c1dbbb4ff8c30bc/users/d8ca956f2325449690b7c98cd1e72856/roles/0688968254744e3f9913653cafea3091` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:28:27.374270 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3951f3-8879-4c1e-bdf9-057eaed44639 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8fe7272b782e49339c1dbbb4ff8c30bc, user_id=d8ca956f2325449690b7c98cd1e72856, role_id=0688968254744e3f9913653cafea3091)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:28:27.376994 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3951f3-8879-4c1e-bdf9-057eaed44639 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:28:27.395718 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1151/2298] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 16 12:28:27 2022] PUT /identity/v3/projects/8fe7272b782e49339c1dbbb4ff8c30bc/users/d8ca956f2325449690b7c98cd1e72856/roles/0688968254744e3f9913653cafea3091 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 12:28:27.399758 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b1876c-3e08-4fee-b233-d6188ba27153 admin admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:28:27.409940 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b1876c-3e08-4fee-b233-d6188ba27153 admin admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:28:27.464102 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a07783f-70ec-4dfa-8650-f097c4377d58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:28:27.464785 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a07783f-70ec-4dfa-8650-f097c4377d58 admin admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:28:27.465069 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a07783f-70ec-4dfa-8650-f097c4377d58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:28:27.465346 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a07783f-70ec-4dfa-8650-f097c4377d58 admin admin] PATH_INFO: `/v3/roles` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:28:27.466072 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a07783f-70ec-4dfa-8650-f097c4377d58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:28:27.467667 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a07783f-70ec-4dfa-8650-f097c4377d58 admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:28:27.477228 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1148/2299] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 12:28:27 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 12:28:27.481261 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3951f3-8879-4c1e-bdf9-057eaed44639 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:28:27.491676 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3951f3-8879-4c1e-bdf9-057eaed44639 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:28:27.496689 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2c9c61-56f9-435d-bf40-35eee3f6fb8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:28:27.497704 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2c9c61-56f9-435d-bf40-35eee3f6fb8b admin admin] REQUEST_METHOD: `PUT` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:28:27.497989 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2c9c61-56f9-435d-bf40-35eee3f6fb8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:28:27.498261 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2c9c61-56f9-435d-bf40-35eee3f6fb8b admin admin] PATH_INFO: `/v3/projects/8fe7272b782e49339c1dbbb4ff8c30bc/users/d8ca956f2325449690b7c98cd1e72856/roles/0688968254744e3f9913653cafea3091` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:28:27.500277 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2c9c61-56f9-435d-bf40-35eee3f6fb8b admin admin] RBAC: Authorizing `identity:create_grant(project_id=8fe7272b782e49339c1dbbb4ff8c30bc, user_id=d8ca956f2325449690b7c98cd1e72856, role_id=0688968254744e3f9913653cafea3091)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:28:27.503522 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2c9c61-56f9-435d-bf40-35eee3f6fb8b admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:28:27.514365 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1152/2300] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 16 12:28:27 2022] PUT /identity/v3/projects/8fe7272b782e49339c1dbbb4ff8c30bc/users/d8ca956f2325449690b7c98cd1e72856/roles/0688968254744e3f9913653cafea3091 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 12:28:27.524996 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48c846e-548d-47bb-96af-412f3f0c78f4 None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:28:27.525283 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48c846e-548d-47bb-96af-412f3f0c78f4 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:28:27.525556 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48c846e-548d-47bb-96af-412f3f0c78f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:28:27.551644 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-f48c846e-548d-47bb-96af-412f3f0c78f4 None None] MFA Rules not processed for user `d8ca956f2325449690b7c98cd1e72856`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:28:27.552887 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-f48c846e-548d-47bb-96af-412f3f0c78f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:28:27.594309 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:28:27.627080 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1149/2301] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 12:28:27 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 12:28:27.638986 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2c9c61-56f9-435d-bf40-35eee3f6fb8b admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:28:27.641009 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-5b2c9c61-56f9-435d-bf40-35eee3f6fb8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:28:27.705795 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2c9c61-56f9-435d-bf40-35eee3f6fb8b admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:28:27.711589 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27856aa1-64d7-4f57-b1e0-1bf5064dcbf3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f96fc14ed89478c8a8c2f11c87511e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '601361df39e34fcca71175aa94e425c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:28:27.712380 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27856aa1-64d7-4f57-b1e0-1bf5064dcbf3 service cinder] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:28:27.712925 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27856aa1-64d7-4f57-b1e0-1bf5064dcbf3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:28:27.713213 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27856aa1-64d7-4f57-b1e0-1bf5064dcbf3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:28:27.786044 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27856aa1-64d7-4f57-b1e0-1bf5064dcbf3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:28:27.787641 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27856aa1-64d7-4f57-b1e0-1bf5064dcbf3 service cinder] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:28:27.800091 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1153/2302] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 12:28:27 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 12:28:27.938564 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48c846e-548d-47bb-96af-412f3f0c78f4 None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:28:27.941202 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-f48c846e-548d-47bb-96af-412f3f0c78f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:28:28.032192 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48c846e-548d-47bb-96af-412f3f0c78f4 None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:28:28.040417 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c8b496-72cc-4eba-9279-e6abba5505e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:28:28.041971 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c8b496-72cc-4eba-9279-e6abba5505e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:28:28.042583 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c8b496-72cc-4eba-9279-e6abba5505e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:28:28.042703 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c8b496-72cc-4eba-9279-e6abba5505e7 admin admin] PATH_INFO: `/v3/users/806853ac7c384f97a1043cb9d21bc963` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:28:28.044306 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c8b496-72cc-4eba-9279-e6abba5505e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=806853ac7c384f97a1043cb9d21bc963)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:28:28.046392 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c8b496-72cc-4eba-9279-e6abba5505e7 admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:28:28.109700 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-c1c8b496-72cc-4eba-9279-e6abba5505e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '806853ac7c384f97a1043cb9d21bc963'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:28:28.124335 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-c1c8b496-72cc-4eba-9279-e6abba5505e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '806853ac7c384f97a1043cb9d21bc963'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:28:28.135041 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-c1c8b496-72cc-4eba-9279-e6abba5505e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '806853ac7c384f97a1043cb9d21bc963'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:28:28.135898 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-c1c8b496-72cc-4eba-9279-e6abba5505e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '806853ac7c384f97a1043cb9d21bc963'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:28:28.136590 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-c1c8b496-72cc-4eba-9279-e6abba5505e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '806853ac7c384f97a1043cb9d21bc963'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:28:28.158485 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1150/2303] 10.222.0.44 () {58 vars in 1223 bytes} [Thu Jun 16 12:28:27 2022] DELETE /identity/v3/users/806853ac7c384f97a1043cb9d21bc963 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:28:28.163214 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25be091-fe44-420a-9794-83a86886cb12 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:28:28.163499 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25be091-fe44-420a-9794-83a86886cb12 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:28:28.163778 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25be091-fe44-420a-9794-83a86886cb12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:28:28.181105 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-f25be091-fe44-420a-9794-83a86886cb12 None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:28:28.182324 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-f25be091-fe44-420a-9794-83a86886cb12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:28:28.242812 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1154/2304] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 12:28:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:28:28.252379 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c8b496-72cc-4eba-9279-e6abba5505e7 admin admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:28:28.254399 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-c1c8b496-72cc-4eba-9279-e6abba5505e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:28:28.311717 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c8b496-72cc-4eba-9279-e6abba5505e7 admin admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:28:28.315883 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9bd2f6-e322-4ca8-bc49-afba80184ce4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1094729b25a4be7b0b394998c9ca681', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '601361df39e34fcca71175aa94e425c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:28:28.316523 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9bd2f6-e322-4ca8-bc49-afba80184ce4 service neutron] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:28:28.316833 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9bd2f6-e322-4ca8-bc49-afba80184ce4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:28:28.317109 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9bd2f6-e322-4ca8-bc49-afba80184ce4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:28:28.326028 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9bd2f6-e322-4ca8-bc49-afba80184ce4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:28:28.327451 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9bd2f6-e322-4ca8-bc49-afba80184ce4 service neutron] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:28:28.331868 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:28:28.339021 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1151/2305] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 12:28:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 12:28:28.598325 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25be091-fe44-420a-9794-83a86886cb12 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:28:28.599998 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-f25be091-fe44-420a-9794-83a86886cb12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:28:28.613456 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25be091-fe44-420a-9794-83a86886cb12 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:28:28.618518 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c6bfa3-a1ea-4e42-a88e-aa47bca2168c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:28:28.619458 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c6bfa3-a1ea-4e42-a88e-aa47bca2168c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:28:28.619738 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c6bfa3-a1ea-4e42-a88e-aa47bca2168c admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:28:28.620001 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c6bfa3-a1ea-4e42-a88e-aa47bca2168c admin admin] PATH_INFO: `/v3/projects/da24ac3ea2e643dcbc24210cf708c91a` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:28:28.621217 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c6bfa3-a1ea-4e42-a88e-aa47bca2168c admin admin] RBAC: Authorizing `identity:delete_project(project_id=da24ac3ea2e643dcbc24210cf708c91a)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:28:28.623145 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c6bfa3-a1ea-4e42-a88e-aa47bca2168c admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:28:28.633180 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:28:28.676790 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-f1c6bfa3-a1ea-4e42-a88e-aa47bca2168c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da24ac3ea2e643dcbc24210cf708c91a', 'request_id': 'req-f1c6bfa3-a1ea-4e42-a88e-aa47bca2168c'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:28:28.683103 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-f1c6bfa3-a1ea-4e42-a88e-aa47bca2168c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da24ac3ea2e643dcbc24210cf708c91a', 'request_id': 'req-f1c6bfa3-a1ea-4e42-a88e-aa47bca2168c'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:28:28.688668 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-f1c6bfa3-a1ea-4e42-a88e-aa47bca2168c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da24ac3ea2e643dcbc24210cf708c91a', 'request_id': 'req-f1c6bfa3-a1ea-4e42-a88e-aa47bca2168c'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:28:28.701718 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-f1c6bfa3-a1ea-4e42-a88e-aa47bca2168c admin admin] The token cache is being invalidate because project da24ac3ea2e643dcbc24210cf708c91a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 12:28:28.702004 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-f1c6bfa3-a1ea-4e42-a88e-aa47bca2168c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:28:28.702687 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-f1c6bfa3-a1ea-4e42-a88e-aa47bca2168c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:28:28.704261 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1155/2306] 10.222.0.44 () {58 vars in 1232 bytes} [Thu Jun 16 12:28:28 2022] DELETE /identity/v3/projects/da24ac3ea2e643dcbc24210cf708c91a => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:28:29.370306 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9bd2f6-e322-4ca8-bc49-afba80184ce4 service neutron] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:28:29.371694 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-dd9bd2f6-e322-4ca8-bc49-afba80184ce4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:28:29.433606 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9bd2f6-e322-4ca8-bc49-afba80184ce4 service neutron] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:28:29.499565 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3924ca-a821-4ae8-be1c-35b20060981f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f96fc14ed89478c8a8c2f11c87511e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '601361df39e34fcca71175aa94e425c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:28:29.500355 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3924ca-a821-4ae8-be1c-35b20060981f service cinder] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:28:29.500906 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3924ca-a821-4ae8-be1c-35b20060981f service cinder] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:28:29.501014 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3924ca-a821-4ae8-be1c-35b20060981f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:28:29.502900 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-ea3924ca-a821-4ae8-be1c-35b20060981f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:28:29.577763 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3924ca-a821-4ae8-be1c-35b20060981f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:28:29.579206 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3924ca-a821-4ae8-be1c-35b20060981f service cinder] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:28:29.587871 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1152/2307] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 12:28:29 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 12:28:30.118375 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c6bfa3-a1ea-4e42-a88e-aa47bca2168c admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:28:30.119873 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-f1c6bfa3-a1ea-4e42-a88e-aa47bca2168c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:28:30.131929 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c6bfa3-a1ea-4e42-a88e-aa47bca2168c admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:28:30.136546 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4551bda2-0fb9-4127-816e-d53e3e58d05f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f96fc14ed89478c8a8c2f11c87511e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '601361df39e34fcca71175aa94e425c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:28:30.137215 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4551bda2-0fb9-4127-816e-d53e3e58d05f service cinder] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:28:30.137497 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4551bda2-0fb9-4127-816e-d53e3e58d05f service cinder] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:28:30.137770 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4551bda2-0fb9-4127-816e-d53e3e58d05f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:28:30.139447 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-4551bda2-0fb9-4127-816e-d53e3e58d05f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:28:30.211347 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4551bda2-0fb9-4127-816e-d53e3e58d05f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:28:30.212872 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4551bda2-0fb9-4127-816e-d53e3e58d05f service cinder] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:28:30.224702 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1156/2308] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 12:28:30 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 12:28:34.091114 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3924ca-a821-4ae8-be1c-35b20060981f service cinder] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:28:34.092653 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-ea3924ca-a821-4ae8-be1c-35b20060981f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:28:34.159397 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3924ca-a821-4ae8-be1c-35b20060981f service cinder] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:28:34.164447 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863bfbf4-00d1-4edb-a1ef-893290de1fbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:28:34.165356 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863bfbf4-00d1-4edb-a1ef-893290de1fbc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:28:34.165636 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863bfbf4-00d1-4edb-a1ef-893290de1fbc admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:28:34.165892 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863bfbf4-00d1-4edb-a1ef-893290de1fbc admin admin] PATH_INFO: `/v3/users/6eb4aee8cdd747f9b555487362713011` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:28:34.167087 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863bfbf4-00d1-4edb-a1ef-893290de1fbc admin admin] RBAC: Authorizing `identity:delete_user(user_id=6eb4aee8cdd747f9b555487362713011)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:28:34.169058 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863bfbf4-00d1-4edb-a1ef-893290de1fbc admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:28:34.180050 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:28:34.218942 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-863bfbf4-00d1-4edb-a1ef-893290de1fbc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6eb4aee8cdd747f9b555487362713011'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:28:34.231297 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-863bfbf4-00d1-4edb-a1ef-893290de1fbc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6eb4aee8cdd747f9b555487362713011'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:28:34.239148 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-863bfbf4-00d1-4edb-a1ef-893290de1fbc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6eb4aee8cdd747f9b555487362713011'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:28:34.239850 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-863bfbf4-00d1-4edb-a1ef-893290de1fbc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6eb4aee8cdd747f9b555487362713011'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:28:34.240466 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-863bfbf4-00d1-4edb-a1ef-893290de1fbc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6eb4aee8cdd747f9b555487362713011'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:28:34.254014 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1153/2309] 10.222.0.44 () {58 vars in 1223 bytes} [Thu Jun 16 12:28:34 2022] DELETE /identity/v3/users/6eb4aee8cdd747f9b555487362713011 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:28:34.258602 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512ad7b5-9348-401a-b4e8-fd6923d6c4b3 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:28:34.259073 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512ad7b5-9348-401a-b4e8-fd6923d6c4b3 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:28:34.259162 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512ad7b5-9348-401a-b4e8-fd6923d6c4b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:28:34.275669 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-512ad7b5-9348-401a-b4e8-fd6923d6c4b3 None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:28:34.276903 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-512ad7b5-9348-401a-b4e8-fd6923d6c4b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:28:34.339255 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1157/2310] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 12:28:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:28:34.349642 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863bfbf4-00d1-4edb-a1ef-893290de1fbc admin admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:28:34.351031 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-863bfbf4-00d1-4edb-a1ef-893290de1fbc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:28:34.407528 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863bfbf4-00d1-4edb-a1ef-893290de1fbc admin admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:28:34.412093 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952b1a6d-293c-4d3c-b5a6-5bf97508277f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1094729b25a4be7b0b394998c9ca681', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '601361df39e34fcca71175aa94e425c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:28:34.412740 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952b1a6d-293c-4d3c-b5a6-5bf97508277f service neutron] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:28:34.413053 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952b1a6d-293c-4d3c-b5a6-5bf97508277f service neutron] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:28:34.413325 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952b1a6d-293c-4d3c-b5a6-5bf97508277f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:28:34.422627 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952b1a6d-293c-4d3c-b5a6-5bf97508277f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:28:34.424052 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952b1a6d-293c-4d3c-b5a6-5bf97508277f service neutron] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:28:34.433428 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1154/2311] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 12:28:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 12:28:34.702530 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512ad7b5-9348-401a-b4e8-fd6923d6c4b3 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:28:34.704201 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-512ad7b5-9348-401a-b4e8-fd6923d6c4b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:28:34.724700 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512ad7b5-9348-401a-b4e8-fd6923d6c4b3 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:28:34.740500 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194e2e79-56bc-4bcf-b732-908a261fdf5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:28:34.741416 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194e2e79-56bc-4bcf-b732-908a261fdf5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:28:34.741699 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194e2e79-56bc-4bcf-b732-908a261fdf5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:28:34.741968 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194e2e79-56bc-4bcf-b732-908a261fdf5b admin admin] PATH_INFO: `/v3/projects/d6316553663e45e4a504dc08bc05ba48` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:28:34.743183 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194e2e79-56bc-4bcf-b732-908a261fdf5b admin admin] RBAC: Authorizing `identity:delete_project(project_id=d6316553663e45e4a504dc08bc05ba48)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:28:34.745330 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194e2e79-56bc-4bcf-b732-908a261fdf5b admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:28:34.780278 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:28:34.799846 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-194e2e79-56bc-4bcf-b732-908a261fdf5b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd6316553663e45e4a504dc08bc05ba48', 'request_id': 'req-194e2e79-56bc-4bcf-b732-908a261fdf5b'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:28:34.812099 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-194e2e79-56bc-4bcf-b732-908a261fdf5b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd6316553663e45e4a504dc08bc05ba48', 'request_id': 'req-194e2e79-56bc-4bcf-b732-908a261fdf5b'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:28:34.817794 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-194e2e79-56bc-4bcf-b732-908a261fdf5b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd6316553663e45e4a504dc08bc05ba48', 'request_id': 'req-194e2e79-56bc-4bcf-b732-908a261fdf5b'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:28:34.828831 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-194e2e79-56bc-4bcf-b732-908a261fdf5b admin admin] The token cache is being invalidate because project d6316553663e45e4a504dc08bc05ba48 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 12:28:34.829121 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-194e2e79-56bc-4bcf-b732-908a261fdf5b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:28:34.829785 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-194e2e79-56bc-4bcf-b732-908a261fdf5b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:28:34.831378 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1158/2312] 10.222.0.44 () {58 vars in 1232 bytes} [Thu Jun 16 12:28:34 2022] DELETE /identity/v3/projects/d6316553663e45e4a504dc08bc05ba48 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:28:34.836056 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952b1a6d-293c-4d3c-b5a6-5bf97508277f service neutron] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:28:34.849870 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952b1a6d-293c-4d3c-b5a6-5bf97508277f service neutron] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:28:34.905708 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac286cc-3c06-4f6d-b7d3-e2500e707d38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:28:34.906522 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac286cc-3c06-4f6d-b7d3-e2500e707d38 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:28:34.906828 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac286cc-3c06-4f6d-b7d3-e2500e707d38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:28:34.907105 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac286cc-3c06-4f6d-b7d3-e2500e707d38 admin admin] PATH_INFO: `/v3/users/de0457ababa84086a1ffc38360260e74` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:28:34.908318 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac286cc-3c06-4f6d-b7d3-e2500e707d38 admin admin] RBAC: Authorizing `identity:delete_user(user_id=de0457ababa84086a1ffc38360260e74)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:28:34.910606 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac286cc-3c06-4f6d-b7d3-e2500e707d38 admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:28:34.949208 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:DELETE=15,keystone:SELECT=84,keystone:INSERT=1 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:28:34.963763 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-7ac286cc-3c06-4f6d-b7d3-e2500e707d38 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'de0457ababa84086a1ffc38360260e74'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:28:34.976784 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-7ac286cc-3c06-4f6d-b7d3-e2500e707d38 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'de0457ababa84086a1ffc38360260e74'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:28:34.983850 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-7ac286cc-3c06-4f6d-b7d3-e2500e707d38 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'de0457ababa84086a1ffc38360260e74'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:28:34.984568 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-7ac286cc-3c06-4f6d-b7d3-e2500e707d38 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'de0457ababa84086a1ffc38360260e74'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:28:34.985226 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-7ac286cc-3c06-4f6d-b7d3-e2500e707d38 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'de0457ababa84086a1ffc38360260e74'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:28:34.998668 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1155/2313] 10.222.0.44 () {58 vars in 1223 bytes} [Thu Jun 16 12:28:34 2022] DELETE /identity/v3/users/de0457ababa84086a1ffc38360260e74 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:28:35.360352 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194e2e79-56bc-4bcf-b732-908a261fdf5b admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:28:35.361827 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-194e2e79-56bc-4bcf-b732-908a261fdf5b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:28:35.375748 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194e2e79-56bc-4bcf-b732-908a261fdf5b admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:28:35.434329 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5c5f55-3c57-4873-af69-2d10fd4b5f7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:28:35.435191 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5c5f55-3c57-4873-af69-2d10fd4b5f7f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:28:35.435470 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5c5f55-3c57-4873-af69-2d10fd4b5f7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:28:35.435871 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5c5f55-3c57-4873-af69-2d10fd4b5f7f admin admin] PATH_INFO: `/v3/projects/9c4ce822e60447fabb96bd43ae49b01c` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:28:35.437292 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5c5f55-3c57-4873-af69-2d10fd4b5f7f admin admin] RBAC: Authorizing `identity:delete_project(project_id=9c4ce822e60447fabb96bd43ae49b01c)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:28:35.439196 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5c5f55-3c57-4873-af69-2d10fd4b5f7f admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:28:35.490634 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-9c5c5f55-3c57-4873-af69-2d10fd4b5f7f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9c4ce822e60447fabb96bd43ae49b01c', 'request_id': 'req-9c5c5f55-3c57-4873-af69-2d10fd4b5f7f'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:28:35.498355 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-9c5c5f55-3c57-4873-af69-2d10fd4b5f7f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9c4ce822e60447fabb96bd43ae49b01c', 'request_id': 'req-9c5c5f55-3c57-4873-af69-2d10fd4b5f7f'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:28:35.503973 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-9c5c5f55-3c57-4873-af69-2d10fd4b5f7f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9c4ce822e60447fabb96bd43ae49b01c', 'request_id': 'req-9c5c5f55-3c57-4873-af69-2d10fd4b5f7f'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:28:35.514963 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-9c5c5f55-3c57-4873-af69-2d10fd4b5f7f admin admin] The token cache is being invalidate because project 9c4ce822e60447fabb96bd43ae49b01c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 12:28:35.515252 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-9c5c5f55-3c57-4873-af69-2d10fd4b5f7f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:28:35.515883 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-9c5c5f55-3c57-4873-af69-2d10fd4b5f7f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:28:35.517451 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1159/2314] 10.222.0.44 () {58 vars in 1232 bytes} [Thu Jun 16 12:28:35 2022] DELETE /identity/v3/projects/9c4ce822e60447fabb96bd43ae49b01c => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:28:35.521469 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac286cc-3c06-4f6d-b7d3-e2500e707d38 admin admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:28:35.522864 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-7ac286cc-3c06-4f6d-b7d3-e2500e707d38 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:28:35.536471 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac286cc-3c06-4f6d-b7d3-e2500e707d38 admin admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:28:35.593898 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50d5ec3-6cb2-42aa-9c36-922d73187dce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:28:35.594771 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50d5ec3-6cb2-42aa-9c36-922d73187dce admin admin] REQUEST_METHOD: `DELETE` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:28:35.595053 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50d5ec3-6cb2-42aa-9c36-922d73187dce admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:28:35.595327 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50d5ec3-6cb2-42aa-9c36-922d73187dce admin admin] PATH_INFO: `/v3/users/d8ca956f2325449690b7c98cd1e72856` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:28:35.596514 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50d5ec3-6cb2-42aa-9c36-922d73187dce admin admin] RBAC: Authorizing `identity:delete_user(user_id=d8ca956f2325449690b7c98cd1e72856)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:28:35.599001 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50d5ec3-6cb2-42aa-9c36-922d73187dce admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:28:35.645262 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-a50d5ec3-6cb2-42aa-9c36-922d73187dce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd8ca956f2325449690b7c98cd1e72856'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:28:35.657246 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-a50d5ec3-6cb2-42aa-9c36-922d73187dce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd8ca956f2325449690b7c98cd1e72856'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:28:35.665595 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-a50d5ec3-6cb2-42aa-9c36-922d73187dce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd8ca956f2325449690b7c98cd1e72856'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:28:35.666353 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-a50d5ec3-6cb2-42aa-9c36-922d73187dce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd8ca956f2325449690b7c98cd1e72856'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:28:35.666971 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-a50d5ec3-6cb2-42aa-9c36-922d73187dce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd8ca956f2325449690b7c98cd1e72856'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:28:35.679790 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1156/2315] 10.222.0.44 () {58 vars in 1223 bytes} [Thu Jun 16 12:28:35 2022] DELETE /identity/v3/users/d8ca956f2325449690b7c98cd1e72856 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:28:35.959355 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5c5f55-3c57-4873-af69-2d10fd4b5f7f admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:28:35.961063 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-9c5c5f55-3c57-4873-af69-2d10fd4b5f7f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:28:35.974708 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5c5f55-3c57-4873-af69-2d10fd4b5f7f admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:28:36.015381 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:28:36.032570 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3fae78-de3c-48fc-8bb2-567e74af7cbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:28:36.033466 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3fae78-de3c-48fc-8bb2-567e74af7cbf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:28:36.033749 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3fae78-de3c-48fc-8bb2-567e74af7cbf admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:28:36.034280 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3fae78-de3c-48fc-8bb2-567e74af7cbf admin admin] PATH_INFO: `/v3/projects/8fe7272b782e49339c1dbbb4ff8c30bc` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:28:36.036019 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3fae78-de3c-48fc-8bb2-567e74af7cbf admin admin] RBAC: Authorizing `identity:delete_project(project_id=8fe7272b782e49339c1dbbb4ff8c30bc)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:28:36.037993 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3fae78-de3c-48fc-8bb2-567e74af7cbf admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:28:36.083936 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-1d3fae78-de3c-48fc-8bb2-567e74af7cbf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8fe7272b782e49339c1dbbb4ff8c30bc', 'request_id': 'req-1d3fae78-de3c-48fc-8bb2-567e74af7cbf'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:28:36.090731 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-1d3fae78-de3c-48fc-8bb2-567e74af7cbf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8fe7272b782e49339c1dbbb4ff8c30bc', 'request_id': 'req-1d3fae78-de3c-48fc-8bb2-567e74af7cbf'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:28:36.096251 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-1d3fae78-de3c-48fc-8bb2-567e74af7cbf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8fe7272b782e49339c1dbbb4ff8c30bc', 'request_id': 'req-1d3fae78-de3c-48fc-8bb2-567e74af7cbf'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:28:36.107844 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-1d3fae78-de3c-48fc-8bb2-567e74af7cbf admin admin] The token cache is being invalidate because project 8fe7272b782e49339c1dbbb4ff8c30bc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 12:28:36.108132 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-1d3fae78-de3c-48fc-8bb2-567e74af7cbf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:28:36.108854 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-1d3fae78-de3c-48fc-8bb2-567e74af7cbf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:28:36.110426 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1160/2316] 10.222.0.44 () {58 vars in 1232 bytes} [Thu Jun 16 12:28:35 2022] DELETE /identity/v3/projects/8fe7272b782e49339c1dbbb4ff8c30bc => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:28:40.454503 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d56f7f8-8649-461b-a906-4a96f6c141e9 None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:28:40.455037 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d56f7f8-8649-461b-a906-4a96f6c141e9 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:28:40.455037 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d56f7f8-8649-461b-a906-4a96f6c141e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:28:40.474657 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-1d56f7f8-8649-461b-a906-4a96f6c141e9 None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:28:40.475895 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-1d56f7f8-8649-461b-a906-4a96f6c141e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:28:40.499192 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:28:40.534883 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1157/2317] 10.222.0.16 () {58 vars in 1016 bytes} [Thu Jun 16 12:28:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:28:40.549128 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3fae78-de3c-48fc-8bb2-567e74af7cbf admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:28:40.550507 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-1d3fae78-de3c-48fc-8bb2-567e74af7cbf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:28:40.622808 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3fae78-de3c-48fc-8bb2-567e74af7cbf admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:28:40.628489 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795cd3c2-6d45-411e-a4b0-442b0b247f33 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edfb12d445e74136b90800e93941f468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '601361df39e34fcca71175aa94e425c4', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:28:40.629232 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795cd3c2-6d45-411e-a4b0-442b0b247f33 service nova] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:28:40.630017 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795cd3c2-6d45-411e-a4b0-442b0b247f33 service nova] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:28:40.630288 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795cd3c2-6d45-411e-a4b0-442b0b247f33 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:28:40.639106 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795cd3c2-6d45-411e-a4b0-442b0b247f33 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:28:40.640699 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795cd3c2-6d45-411e-a4b0-442b0b247f33 service nova] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:28:40.650229 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1161/2318] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 12:28:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 12:28:44.552364 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809da12f-fd30-4ae8-98d0-54b698c126b4 None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:28:44.553012 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809da12f-fd30-4ae8-98d0-54b698c126b4 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:28:44.553012 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809da12f-fd30-4ae8-98d0-54b698c126b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:28:44.574289 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-809da12f-fd30-4ae8-98d0-54b698c126b4 None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:28:44.575639 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-809da12f-fd30-4ae8-98d0-54b698c126b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:28:44.587206 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1158/2319] 10.222.0.16 () {58 vars in 1016 bytes} [Thu Jun 16 12:28:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:28:44.607924 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795cd3c2-6d45-411e-a4b0-442b0b247f33 service nova] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:28:44.620458 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795cd3c2-6d45-411e-a4b0-442b0b247f33 service nova] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:28:44.626992 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491ac85f-84d8-4023-883c-657ca68ada3b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edfb12d445e74136b90800e93941f468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '601361df39e34fcca71175aa94e425c4', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:28:44.627625 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491ac85f-84d8-4023-883c-657ca68ada3b service nova] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:28:44.627907 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491ac85f-84d8-4023-883c-657ca68ada3b service nova] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:28:44.628178 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491ac85f-84d8-4023-883c-657ca68ada3b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:28:44.637932 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491ac85f-84d8-4023-883c-657ca68ada3b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:28:44.639523 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491ac85f-84d8-4023-883c-657ca68ada3b service nova] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:28:44.650221 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1162/2320] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 12:28:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 12:28:45.262041 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c0b249-8d4a-4a81-8d7b-6b038a5a6c21 None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:28:45.262323 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c0b249-8d4a-4a81-8d7b-6b038a5a6c21 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:28:45.262595 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c0b249-8d4a-4a81-8d7b-6b038a5a6c21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:28:45.280933 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-01c0b249-8d4a-4a81-8d7b-6b038a5a6c21 None None] MFA Rules not processed for user `93da8714f87144e6a75e3bd076ebeab6`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:28:45.282240 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-01c0b249-8d4a-4a81-8d7b-6b038a5a6c21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:28:45.337079 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1159/2321] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 12:28:45 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:28:47.874911 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645d7c69-a190-4341-bf16-fa24e7a03fa9 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:28:47.875556 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645d7c69-a190-4341-bf16-fa24e7a03fa9 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:28:47.875556 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645d7c69-a190-4341-bf16-fa24e7a03fa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:28:47.939091 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:28:47.947742 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-645d7c69-a190-4341-bf16-fa24e7a03fa9 None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:28:47.950038 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-645d7c69-a190-4341-bf16-fa24e7a03fa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:28:48.015683 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1163/2322] 10.222.0.16 () {58 vars in 1016 bytes} [Thu Jun 16 12:28:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:28:48.116157 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c0b249-8d4a-4a81-8d7b-6b038a5a6c21 None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:28:48.160091 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c0b249-8d4a-4a81-8d7b-6b038a5a6c21 None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:28:48.167264 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e59b955-67b2-474a-a5a1-914df6552592 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edfb12d445e74136b90800e93941f468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '601361df39e34fcca71175aa94e425c4', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:28:48.168065 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e59b955-67b2-474a-a5a1-914df6552592 service nova] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:28:48.168412 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e59b955-67b2-474a-a5a1-914df6552592 service nova] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:28:48.168691 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e59b955-67b2-474a-a5a1-914df6552592 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:28:48.177776 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e59b955-67b2-474a-a5a1-914df6552592 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:28:48.179531 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e59b955-67b2-474a-a5a1-914df6552592 service nova] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:28:48.189955 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1160/2323] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 12:28:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 12:28:50.847288 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e32d90-9bf8-4bc0-8786-9e9af8a17ae1 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:28:50.847767 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e32d90-9bf8-4bc0-8786-9e9af8a17ae1 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:28:50.847966 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e32d90-9bf8-4bc0-8786-9e9af8a17ae1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:28:50.867718 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-d3e32d90-9bf8-4bc0-8786-9e9af8a17ae1 None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:28:50.869017 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-d3e32d90-9bf8-4bc0-8786-9e9af8a17ae1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:28:50.877439 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1164/2324] 10.222.0.16 () {58 vars in 1016 bytes} [Thu Jun 16 12:28:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:28:50.892354 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e59b955-67b2-474a-a5a1-914df6552592 service nova] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:28:50.905300 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e59b955-67b2-474a-a5a1-914df6552592 service nova] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:28:50.911690 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed337144-ec8f-43c3-b860-17ec6843680f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edfb12d445e74136b90800e93941f468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '601361df39e34fcca71175aa94e425c4', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:28:50.912357 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed337144-ec8f-43c3-b860-17ec6843680f service nova] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:28:50.912631 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed337144-ec8f-43c3-b860-17ec6843680f service nova] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:28:50.912970 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed337144-ec8f-43c3-b860-17ec6843680f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:28:50.926392 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed337144-ec8f-43c3-b860-17ec6843680f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:28:50.928044 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed337144-ec8f-43c3-b860-17ec6843680f service nova] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:28:50.939483 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1161/2325] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 12:28:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 12:28:56.070118 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0172dde-eba6-4cd0-ab8f-ca7e1e7bbe49 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:28:56.070590 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0172dde-eba6-4cd0-ab8f-ca7e1e7bbe49 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:28:56.070706 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0172dde-eba6-4cd0-ab8f-ca7e1e7bbe49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:28:56.088706 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-a0172dde-eba6-4cd0-ab8f-ca7e1e7bbe49 None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:28:56.089933 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-a0172dde-eba6-4cd0-ab8f-ca7e1e7bbe49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:28:56.098046 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1165/2326] 10.222.0.16 () {58 vars in 1016 bytes} [Thu Jun 16 12:28:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:28:56.131802 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed337144-ec8f-43c3-b860-17ec6843680f service nova] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:28:56.133243 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-ed337144-ec8f-43c3-b860-17ec6843680f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:28:56.159949 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed337144-ec8f-43c3-b860-17ec6843680f service nova] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:28:56.161684 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0172dde-eba6-4cd0-ab8f-ca7e1e7bbe49 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:28:56.163843 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-a0172dde-eba6-4cd0-ab8f-ca7e1e7bbe49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:28:56.175347 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716b5726-7ae3-48a7-8f51-6dbf8030b9f3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edfb12d445e74136b90800e93941f468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '601361df39e34fcca71175aa94e425c4', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:28:56.176002 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716b5726-7ae3-48a7-8f51-6dbf8030b9f3 service nova] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:28:56.176282 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716b5726-7ae3-48a7-8f51-6dbf8030b9f3 service nova] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:28:56.176552 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716b5726-7ae3-48a7-8f51-6dbf8030b9f3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:28:56.176832 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0172dde-eba6-4cd0-ab8f-ca7e1e7bbe49 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:28:56.181339 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521e6ae9-8842-462a-ad18-a18f5606e375 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:28:56.182193 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521e6ae9-8842-462a-ad18-a18f5606e375 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:28:56.182465 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521e6ae9-8842-462a-ad18-a18f5606e375 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:28:56.182730 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521e6ae9-8842-462a-ad18-a18f5606e375 admin admin] PATH_INFO: `/v3/users/e4a67e956c0d44439ea5aba3e7ce12e6` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:28:56.183922 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521e6ae9-8842-462a-ad18-a18f5606e375 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e4a67e956c0d44439ea5aba3e7ce12e6)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:28:56.185272 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716b5726-7ae3-48a7-8f51-6dbf8030b9f3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:28:56.185865 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521e6ae9-8842-462a-ad18-a18f5606e375 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:28:56.186837 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716b5726-7ae3-48a7-8f51-6dbf8030b9f3 service nova] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:28:56.196460 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1162/2327] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 12:28:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 12:28:56.235928 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-521e6ae9-8842-462a-ad18-a18f5606e375 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e4a67e956c0d44439ea5aba3e7ce12e6'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:28:56.236562 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-521e6ae9-8842-462a-ad18-a18f5606e375 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e4a67e956c0d44439ea5aba3e7ce12e6'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:28:56.243588 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-521e6ae9-8842-462a-ad18-a18f5606e375 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e4a67e956c0d44439ea5aba3e7ce12e6'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:28:56.244244 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-521e6ae9-8842-462a-ad18-a18f5606e375 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e4a67e956c0d44439ea5aba3e7ce12e6'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:28:56.251707 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-521e6ae9-8842-462a-ad18-a18f5606e375 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e4a67e956c0d44439ea5aba3e7ce12e6'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:28:56.270569 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1166/2328] 10.222.0.44 () {58 vars in 1223 bytes} [Thu Jun 16 12:28:56 2022] DELETE /identity/v3/users/e4a67e956c0d44439ea5aba3e7ce12e6 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 12:28:56.275894 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877b04dc-b084-45d9-a9a3-768a59ede0cd None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:28:56.276184 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877b04dc-b084-45d9-a9a3-768a59ede0cd None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:28:56.276513 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877b04dc-b084-45d9-a9a3-768a59ede0cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:28:56.299637 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-877b04dc-b084-45d9-a9a3-768a59ede0cd None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:28:56.301527 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-877b04dc-b084-45d9-a9a3-768a59ede0cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:28:56.351229 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:28:56.363383 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1163/2329] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 12:28:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:28:56.373356 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521e6ae9-8842-462a-ad18-a18f5606e375 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:28:56.374753 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-521e6ae9-8842-462a-ad18-a18f5606e375 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:28:56.458499 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521e6ae9-8842-462a-ad18-a18f5606e375 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:28:56.465430 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9bedc4-8c70-4491-a99f-d303651de7c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1094729b25a4be7b0b394998c9ca681', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '601361df39e34fcca71175aa94e425c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:28:56.466085 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9bedc4-8c70-4491-a99f-d303651de7c1 service neutron] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:28:56.466491 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9bedc4-8c70-4491-a99f-d303651de7c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:28:56.466807 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9bedc4-8c70-4491-a99f-d303651de7c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:28:56.483004 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9bedc4-8c70-4491-a99f-d303651de7c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:28:56.485153 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9bedc4-8c70-4491-a99f-d303651de7c1 service neutron] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:28:56.490397 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:28:56.512339 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1167/2330] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 12:28:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 12:28:56.854201 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877b04dc-b084-45d9-a9a3-768a59ede0cd None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:28:56.855730 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-877b04dc-b084-45d9-a9a3-768a59ede0cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:28:56.871160 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877b04dc-b084-45d9-a9a3-768a59ede0cd None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:28:56.876003 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e521b6c6-d289-43ad-bbe8-4d5c2bf8e56a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:28:56.876969 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e521b6c6-d289-43ad-bbe8-4d5c2bf8e56a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:28:56.877366 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e521b6c6-d289-43ad-bbe8-4d5c2bf8e56a admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:28:56.877779 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e521b6c6-d289-43ad-bbe8-4d5c2bf8e56a admin admin] PATH_INFO: `/v3/projects/1e4273e21bfd4d62ae87c8efdc3bc76b` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:28:56.879425 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e521b6c6-d289-43ad-bbe8-4d5c2bf8e56a admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e4273e21bfd4d62ae87c8efdc3bc76b)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:28:56.881390 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e521b6c6-d289-43ad-bbe8-4d5c2bf8e56a admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:28:56.927994 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-e521b6c6-d289-43ad-bbe8-4d5c2bf8e56a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e4273e21bfd4d62ae87c8efdc3bc76b', 'request_id': 'req-e521b6c6-d289-43ad-bbe8-4d5c2bf8e56a'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:28:56.936023 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-e521b6c6-d289-43ad-bbe8-4d5c2bf8e56a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e4273e21bfd4d62ae87c8efdc3bc76b', 'request_id': 'req-e521b6c6-d289-43ad-bbe8-4d5c2bf8e56a'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:28:56.942696 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-e521b6c6-d289-43ad-bbe8-4d5c2bf8e56a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e4273e21bfd4d62ae87c8efdc3bc76b', 'request_id': 'req-e521b6c6-d289-43ad-bbe8-4d5c2bf8e56a'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:28:56.954602 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-e521b6c6-d289-43ad-bbe8-4d5c2bf8e56a admin admin] The token cache is being invalidate because project 1e4273e21bfd4d62ae87c8efdc3bc76b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 12:28:56.954890 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-e521b6c6-d289-43ad-bbe8-4d5c2bf8e56a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:28:56.955529 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-e521b6c6-d289-43ad-bbe8-4d5c2bf8e56a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:28:56.957106 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1164/2331] 10.222.0.44 () {58 vars in 1232 bytes} [Thu Jun 16 12:28:56 2022] DELETE /identity/v3/projects/1e4273e21bfd4d62ae87c8efdc3bc76b => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:28:56.962020 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67f10c9-9a75-4f77-81b8-f5938c723830 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:28:56.962338 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67f10c9-9a75-4f77-81b8-f5938c723830 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:28:56.962636 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67f10c9-9a75-4f77-81b8-f5938c723830 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:28:56.980139 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-a67f10c9-9a75-4f77-81b8-f5938c723830 None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:28:56.981374 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-a67f10c9-9a75-4f77-81b8-f5938c723830 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:28:57.039000 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1168/2332] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 12:28:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:28:57.047062 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1060a11a-77e5-4e94-beca-21f5533635b3 None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:28:57.047376 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1060a11a-77e5-4e94-beca-21f5533635b3 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:28:57.047654 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1060a11a-77e5-4e94-beca-21f5533635b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:28:57.066299 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-1060a11a-77e5-4e94-beca-21f5533635b3 None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:28:57.067503 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-1060a11a-77e5-4e94-beca-21f5533635b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:28:57.075479 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1165/2333] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 12:28:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:28:57.079651 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67f10c9-9a75-4f77-81b8-f5938c723830 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:28:57.089228 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67f10c9-9a75-4f77-81b8-f5938c723830 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:28:57.093680 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0465e2-1829-4b8a-906a-0b486f1de35a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:28:57.094318 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0465e2-1829-4b8a-906a-0b486f1de35a admin admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:28:57.094594 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0465e2-1829-4b8a-906a-0b486f1de35a admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:28:57.094863 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0465e2-1829-4b8a-906a-0b486f1de35a admin admin] PATH_INFO: `/v3/domains` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:28:57.095575 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0465e2-1829-4b8a-906a-0b486f1de35a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:28:57.095874 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0465e2-1829-4b8a-906a-0b486f1de35a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:28:57.097490 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0465e2-1829-4b8a-906a-0b486f1de35a admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:28:57.109703 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1169/2334] 10.222.0.44 () {58 vars in 1152 bytes} [Thu Jun 16 12:28:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 12:28:57.114204 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1060a11a-77e5-4e94-beca-21f5533635b3 None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:28:57.125597 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1060a11a-77e5-4e94-beca-21f5533635b3 None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:28:57.130503 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe4a697-11f8-47cc-b20c-7d1ff2b12ad7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:28:57.131191 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe4a697-11f8-47cc-b20c-7d1ff2b12ad7 admin admin] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:28:57.131470 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe4a697-11f8-47cc-b20c-7d1ff2b12ad7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:28:57.131743 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe4a697-11f8-47cc-b20c-7d1ff2b12ad7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:28:57.132462 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe4a697-11f8-47cc-b20c-7d1ff2b12ad7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:28:57.134438 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe4a697-11f8-47cc-b20c-7d1ff2b12ad7 admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:28:57.158859 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1166/2335] 10.222.0.44 () {60 vars in 1152 bytes} [Thu Jun 16 12:28:57 2022] POST /identity/v3/projects => generated 375 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 12:28:57.162934 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0465e2-1829-4b8a-906a-0b486f1de35a admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:28:57.173432 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0465e2-1829-4b8a-906a-0b486f1de35a admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:28:57.228411 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1811243-4a37-4389-a4d9-9d70cdc4e2f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:28:57.229118 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1811243-4a37-4389-a4d9-9d70cdc4e2f4 admin admin] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:28:57.229399 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1811243-4a37-4389-a4d9-9d70cdc4e2f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:28:57.229672 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1811243-4a37-4389-a4d9-9d70cdc4e2f4 admin admin] PATH_INFO: `/v3/users` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:28:57.230357 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1811243-4a37-4389-a4d9-9d70cdc4e2f4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:28:57.232275 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1811243-4a37-4389-a4d9-9d70cdc4e2f4 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:28:57.251823 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1170/2336] 10.222.0.44 () {60 vars in 1143 bytes} [Thu Jun 16 12:28:57 2022] POST /identity/v3/users => generated 288 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 12:28:57.255893 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe4a697-11f8-47cc-b20c-7d1ff2b12ad7 admin admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:28:57.266081 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe4a697-11f8-47cc-b20c-7d1ff2b12ad7 admin admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:28:57.270648 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c60095-78a5-4f80-b44d-6ce84561c608 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:28:57.271292 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c60095-78a5-4f80-b44d-6ce84561c608 admin admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:28:57.271570 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c60095-78a5-4f80-b44d-6ce84561c608 admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:28:57.271840 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c60095-78a5-4f80-b44d-6ce84561c608 admin admin] PATH_INFO: `/v3/roles` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:28:57.272556 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c60095-78a5-4f80-b44d-6ce84561c608 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:28:57.274178 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c60095-78a5-4f80-b44d-6ce84561c608 admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:28:57.285227 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1167/2337] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 12:28:57 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 12:28:57.288872 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1811243-4a37-4389-a4d9-9d70cdc4e2f4 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:28:57.299302 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1811243-4a37-4389-a4d9-9d70cdc4e2f4 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:28:57.303855 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a18846d-ee16-40ce-a6d0-9d92c1c090b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:28:57.304499 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a18846d-ee16-40ce-a6d0-9d92c1c090b1 admin admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:28:57.304815 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a18846d-ee16-40ce-a6d0-9d92c1c090b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:28:57.305093 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a18846d-ee16-40ce-a6d0-9d92c1c090b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:28:57.306360 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a18846d-ee16-40ce-a6d0-9d92c1c090b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:28:57.307937 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a18846d-ee16-40ce-a6d0-9d92c1c090b1 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:28:57.317787 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1171/2338] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 12:28:57 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 12:28:57.321680 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c60095-78a5-4f80-b44d-6ce84561c608 admin admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:28:57.331412 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c60095-78a5-4f80-b44d-6ce84561c608 admin admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:28:57.335991 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddde54b-7cc7-4a66-8acb-d66c1da40d0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:28:57.336889 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddde54b-7cc7-4a66-8acb-d66c1da40d0c admin admin] REQUEST_METHOD: `PUT` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:28:57.337173 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddde54b-7cc7-4a66-8acb-d66c1da40d0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:28:57.337449 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddde54b-7cc7-4a66-8acb-d66c1da40d0c admin admin] PATH_INFO: `/v3/projects/1190b499f7e0492a898137ed91a4979d/users/6ab340fda7124f489c78be7e790d44d4/roles/c39882b202e942479a7cdac2fc6da72c` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:28:57.351449 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eddde54b-7cc7-4a66-8acb-d66c1da40d0c admin admin] RBAC: Authorizing `identity:create_grant(project_id=1190b499f7e0492a898137ed91a4979d, user_id=6ab340fda7124f489c78be7e790d44d4, role_id=c39882b202e942479a7cdac2fc6da72c)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:28:57.354615 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eddde54b-7cc7-4a66-8acb-d66c1da40d0c admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:28:57.367599 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1168/2339] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 16 12:28:57 2022] PUT /identity/v3/projects/1190b499f7e0492a898137ed91a4979d/users/6ab340fda7124f489c78be7e790d44d4/roles/c39882b202e942479a7cdac2fc6da72c => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:28:57.378145 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0abde2-8465-4717-b96d-f8184a74279f None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:28:57.378483 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0abde2-8465-4717-b96d-f8184a74279f None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:28:57.378765 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0abde2-8465-4717-b96d-f8184a74279f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:28:57.405102 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-0b0abde2-8465-4717-b96d-f8184a74279f None None] MFA Rules not processed for user `6ab340fda7124f489c78be7e790d44d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:28:57.406303 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-0b0abde2-8465-4717-b96d-f8184a74279f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:28:57.459191 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:28:57.471226 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1172/2340] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 12:28:57 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:28:57.482295 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddde54b-7cc7-4a66-8acb-d66c1da40d0c admin admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:28:57.483981 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-eddde54b-7cc7-4a66-8acb-d66c1da40d0c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:28:57.546543 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddde54b-7cc7-4a66-8acb-d66c1da40d0c admin admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:28:57.550476 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e00991-969c-4e37-9bc7-7bb6fbd96b55 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f96fc14ed89478c8a8c2f11c87511e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '601361df39e34fcca71175aa94e425c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:28:57.551113 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e00991-969c-4e37-9bc7-7bb6fbd96b55 service cinder] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:28:57.551462 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e00991-969c-4e37-9bc7-7bb6fbd96b55 service cinder] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:28:57.551801 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e00991-969c-4e37-9bc7-7bb6fbd96b55 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:28:57.561937 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e00991-969c-4e37-9bc7-7bb6fbd96b55 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:28:57.563655 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e00991-969c-4e37-9bc7-7bb6fbd96b55 service cinder] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:28:57.573587 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1169/2341] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 12:28:57 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 12:28:59.233792 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775ac6bf-de60-4560-9794-25329754c06f None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:28:59.234307 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775ac6bf-de60-4560-9794-25329754c06f None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:28:59.234410 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775ac6bf-de60-4560-9794-25329754c06f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:28:59.264651 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-775ac6bf-de60-4560-9794-25329754c06f None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:28:59.266095 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-775ac6bf-de60-4560-9794-25329754c06f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:28:59.341605 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1173/2342] 10.222.0.16 () {58 vars in 1016 bytes} [Thu Jun 16 12:28:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:28:59.357023 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e00991-969c-4e37-9bc7-7bb6fbd96b55 service cinder] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:28:59.358439 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-b8e00991-969c-4e37-9bc7-7bb6fbd96b55 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:28:59.378966 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:28:59.434275 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e00991-969c-4e37-9bc7-7bb6fbd96b55 service cinder] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:28:59.440079 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86353c78-5076-4415-a2e4-00fd17c6887b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edfb12d445e74136b90800e93941f468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '601361df39e34fcca71175aa94e425c4', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:28:59.440833 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86353c78-5076-4415-a2e4-00fd17c6887b service nova] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:28:59.441191 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86353c78-5076-4415-a2e4-00fd17c6887b service nova] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:28:59.441541 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86353c78-5076-4415-a2e4-00fd17c6887b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:28:59.450610 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86353c78-5076-4415-a2e4-00fd17c6887b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:28:59.452194 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86353c78-5076-4415-a2e4-00fd17c6887b service nova] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:28:59.461547 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1170/2343] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 12:28:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 12:29:07.663561 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775ac6bf-de60-4560-9794-25329754c06f None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:29:07.674000 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775ac6bf-de60-4560-9794-25329754c06f None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:29:07.678535 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3210d05b-34e8-4063-8fbd-f1c804ef3650 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:29:07.679396 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3210d05b-34e8-4063-8fbd-f1c804ef3650 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:29:07.679676 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3210d05b-34e8-4063-8fbd-f1c804ef3650 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:29:07.679948 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3210d05b-34e8-4063-8fbd-f1c804ef3650 admin admin] PATH_INFO: `/v3/users/6ab340fda7124f489c78be7e790d44d4` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:29:07.681835 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3210d05b-34e8-4063-8fbd-f1c804ef3650 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6ab340fda7124f489c78be7e790d44d4)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:29:07.683760 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3210d05b-34e8-4063-8fbd-f1c804ef3650 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:29:07.730698 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-3210d05b-34e8-4063-8fbd-f1c804ef3650 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6ab340fda7124f489c78be7e790d44d4'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:29:07.731355 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-3210d05b-34e8-4063-8fbd-f1c804ef3650 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6ab340fda7124f489c78be7e790d44d4'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:29:07.738395 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-3210d05b-34e8-4063-8fbd-f1c804ef3650 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6ab340fda7124f489c78be7e790d44d4'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:29:07.739024 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-3210d05b-34e8-4063-8fbd-f1c804ef3650 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6ab340fda7124f489c78be7e790d44d4'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:29:07.747000 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-3210d05b-34e8-4063-8fbd-f1c804ef3650 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6ab340fda7124f489c78be7e790d44d4'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:29:07.764428 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1174/2344] 10.222.0.44 () {58 vars in 1223 bytes} [Thu Jun 16 12:29:07 2022] DELETE /identity/v3/users/6ab340fda7124f489c78be7e790d44d4 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:29:07.768898 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415971fc-d962-4cca-a3f5-a59550963c61 None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:29:07.769392 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415971fc-d962-4cca-a3f5-a59550963c61 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:29:07.769491 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415971fc-d962-4cca-a3f5-a59550963c61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:29:07.787845 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-415971fc-d962-4cca-a3f5-a59550963c61 None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:29:07.789064 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-415971fc-d962-4cca-a3f5-a59550963c61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:29:07.846518 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1171/2345] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 12:29:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:29:07.856517 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3210d05b-34e8-4063-8fbd-f1c804ef3650 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:29:07.857900 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-3210d05b-34e8-4063-8fbd-f1c804ef3650 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:29:07.913477 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3210d05b-34e8-4063-8fbd-f1c804ef3650 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:29:07.917610 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3a4e9c-3735-444e-a253-015d853d6fe3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1094729b25a4be7b0b394998c9ca681', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '601361df39e34fcca71175aa94e425c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:29:07.918272 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3a4e9c-3735-444e-a253-015d853d6fe3 service neutron] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:29:07.918550 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3a4e9c-3735-444e-a253-015d853d6fe3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:29:07.918822 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3a4e9c-3735-444e-a253-015d853d6fe3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:29:07.927988 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3a4e9c-3735-444e-a253-015d853d6fe3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:29:07.929442 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3a4e9c-3735-444e-a253-015d853d6fe3 service neutron] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:29:07.934775 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:29:07.939769 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1175/2346] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 12:29:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 12:29:08.206155 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415971fc-d962-4cca-a3f5-a59550963c61 None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:29:08.207859 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-415971fc-d962-4cca-a3f5-a59550963c61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:29:08.221236 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415971fc-d962-4cca-a3f5-a59550963c61 None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:29:08.225899 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d92c2e4-c78e-4f03-a184-c6c8dd11cfd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:29:08.226858 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d92c2e4-c78e-4f03-a184-c6c8dd11cfd9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:29:08.227803 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d92c2e4-c78e-4f03-a184-c6c8dd11cfd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:29:08.228139 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d92c2e4-c78e-4f03-a184-c6c8dd11cfd9 admin admin] PATH_INFO: `/v3/projects/1190b499f7e0492a898137ed91a4979d` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:29:08.229614 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d92c2e4-c78e-4f03-a184-c6c8dd11cfd9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1190b499f7e0492a898137ed91a4979d)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:29:08.231925 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d92c2e4-c78e-4f03-a184-c6c8dd11cfd9 admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:29:08.277501 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-1d92c2e4-c78e-4f03-a184-c6c8dd11cfd9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1190b499f7e0492a898137ed91a4979d', 'request_id': 'req-1d92c2e4-c78e-4f03-a184-c6c8dd11cfd9'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:29:08.284561 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-1d92c2e4-c78e-4f03-a184-c6c8dd11cfd9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1190b499f7e0492a898137ed91a4979d', 'request_id': 'req-1d92c2e4-c78e-4f03-a184-c6c8dd11cfd9'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:29:08.290462 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-1d92c2e4-c78e-4f03-a184-c6c8dd11cfd9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1190b499f7e0492a898137ed91a4979d', 'request_id': 'req-1d92c2e4-c78e-4f03-a184-c6c8dd11cfd9'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:29:08.301144 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-1d92c2e4-c78e-4f03-a184-c6c8dd11cfd9 admin admin] The token cache is being invalidate because project 1190b499f7e0492a898137ed91a4979d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 12:29:08.301431 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-1d92c2e4-c78e-4f03-a184-c6c8dd11cfd9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:29:08.302064 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-1d92c2e4-c78e-4f03-a184-c6c8dd11cfd9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:29:08.303577 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1172/2347] 10.222.0.44 () {58 vars in 1232 bytes} [Thu Jun 16 12:29:08 2022] DELETE /identity/v3/projects/1190b499f7e0492a898137ed91a4979d => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:29:08.308553 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007f1557-93bf-456d-b24a-4361e72cf19e None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:29:08.308874 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007f1557-93bf-456d-b24a-4361e72cf19e None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:29:08.309156 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007f1557-93bf-456d-b24a-4361e72cf19e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:29:08.326682 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-007f1557-93bf-456d-b24a-4361e72cf19e None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:29:08.327876 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-007f1557-93bf-456d-b24a-4361e72cf19e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:29:08.385970 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1176/2348] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 12:29:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:29:08.394454 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34486744-1f14-4a09-8cfb-9b096977cc30 None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:29:08.394740 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34486744-1f14-4a09-8cfb-9b096977cc30 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:29:08.395047 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34486744-1f14-4a09-8cfb-9b096977cc30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:29:08.415179 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-34486744-1f14-4a09-8cfb-9b096977cc30 None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:29:08.416660 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-34486744-1f14-4a09-8cfb-9b096977cc30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:29:08.424626 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1173/2349] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 12:29:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:29:08.428863 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007f1557-93bf-456d-b24a-4361e72cf19e None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:29:08.439489 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007f1557-93bf-456d-b24a-4361e72cf19e None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:29:08.444025 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c234f2-fef0-41b9-9227-4ae77e05d618 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:29:08.444968 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c234f2-fef0-41b9-9227-4ae77e05d618 admin admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:29:08.445252 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c234f2-fef0-41b9-9227-4ae77e05d618 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:29:08.445521 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c234f2-fef0-41b9-9227-4ae77e05d618 admin admin] PATH_INFO: `/v3/domains` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:29:08.446789 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c234f2-fef0-41b9-9227-4ae77e05d618 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:29:08.447099 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c234f2-fef0-41b9-9227-4ae77e05d618 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:29:08.448792 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c234f2-fef0-41b9-9227-4ae77e05d618 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:29:08.464307 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1177/2350] 10.222.0.44 () {58 vars in 1152 bytes} [Thu Jun 16 12:29:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:29:08.465827 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34486744-1f14-4a09-8cfb-9b096977cc30 None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:29:08.476464 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34486744-1f14-4a09-8cfb-9b096977cc30 None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:29:08.482513 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc63d3a-627c-4808-ae99-442308be576e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:29:08.483294 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc63d3a-627c-4808-ae99-442308be576e admin admin] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:29:08.483574 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc63d3a-627c-4808-ae99-442308be576e admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:29:08.483844 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc63d3a-627c-4808-ae99-442308be576e admin admin] PATH_INFO: `/v3/projects` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:29:08.484538 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc63d3a-627c-4808-ae99-442308be576e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:29:08.486642 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc63d3a-627c-4808-ae99-442308be576e admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:29:08.507786 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:29:08.521868 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1174/2351] 10.222.0.44 () {60 vars in 1152 bytes} [Thu Jun 16 12:29:08 2022] POST /identity/v3/projects => generated 397 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 12:29:08.523060 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c234f2-fef0-41b9-9227-4ae77e05d618 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:29:08.534317 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c234f2-fef0-41b9-9227-4ae77e05d618 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:29:08.591757 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b131a9-cd81-4965-b302-4e5a83504950 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:29:08.592515 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b131a9-cd81-4965-b302-4e5a83504950 admin admin] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:29:08.592868 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b131a9-cd81-4965-b302-4e5a83504950 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:29:08.593095 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b131a9-cd81-4965-b302-4e5a83504950 admin admin] PATH_INFO: `/v3/users` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:29:08.593788 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b131a9-cd81-4965-b302-4e5a83504950 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:29:08.595710 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b131a9-cd81-4965-b302-4e5a83504950 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:29:08.618618 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1178/2352] 10.222.0.44 () {60 vars in 1143 bytes} [Thu Jun 16 12:29:08 2022] POST /identity/v3/users => generated 299 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 12:29:08.622633 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc63d3a-627c-4808-ae99-442308be576e admin admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:29:08.632813 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc63d3a-627c-4808-ae99-442308be576e admin admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:29:08.638233 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b64de4-c70d-42bb-b35d-13a24d8343e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:29:08.638880 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b64de4-c70d-42bb-b35d-13a24d8343e6 admin admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:29:08.639161 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b64de4-c70d-42bb-b35d-13a24d8343e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:29:08.639433 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b64de4-c70d-42bb-b35d-13a24d8343e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:29:08.640156 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b64de4-c70d-42bb-b35d-13a24d8343e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:29:08.641827 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b64de4-c70d-42bb-b35d-13a24d8343e6 admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:29:08.652545 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1175/2353] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 12:29:08 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 12:29:08.656300 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b131a9-cd81-4965-b302-4e5a83504950 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:29:08.666314 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b131a9-cd81-4965-b302-4e5a83504950 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:29:08.671063 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172f07d6-1ef7-425f-99ca-96139702f6cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:29:08.671710 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172f07d6-1ef7-425f-99ca-96139702f6cd admin admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:29:08.671988 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172f07d6-1ef7-425f-99ca-96139702f6cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:29:08.672267 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172f07d6-1ef7-425f-99ca-96139702f6cd admin admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:29:08.673021 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172f07d6-1ef7-425f-99ca-96139702f6cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:29:08.674611 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172f07d6-1ef7-425f-99ca-96139702f6cd admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:29:08.685035 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1179/2354] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 12:29:08 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 12:29:08.689068 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b64de4-c70d-42bb-b35d-13a24d8343e6 admin admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:29:08.699596 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b64de4-c70d-42bb-b35d-13a24d8343e6 admin admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:29:08.704121 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3dd164-2c06-4455-a324-7d1fe014e745 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:29:08.705016 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3dd164-2c06-4455-a324-7d1fe014e745 admin admin] REQUEST_METHOD: `PUT` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:29:08.705296 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3dd164-2c06-4455-a324-7d1fe014e745 admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:29:08.705568 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3dd164-2c06-4455-a324-7d1fe014e745 admin admin] PATH_INFO: `/v3/projects/eb0b025b620b407e9f36cb01be37bf88/users/c5660604b3344a3595d27874a70aee3e/roles/c39882b202e942479a7cdac2fc6da72c` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:29:08.719759 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3dd164-2c06-4455-a324-7d1fe014e745 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb0b025b620b407e9f36cb01be37bf88, user_id=c5660604b3344a3595d27874a70aee3e, role_id=c39882b202e942479a7cdac2fc6da72c)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:29:08.722421 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3dd164-2c06-4455-a324-7d1fe014e745 admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:29:08.743986 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1176/2355] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 16 12:29:08 2022] PUT /identity/v3/projects/eb0b025b620b407e9f36cb01be37bf88/users/c5660604b3344a3595d27874a70aee3e/roles/c39882b202e942479a7cdac2fc6da72c => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:29:08.745741 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2d8688-eb2b-40ed-b5de-812280e45e9e None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:29:08.746030 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2d8688-eb2b-40ed-b5de-812280e45e9e None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:29:08.746303 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2d8688-eb2b-40ed-b5de-812280e45e9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:29:08.772710 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-bf2d8688-eb2b-40ed-b5de-812280e45e9e None None] MFA Rules not processed for user `c5660604b3344a3595d27874a70aee3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:29:08.773949 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-bf2d8688-eb2b-40ed-b5de-812280e45e9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:29:08.829316 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:29:08.839069 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1180/2356] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 12:29:08 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:29:08.850152 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3dd164-2c06-4455-a324-7d1fe014e745 admin admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:29:08.851971 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-8c3dd164-2c06-4455-a324-7d1fe014e745 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:29:08.907797 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3dd164-2c06-4455-a324-7d1fe014e745 admin admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:29:08.911710 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59faca4d-4832-4a7c-a12e-2c80e8424ecc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f96fc14ed89478c8a8c2f11c87511e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '601361df39e34fcca71175aa94e425c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:29:08.912341 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59faca4d-4832-4a7c-a12e-2c80e8424ecc service cinder] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:29:08.912622 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59faca4d-4832-4a7c-a12e-2c80e8424ecc service cinder] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:29:08.912926 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59faca4d-4832-4a7c-a12e-2c80e8424ecc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:29:08.921450 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59faca4d-4832-4a7c-a12e-2c80e8424ecc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:29:08.922893 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59faca4d-4832-4a7c-a12e-2c80e8424ecc service cinder] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:29:08.932546 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1177/2357] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 12:29:08 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 12:29:11.146956 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60ef118-a28b-41e6-9fb4-be6ddecc8bac None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:29:11.147421 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60ef118-a28b-41e6-9fb4-be6ddecc8bac None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:29:11.147642 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60ef118-a28b-41e6-9fb4-be6ddecc8bac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:29:11.189008 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-a60ef118-a28b-41e6-9fb4-be6ddecc8bac None None] MFA Rules not processed for user `222b53cae3d64412b9b0a89d162311f4`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:29:11.190226 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-a60ef118-a28b-41e6-9fb4-be6ddecc8bac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:29:11.259685 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1181/2358] 10.222.0.44 () {58 vars in 1009 bytes} [Thu Jun 16 12:29:11 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:29:11.305354 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59faca4d-4832-4a7c-a12e-2c80e8424ecc service cinder] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:29:11.307422 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-59faca4d-4832-4a7c-a12e-2c80e8424ecc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:29:11.377213 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59faca4d-4832-4a7c-a12e-2c80e8424ecc service cinder] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:29:11.382645 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918adcf6-0cca-4bc8-8c27-7e4c5a54c422 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c159f79c1921496487101aac5d530ae5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '601361df39e34fcca71175aa94e425c4', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:29:11.383841 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918adcf6-0cca-4bc8-8c27-7e4c5a54c422 service swift] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:29:11.384125 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918adcf6-0cca-4bc8-8c27-7e4c5a54c422 service swift] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:29:11.384401 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918adcf6-0cca-4bc8-8c27-7e4c5a54c422 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:29:11.393039 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918adcf6-0cca-4bc8-8c27-7e4c5a54c422 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:29:11.394621 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918adcf6-0cca-4bc8-8c27-7e4c5a54c422 service swift] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:29:11.403588 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1178/2359] 10.222.0.44 () {60 vars in 1384 bytes} [Thu Jun 16 12:29:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 16 12:29:13.940131 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60ef118-a28b-41e6-9fb4-be6ddecc8bac None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:29:14.011057 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60ef118-a28b-41e6-9fb4-be6ddecc8bac None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:29:14.015625 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a18c83-a8e5-4370-bf88-34dee80f027e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:29:14.016532 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a18c83-a8e5-4370-bf88-34dee80f027e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:29:14.016967 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a18c83-a8e5-4370-bf88-34dee80f027e admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:29:14.017094 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a18c83-a8e5-4370-bf88-34dee80f027e admin admin] PATH_INFO: `/v3/users/c5660604b3344a3595d27874a70aee3e` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:29:14.018297 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a18c83-a8e5-4370-bf88-34dee80f027e admin admin] RBAC: Authorizing `identity:delete_user(user_id=c5660604b3344a3595d27874a70aee3e)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:29:14.020264 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a18c83-a8e5-4370-bf88-34dee80f027e admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:29:14.077575 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-44a18c83-a8e5-4370-bf88-34dee80f027e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c5660604b3344a3595d27874a70aee3e'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:29:14.078719 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-44a18c83-a8e5-4370-bf88-34dee80f027e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c5660604b3344a3595d27874a70aee3e'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:29:14.094126 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-44a18c83-a8e5-4370-bf88-34dee80f027e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c5660604b3344a3595d27874a70aee3e'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:29:14.094859 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-44a18c83-a8e5-4370-bf88-34dee80f027e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c5660604b3344a3595d27874a70aee3e'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:29:14.105013 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-44a18c83-a8e5-4370-bf88-34dee80f027e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c5660604b3344a3595d27874a70aee3e'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:29:14.129005 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1182/2360] 10.222.0.44 () {58 vars in 1223 bytes} [Thu Jun 16 12:29:13 2022] DELETE /identity/v3/users/c5660604b3344a3595d27874a70aee3e => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:29:14.130592 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb6a1b8-f8a5-48be-9ffc-5204c9df59e1 None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:29:14.131229 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb6a1b8-f8a5-48be-9ffc-5204c9df59e1 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:29:14.131229 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb6a1b8-f8a5-48be-9ffc-5204c9df59e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:29:14.151415 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-5bb6a1b8-f8a5-48be-9ffc-5204c9df59e1 None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:29:14.152794 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-5bb6a1b8-f8a5-48be-9ffc-5204c9df59e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:29:14.236798 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:29:14.252804 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1179/2361] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 12:29:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:29:14.263006 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a18c83-a8e5-4370-bf88-34dee80f027e admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:29:14.265132 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-44a18c83-a8e5-4370-bf88-34dee80f027e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:29:14.274866 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:29:14.391538 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a18c83-a8e5-4370-bf88-34dee80f027e admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:29:14.406927 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb179d4d-22a7-419b-aef9-9e70a4bd6d4d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1094729b25a4be7b0b394998c9ca681', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '601361df39e34fcca71175aa94e425c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:29:14.407727 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb179d4d-22a7-419b-aef9-9e70a4bd6d4d service neutron] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:29:14.408474 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb179d4d-22a7-419b-aef9-9e70a4bd6d4d service neutron] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:29:14.408903 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb179d4d-22a7-419b-aef9-9e70a4bd6d4d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:29:14.421271 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb179d4d-22a7-419b-aef9-9e70a4bd6d4d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:29:14.422872 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb179d4d-22a7-419b-aef9-9e70a4bd6d4d service neutron] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:29:14.441305 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1183/2362] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 12:29:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 12:29:14.841189 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb6a1b8-f8a5-48be-9ffc-5204c9df59e1 None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:29:14.842983 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-5bb6a1b8-f8a5-48be-9ffc-5204c9df59e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:29:14.861645 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb6a1b8-f8a5-48be-9ffc-5204c9df59e1 None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:29:14.869701 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57af20dd-4089-47fe-96ad-e827be0fa0e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:29:14.870666 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57af20dd-4089-47fe-96ad-e827be0fa0e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:29:14.871088 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57af20dd-4089-47fe-96ad-e827be0fa0e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:29:14.871306 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57af20dd-4089-47fe-96ad-e827be0fa0e3 admin admin] PATH_INFO: `/v3/projects/eb0b025b620b407e9f36cb01be37bf88` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:29:14.872346 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57af20dd-4089-47fe-96ad-e827be0fa0e3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eb0b025b620b407e9f36cb01be37bf88)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:29:14.874505 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57af20dd-4089-47fe-96ad-e827be0fa0e3 admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:29:14.941197 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-57af20dd-4089-47fe-96ad-e827be0fa0e3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eb0b025b620b407e9f36cb01be37bf88', 'request_id': 'req-57af20dd-4089-47fe-96ad-e827be0fa0e3'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:29:14.950461 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-57af20dd-4089-47fe-96ad-e827be0fa0e3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eb0b025b620b407e9f36cb01be37bf88', 'request_id': 'req-57af20dd-4089-47fe-96ad-e827be0fa0e3'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:29:14.957197 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-57af20dd-4089-47fe-96ad-e827be0fa0e3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eb0b025b620b407e9f36cb01be37bf88', 'request_id': 'req-57af20dd-4089-47fe-96ad-e827be0fa0e3'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:29:14.969296 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-57af20dd-4089-47fe-96ad-e827be0fa0e3 admin admin] The token cache is being invalidate because project eb0b025b620b407e9f36cb01be37bf88 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 12:29:14.969682 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-57af20dd-4089-47fe-96ad-e827be0fa0e3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:29:14.970452 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-57af20dd-4089-47fe-96ad-e827be0fa0e3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:29:14.972086 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1180/2363] 10.222.0.44 () {58 vars in 1232 bytes} [Thu Jun 16 12:29:14 2022] DELETE /identity/v3/projects/eb0b025b620b407e9f36cb01be37bf88 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:29:14.977625 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddf26f1-466c-40ee-be01-39f04d60439a None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:29:14.978162 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddf26f1-466c-40ee-be01-39f04d60439a None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:29:14.978258 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddf26f1-466c-40ee-be01-39f04d60439a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:29:14.997671 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-4ddf26f1-466c-40ee-be01-39f04d60439a None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:29:14.998905 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-4ddf26f1-466c-40ee-be01-39f04d60439a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:29:15.068651 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1184/2364] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 12:29:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 12:29:15.076531 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06338b36-5f99-448d-adf5-e69ca5fcbff6 None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:29:15.076852 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06338b36-5f99-448d-adf5-e69ca5fcbff6 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:29:15.077131 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06338b36-5f99-448d-adf5-e69ca5fcbff6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:29:15.096697 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-06338b36-5f99-448d-adf5-e69ca5fcbff6 None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:29:15.098330 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-06338b36-5f99-448d-adf5-e69ca5fcbff6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:29:15.107706 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1181/2365] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 12:29:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:29:15.112643 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddf26f1-466c-40ee-be01-39f04d60439a None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:29:15.126667 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddf26f1-466c-40ee-be01-39f04d60439a None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:29:15.131559 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146e60e7-66d1-4c98-aee3-de6f2b3183ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:29:15.132217 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146e60e7-66d1-4c98-aee3-de6f2b3183ef admin admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:29:15.132504 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146e60e7-66d1-4c98-aee3-de6f2b3183ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:29:15.132865 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146e60e7-66d1-4c98-aee3-de6f2b3183ef admin admin] PATH_INFO: `/v3/domains` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:29:15.133601 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146e60e7-66d1-4c98-aee3-de6f2b3183ef admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:29:15.133909 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146e60e7-66d1-4c98-aee3-de6f2b3183ef admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:29:15.135551 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146e60e7-66d1-4c98-aee3-de6f2b3183ef admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:29:15.150762 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1185/2366] 10.222.0.44 () {58 vars in 1152 bytes} [Thu Jun 16 12:29:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:29:15.155666 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06338b36-5f99-448d-adf5-e69ca5fcbff6 None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:29:15.166867 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06338b36-5f99-448d-adf5-e69ca5fcbff6 None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:29:15.172443 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7098af1a-79b2-48d1-a969-902cf27220c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:29:15.173435 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7098af1a-79b2-48d1-a969-902cf27220c2 admin admin] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:29:15.173791 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7098af1a-79b2-48d1-a969-902cf27220c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:29:15.174142 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7098af1a-79b2-48d1-a969-902cf27220c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:29:15.174918 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7098af1a-79b2-48d1-a969-902cf27220c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:29:15.176986 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7098af1a-79b2-48d1-a969-902cf27220c2 admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:29:15.210400 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1182/2367] 10.222.0.44 () {60 vars in 1152 bytes} [Thu Jun 16 12:29:15 2022] POST /identity/v3/projects => generated 383 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 12:29:15.211714 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146e60e7-66d1-4c98-aee3-de6f2b3183ef admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:29:15.222919 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146e60e7-66d1-4c98-aee3-de6f2b3183ef admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:29:15.290558 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73b4ea3-4424-4762-b1d9-a8ed64888c0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:29:15.291347 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73b4ea3-4424-4762-b1d9-a8ed64888c0a admin admin] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:29:15.291699 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73b4ea3-4424-4762-b1d9-a8ed64888c0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:29:15.292041 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73b4ea3-4424-4762-b1d9-a8ed64888c0a admin admin] PATH_INFO: `/v3/users` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:29:15.292780 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73b4ea3-4424-4762-b1d9-a8ed64888c0a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:29:15.294744 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73b4ea3-4424-4762-b1d9-a8ed64888c0a admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:29:15.318442 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1186/2368] 10.222.0.44 () {60 vars in 1143 bytes} [Thu Jun 16 12:29:15 2022] POST /identity/v3/users => generated 292 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 12:29:15.322399 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7098af1a-79b2-48d1-a969-902cf27220c2 admin admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:29:15.339468 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7098af1a-79b2-48d1-a969-902cf27220c2 admin admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:29:15.344651 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b469cbf9-f626-48da-a60d-f18efc672679 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:29:15.345427 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b469cbf9-f626-48da-a60d-f18efc672679 admin admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:29:15.345789 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b469cbf9-f626-48da-a60d-f18efc672679 admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:29:15.346142 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b469cbf9-f626-48da-a60d-f18efc672679 admin admin] PATH_INFO: `/v3/roles` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:29:15.347059 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b469cbf9-f626-48da-a60d-f18efc672679 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:29:15.348714 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b469cbf9-f626-48da-a60d-f18efc672679 admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:29:15.361897 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1183/2369] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 12:29:15 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 12:29:15.366375 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73b4ea3-4424-4762-b1d9-a8ed64888c0a admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:29:15.378407 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73b4ea3-4424-4762-b1d9-a8ed64888c0a admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:29:15.384006 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922f7fd0-e5cb-42a4-8d8f-d9b0b17638b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:29:15.384679 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922f7fd0-e5cb-42a4-8d8f-d9b0b17638b2 admin admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:29:15.384993 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922f7fd0-e5cb-42a4-8d8f-d9b0b17638b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:29:15.385499 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922f7fd0-e5cb-42a4-8d8f-d9b0b17638b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:29:15.386004 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922f7fd0-e5cb-42a4-8d8f-d9b0b17638b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:29:15.387624 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922f7fd0-e5cb-42a4-8d8f-d9b0b17638b2 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:29:15.398231 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1187/2370] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 12:29:15 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 12:29:15.402879 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b469cbf9-f626-48da-a60d-f18efc672679 admin admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:29:15.415504 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b469cbf9-f626-48da-a60d-f18efc672679 admin admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:29:15.421079 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f5024a-89ff-425c-a54f-cc708107ae75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:29:15.422097 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f5024a-89ff-425c-a54f-cc708107ae75 admin admin] REQUEST_METHOD: `PUT` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:29:15.422459 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f5024a-89ff-425c-a54f-cc708107ae75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:29:15.422808 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f5024a-89ff-425c-a54f-cc708107ae75 admin admin] PATH_INFO: `/v3/projects/648dcd7b1d814429a17ba5365b4882bd/users/1eeb134860684ab0a4b2477e97f04caf/roles/c39882b202e942479a7cdac2fc6da72c` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:29:15.439588 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f5024a-89ff-425c-a54f-cc708107ae75 admin admin] RBAC: Authorizing `identity:create_grant(project_id=648dcd7b1d814429a17ba5365b4882bd, user_id=1eeb134860684ab0a4b2477e97f04caf, role_id=c39882b202e942479a7cdac2fc6da72c)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:29:15.442530 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f5024a-89ff-425c-a54f-cc708107ae75 admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:29:15.457793 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1184/2371] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 16 12:29:15 2022] PUT /identity/v3/projects/648dcd7b1d814429a17ba5365b4882bd/users/1eeb134860684ab0a4b2477e97f04caf/roles/c39882b202e942479a7cdac2fc6da72c => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:29:15.463601 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbcb7e1-e2ed-413d-aee1-e10ec0462c11 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:29:15.464022 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbcb7e1-e2ed-413d-aee1-e10ec0462c11 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:29:15.464376 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbcb7e1-e2ed-413d-aee1-e10ec0462c11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:29:15.485799 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-0dbcb7e1-e2ed-413d-aee1-e10ec0462c11 None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:29:15.487103 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-0dbcb7e1-e2ed-413d-aee1-e10ec0462c11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:29:15.497923 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:29:15.555356 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1188/2372] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 12:29:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:29:15.565085 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f5024a-89ff-425c-a54f-cc708107ae75 admin admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:29:15.567261 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-e8f5024a-89ff-425c-a54f-cc708107ae75 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:29:15.649926 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f5024a-89ff-425c-a54f-cc708107ae75 admin admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:29:15.653978 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c381936-2222-496f-9182-b22d9003c872 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1094729b25a4be7b0b394998c9ca681', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '601361df39e34fcca71175aa94e425c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:29:15.654775 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c381936-2222-496f-9182-b22d9003c872 service neutron] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:29:15.655061 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c381936-2222-496f-9182-b22d9003c872 service neutron] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:29:15.655337 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c381936-2222-496f-9182-b22d9003c872 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:29:15.683378 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c381936-2222-496f-9182-b22d9003c872 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:29:15.685442 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c381936-2222-496f-9182-b22d9003c872 service neutron] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:29:15.704906 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1185/2373] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 12:29:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 12:29:16.899042 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dfe2ec-0a08-4376-92c1-a8e2c9034cd8 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:29:16.899502 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dfe2ec-0a08-4376-92c1-a8e2c9034cd8 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:29:16.899714 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dfe2ec-0a08-4376-92c1-a8e2c9034cd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:29:16.922480 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-88dfe2ec-0a08-4376-92c1-a8e2c9034cd8 None None] MFA Rules not processed for user `fc4d60019f15420898e9e5c3a527a0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:29:16.922480 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-88dfe2ec-0a08-4376-92c1-a8e2c9034cd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:29:17.016278 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1189/2374] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 12:29:16 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:29:23.790424 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2620521d-2607-4ebb-ad29-17a771377c24 None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:29:23.791523 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2620521d-2607-4ebb-ad29-17a771377c24 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:29:23.792011 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2620521d-2607-4ebb-ad29-17a771377c24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:29:23.840423 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-2620521d-2607-4ebb-ad29-17a771377c24 None None] MFA Rules not processed for user `1eeb134860684ab0a4b2477e97f04caf`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:29:23.842050 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-2620521d-2607-4ebb-ad29-17a771377c24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:29:23.848873 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:29:23.953905 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1186/2375] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 12:29:23 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:29:23.959393 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88dfe2ec-0a08-4376-92c1-a8e2c9034cd8 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:29:23.977569 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88dfe2ec-0a08-4376-92c1-a8e2c9034cd8 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:29:23.993447 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b91766f-a69f-48a6-9f01-170328326954 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:29:23.993447 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b91766f-a69f-48a6-9f01-170328326954 admin admin] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:29:23.993447 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b91766f-a69f-48a6-9f01-170328326954 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:29:23.993447 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b91766f-a69f-48a6-9f01-170328326954 admin admin] PATH_INFO: `/v3/projects` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:29:23.993802 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b91766f-a69f-48a6-9f01-170328326954 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:29:23.994047 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b91766f-a69f-48a6-9f01-170328326954 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:29:24.033436 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1190/2376] 10.222.0.44 () {60 vars in 1152 bytes} [Thu Jun 16 12:29:23 2022] POST /identity/v3/projects => generated 385 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 12:29:24.037541 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2620521d-2607-4ebb-ad29-17a771377c24 None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:29:24.051575 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2620521d-2607-4ebb-ad29-17a771377c24 None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:29:24.163041 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4b7086-f2dd-4015-9c14-af51909dd9e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:29:24.164465 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4b7086-f2dd-4015-9c14-af51909dd9e3 admin admin] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:29:24.164951 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4b7086-f2dd-4015-9c14-af51909dd9e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:29:24.165130 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4b7086-f2dd-4015-9c14-af51909dd9e3 admin admin] PATH_INFO: `/v3/users` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:29:24.165941 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4b7086-f2dd-4015-9c14-af51909dd9e3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:29:24.168248 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4b7086-f2dd-4015-9c14-af51909dd9e3 admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:29:24.198645 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1187/2377] 10.222.0.44 () {60 vars in 1143 bytes} [Thu Jun 16 12:29:24 2022] POST /identity/v3/users => generated 299 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 12:29:24.202666 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b91766f-a69f-48a6-9f01-170328326954 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:29:24.220367 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b91766f-a69f-48a6-9f01-170328326954 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:29:24.232890 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8870a6d-f094-499d-b1ed-0449cb38e20c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:29:24.234084 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8870a6d-f094-499d-b1ed-0449cb38e20c admin admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:29:24.234563 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8870a6d-f094-499d-b1ed-0449cb38e20c admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:29:24.235133 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8870a6d-f094-499d-b1ed-0449cb38e20c admin admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:29:24.236383 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8870a6d-f094-499d-b1ed-0449cb38e20c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:29:24.239304 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8870a6d-f094-499d-b1ed-0449cb38e20c admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:29:24.256396 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1191/2378] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 12:29:24 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 12:29:24.260866 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4b7086-f2dd-4015-9c14-af51909dd9e3 admin admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:29:24.271717 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4b7086-f2dd-4015-9c14-af51909dd9e3 admin admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:29:24.276931 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bdd3c7-0a6b-43fe-bd6c-c10579ff03e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:29:24.277819 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bdd3c7-0a6b-43fe-bd6c-c10579ff03e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:29:24.278103 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bdd3c7-0a6b-43fe-bd6c-c10579ff03e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:29:24.278357 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bdd3c7-0a6b-43fe-bd6c-c10579ff03e1 admin admin] PATH_INFO: `/v3/projects/3a01bd9ca596488ead66db704730f1ff/users/d907b5796c3c47b5814f52f6c54bda8c/roles/0688968254744e3f9913653cafea3091` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:29:24.294303 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bdd3c7-0a6b-43fe-bd6c-c10579ff03e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a01bd9ca596488ead66db704730f1ff, user_id=d907b5796c3c47b5814f52f6c54bda8c, role_id=0688968254744e3f9913653cafea3091)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:29:24.297226 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bdd3c7-0a6b-43fe-bd6c-c10579ff03e1 admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:29:24.312126 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1188/2379] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 16 12:29:24 2022] PUT /identity/v3/projects/3a01bd9ca596488ead66db704730f1ff/users/d907b5796c3c47b5814f52f6c54bda8c/roles/0688968254744e3f9913653cafea3091 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 12:29:24.315917 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8870a6d-f094-499d-b1ed-0449cb38e20c admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:29:24.326613 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8870a6d-f094-499d-b1ed-0449cb38e20c admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:29:24.383736 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad98e2a-e9b4-4584-8051-ddac5d15ded7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:29:24.384409 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad98e2a-e9b4-4584-8051-ddac5d15ded7 admin admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:29:24.384690 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad98e2a-e9b4-4584-8051-ddac5d15ded7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:29:24.384998 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad98e2a-e9b4-4584-8051-ddac5d15ded7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:29:24.385720 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad98e2a-e9b4-4584-8051-ddac5d15ded7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:29:24.387326 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad98e2a-e9b4-4584-8051-ddac5d15ded7 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:29:24.397109 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1192/2380] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 12:29:24 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 12:29:24.401707 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bdd3c7-0a6b-43fe-bd6c-c10579ff03e1 admin admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:29:24.411981 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bdd3c7-0a6b-43fe-bd6c-c10579ff03e1 admin admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:29:24.416538 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb2585e-93c6-4e9e-9d32-a42077637c8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:29:24.417461 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb2585e-93c6-4e9e-9d32-a42077637c8f admin admin] REQUEST_METHOD: `PUT` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:29:24.417783 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb2585e-93c6-4e9e-9d32-a42077637c8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:29:24.418059 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb2585e-93c6-4e9e-9d32-a42077637c8f admin admin] PATH_INFO: `/v3/projects/3a01bd9ca596488ead66db704730f1ff/users/d907b5796c3c47b5814f52f6c54bda8c/roles/0688968254744e3f9913653cafea3091` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:29:24.420068 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb2585e-93c6-4e9e-9d32-a42077637c8f admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a01bd9ca596488ead66db704730f1ff, user_id=d907b5796c3c47b5814f52f6c54bda8c, role_id=0688968254744e3f9913653cafea3091)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:29:24.422750 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb2585e-93c6-4e9e-9d32-a42077637c8f admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:29:24.434169 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1189/2381] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 16 12:29:24 2022] PUT /identity/v3/projects/3a01bd9ca596488ead66db704730f1ff/users/d907b5796c3c47b5814f52f6c54bda8c/roles/0688968254744e3f9913653cafea3091 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:29:29.957728 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248680c4-2492-4b9b-b547-2b8b3b64b211 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:29:29.958264 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248680c4-2492-4b9b-b547-2b8b3b64b211 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:29:29.958264 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248680c4-2492-4b9b-b547-2b8b3b64b211 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:29:29.987309 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-248680c4-2492-4b9b-b547-2b8b3b64b211 None None] MFA Rules not processed for user `d907b5796c3c47b5814f52f6c54bda8c`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:29:29.988947 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-248680c4-2492-4b9b-b547-2b8b3b64b211 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:29:30.000686 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:29:30.077151 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1193/2382] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 12:29:29 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:29:30.090038 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb2585e-93c6-4e9e-9d32-a42077637c8f admin admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:29:30.091828 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-abb2585e-93c6-4e9e-9d32-a42077637c8f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:29:30.157083 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb2585e-93c6-4e9e-9d32-a42077637c8f admin admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:29:30.161084 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ab903f-6b05-4b8d-adaf-8ad0af0e78cd service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42dedbccc64747d581c862a69ae20941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '601361df39e34fcca71175aa94e425c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:29:30.161734 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ab903f-6b05-4b8d-adaf-8ad0af0e78cd service glance] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:29:30.162023 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ab903f-6b05-4b8d-adaf-8ad0af0e78cd service glance] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:29:30.162303 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ab903f-6b05-4b8d-adaf-8ad0af0e78cd service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:29:30.176418 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:29:30.229627 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ab903f-6b05-4b8d-adaf-8ad0af0e78cd service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:29:30.231177 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ab903f-6b05-4b8d-adaf-8ad0af0e78cd service glance] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:29:30.265118 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1190/2383] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 12:29:30 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 12:29:30.361438 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451ee7ea-03bb-446b-b891-95a87c63203d None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:29:30.361784 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451ee7ea-03bb-446b-b891-95a87c63203d None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:29:30.362064 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451ee7ea-03bb-446b-b891-95a87c63203d None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:29:30.363628 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1194/2384] 10.222.0.44 () {54 vars in 921 bytes} [Thu Jun 16 12:29:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 12:29:30.374854 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc87d75b-61b4-4e78-824f-a700662d7bf5 None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:29:30.375197 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc87d75b-61b4-4e78-824f-a700662d7bf5 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:29:30.375479 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc87d75b-61b4-4e78-824f-a700662d7bf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:29:30.429177 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61303771-5fa2-4027-ba46-378eb79cbfd4 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:29:30.429459 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61303771-5fa2-4027-ba46-378eb79cbfd4 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:29:30.429735 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61303771-5fa2-4027-ba46-378eb79cbfd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:29:30.449350 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-61303771-5fa2-4027-ba46-378eb79cbfd4 None None] MFA Rules not processed for user `222b53cae3d64412b9b0a89d162311f4`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:29:30.450573 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-61303771-5fa2-4027-ba46-378eb79cbfd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:29:30.507989 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-cc87d75b-61b4-4e78-824f-a700662d7bf5 None None] MFA Rules not processed for user `edfb12d445e74136b90800e93941f468`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:29:30.512199 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-cc87d75b-61b4-4e78-824f-a700662d7bf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:29:30.556153 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1195/2385] 10.222.0.44 () {58 vars in 1009 bytes} [Thu Jun 16 12:29:30 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:29:30.568364 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61303771-5fa2-4027-ba46-378eb79cbfd4 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:29:30.573360 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-61303771-5fa2-4027-ba46-378eb79cbfd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:29:30.723428 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61303771-5fa2-4027-ba46-378eb79cbfd4 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:29:30.729153 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1191/2386] 10.222.0.44 () {58 vars in 1018 bytes} [Thu Jun 16 12:29:30 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 356 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:29:30.731034 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfda2afb-9c5e-4d9d-9089-9ce672831c4d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c159f79c1921496487101aac5d530ae5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '601361df39e34fcca71175aa94e425c4', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:29:30.737949 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc87d75b-61b4-4e78-824f-a700662d7bf5 None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:29:30.741310 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfda2afb-9c5e-4d9d-9089-9ce672831c4d service swift] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:29:30.744143 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfda2afb-9c5e-4d9d-9089-9ce672831c4d service swift] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:29:30.744143 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfda2afb-9c5e-4d9d-9089-9ce672831c4d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:29:30.752673 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc87d75b-61b4-4e78-824f-a700662d7bf5 None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:29:30.755670 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfda2afb-9c5e-4d9d-9089-9ce672831c4d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:29:30.758030 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfda2afb-9c5e-4d9d-9089-9ce672831c4d service swift] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:29:30.760708 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fed40cb-33b8-48cc-8919-6ae2eff8aa12 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42dedbccc64747d581c862a69ae20941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '601361df39e34fcca71175aa94e425c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:29:30.761403 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fed40cb-33b8-48cc-8919-6ae2eff8aa12 service glance] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:29:30.761687 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fed40cb-33b8-48cc-8919-6ae2eff8aa12 service glance] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:29:30.761963 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fed40cb-33b8-48cc-8919-6ae2eff8aa12 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:29:30.777956 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fed40cb-33b8-48cc-8919-6ae2eff8aa12 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:29:30.780084 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fed40cb-33b8-48cc-8919-6ae2eff8aa12 service glance] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:29:30.781104 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1196/2387] 10.222.0.44 () {60 vars in 1384 bytes} [Thu Jun 16 12:29:30 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 16 12:29:30.800469 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1192/2388] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 12:29:30 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 12:29:30.909140 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cf07e7-6f75-45da-bd2c-00f42f14c69b None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:29:30.909851 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cf07e7-6f75-45da-bd2c-00f42f14c69b None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:29:30.910349 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cf07e7-6f75-45da-bd2c-00f42f14c69b None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:29:30.912367 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1197/2389] 10.222.0.44 () {54 vars in 921 bytes} [Thu Jun 16 12:29:30 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 12:29:30.929890 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3bb2bb-cde4-455d-8805-82a959cb15bc None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:29:30.930201 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3bb2bb-cde4-455d-8805-82a959cb15bc None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:29:30.930486 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3bb2bb-cde4-455d-8805-82a959cb15bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:29:30.974442 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-ca3bb2bb-cde4-455d-8805-82a959cb15bc None None] MFA Rules not processed for user `e1094729b25a4be7b0b394998c9ca681`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:29:30.975904 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-ca3bb2bb-cde4-455d-8805-82a959cb15bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:29:31.055053 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1193/2390] 10.222.0.44 () {58 vars in 1018 bytes} [Thu Jun 16 12:29:30 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:29:31.067152 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cf07e7-6f75-45da-bd2c-00f42f14c69b None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:29:31.069731 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-53cf07e7-6f75-45da-bd2c-00f42f14c69b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:29:31.101261 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cf07e7-6f75-45da-bd2c-00f42f14c69b None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:29:31.106685 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02dc63b-7900-4b83-9eb8-c5e4db3c0428 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1094729b25a4be7b0b394998c9ca681', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '601361df39e34fcca71175aa94e425c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:29:31.107557 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02dc63b-7900-4b83-9eb8-c5e4db3c0428 service neutron] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:29:31.108005 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02dc63b-7900-4b83-9eb8-c5e4db3c0428 service neutron] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:29:31.108430 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02dc63b-7900-4b83-9eb8-c5e4db3c0428 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:29:31.119711 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02dc63b-7900-4b83-9eb8-c5e4db3c0428 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:29:31.121248 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02dc63b-7900-4b83-9eb8-c5e4db3c0428 service neutron] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:29:31.131466 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1198/2391] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 12:29:31 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 12:29:31.254442 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09746296-2d15-4894-97d6-2c4aeb835983 None None] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:29:31.254976 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09746296-2d15-4894-97d6-2c4aeb835983 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:29:31.255155 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09746296-2d15-4894-97d6-2c4aeb835983 None None] PATH_INFO: `/` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:29:31.257344 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1194/2392] 10.222.0.44 () {54 vars in 921 bytes} [Thu Jun 16 12:29:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 12:29:31.262606 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ea722a-2dea-4cc6-8d15-1fcd9efcdf30 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:29:31.262907 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ea722a-2dea-4cc6-8d15-1fcd9efcdf30 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:29:31.263183 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ea722a-2dea-4cc6-8d15-1fcd9efcdf30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:29:31.285329 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-91ea722a-2dea-4cc6-8d15-1fcd9efcdf30 None None] MFA Rules not processed for user `edfb12d445e74136b90800e93941f468`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:29:31.286582 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-91ea722a-2dea-4cc6-8d15-1fcd9efcdf30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:29:31.308952 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1199/2393] 10.222.0.44 () {58 vars in 1018 bytes} [Thu Jun 16 12:29:31 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:29:31.314075 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09746296-2d15-4894-97d6-2c4aeb835983 None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:29:31.329923 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09746296-2d15-4894-97d6-2c4aeb835983 None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:29:31.334210 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ba04b1-6f3c-428d-a21b-86b81602444c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1094729b25a4be7b0b394998c9ca681', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '601361df39e34fcca71175aa94e425c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:29:31.335022 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ba04b1-6f3c-428d-a21b-86b81602444c service neutron] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:29:31.335302 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ba04b1-6f3c-428d-a21b-86b81602444c service neutron] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:29:31.335641 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ba04b1-6f3c-428d-a21b-86b81602444c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:29:31.347619 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:29:31.350429 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ba04b1-6f3c-428d-a21b-86b81602444c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:29:31.352013 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ba04b1-6f3c-428d-a21b-86b81602444c service neutron] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:29:31.369066 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1195/2394] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 12:29:31 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 12:29:35.086056 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551b64a5-2554-4525-90ad-01b3614be4f7 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:29:35.086679 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551b64a5-2554-4525-90ad-01b3614be4f7 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:29:35.086679 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551b64a5-2554-4525-90ad-01b3614be4f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:29:35.109157 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-551b64a5-2554-4525-90ad-01b3614be4f7 None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:29:35.110684 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-551b64a5-2554-4525-90ad-01b3614be4f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:29:35.136194 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:29:35.209925 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1200/2395] 10.222.0.16 () {58 vars in 1016 bytes} [Thu Jun 16 12:29:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 12:29:35.224597 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ba04b1-6f3c-428d-a21b-86b81602444c service neutron] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:29:35.226855 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-67ba04b1-6f3c-428d-a21b-86b81602444c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:29:35.239547 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e46e89-a5ec-446d-933b-45cddf9f2de9 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:29:35.245099 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e46e89-a5ec-446d-933b-45cddf9f2de9 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:29:35.246337 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e46e89-a5ec-446d-933b-45cddf9f2de9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:29:35.258280 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ba04b1-6f3c-428d-a21b-86b81602444c service neutron] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:29:35.267855 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813658f6-6def-4961-aae1-5361b207538f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edfb12d445e74136b90800e93941f468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '601361df39e34fcca71175aa94e425c4', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:29:35.268609 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813658f6-6def-4961-aae1-5361b207538f service nova] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:29:35.268989 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813658f6-6def-4961-aae1-5361b207538f service nova] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:29:35.269327 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813658f6-6def-4961-aae1-5361b207538f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:29:35.291597 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813658f6-6def-4961-aae1-5361b207538f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:29:35.298220 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813658f6-6def-4961-aae1-5361b207538f service nova] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:29:35.325295 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1196/2396] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 12:29:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 12:29:35.349864 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-94e46e89-a5ec-446d-933b-45cddf9f2de9 None None] MFA Rules not processed for user `222b53cae3d64412b9b0a89d162311f4`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:29:35.351736 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-94e46e89-a5ec-446d-933b-45cddf9f2de9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:29:35.393952 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1201/2397] 10.222.0.44 () {58 vars in 1009 bytes} [Thu Jun 16 12:29:35 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:29:35.415881 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813658f6-6def-4961-aae1-5361b207538f service nova] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:29:35.459659 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813658f6-6def-4961-aae1-5361b207538f service nova] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:29:35.474741 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17416b5e-ad8f-405f-927e-3ca515263fb7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c159f79c1921496487101aac5d530ae5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '601361df39e34fcca71175aa94e425c4', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:29:35.476138 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17416b5e-ad8f-405f-927e-3ca515263fb7 service swift] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:29:35.476969 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17416b5e-ad8f-405f-927e-3ca515263fb7 service swift] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:29:35.477324 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17416b5e-ad8f-405f-927e-3ca515263fb7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:29:35.494057 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17416b5e-ad8f-405f-927e-3ca515263fb7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:29:35.498954 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17416b5e-ad8f-405f-927e-3ca515263fb7 service swift] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:29:35.511407 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1197/2398] 10.222.0.44 () {60 vars in 1384 bytes} [Thu Jun 16 12:29:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 16 12:29:42.087322 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9d667a-c555-4b7b-b899-9452e2a6bdc5 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:29:42.087849 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9d667a-c555-4b7b-b899-9452e2a6bdc5 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:29:42.087849 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9d667a-c555-4b7b-b899-9452e2a6bdc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:29:42.106763 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-ae9d667a-c555-4b7b-b899-9452e2a6bdc5 None None] MFA Rules not processed for user `1eeb134860684ab0a4b2477e97f04caf`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:29:42.107994 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-ae9d667a-c555-4b7b-b899-9452e2a6bdc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:29:42.115660 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1202/2399] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 12:29:42 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:29:45.505159 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=18 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:29:47.759596 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc29112-cb1a-4c94-910d-daee069daba0 None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:29:47.760265 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc29112-cb1a-4c94-910d-daee069daba0 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:29:47.760265 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc29112-cb1a-4c94-910d-daee069daba0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:29:47.780741 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-ecc29112-cb1a-4c94-910d-daee069daba0 None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:29:47.782386 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-ecc29112-cb1a-4c94-910d-daee069daba0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:29:47.791325 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1198/2400] 10.222.0.16 () {58 vars in 1016 bytes} [Thu Jun 16 12:29:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:29:47.827775 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9d667a-c555-4b7b-b899-9452e2a6bdc5 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:29:47.843179 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9d667a-c555-4b7b-b899-9452e2a6bdc5 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:29:47.849547 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917b4176-a297-48f0-92cc-43693c1a382a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edfb12d445e74136b90800e93941f468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '601361df39e34fcca71175aa94e425c4', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:29:47.850295 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917b4176-a297-48f0-92cc-43693c1a382a service nova] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:29:47.850659 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917b4176-a297-48f0-92cc-43693c1a382a service nova] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:29:47.850997 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917b4176-a297-48f0-92cc-43693c1a382a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:29:47.868394 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917b4176-a297-48f0-92cc-43693c1a382a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:29:47.870782 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917b4176-a297-48f0-92cc-43693c1a382a service nova] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:29:47.885462 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1203/2401] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 12:29:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 12:29:48.013393 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab25b203-0066-48f6-b1a6-907a3ab3a768 None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:29:48.013673 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab25b203-0066-48f6-b1a6-907a3ab3a768 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:29:48.014115 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab25b203-0066-48f6-b1a6-907a3ab3a768 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:29:48.039207 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-ab25b203-0066-48f6-b1a6-907a3ab3a768 None None] MFA Rules not processed for user `222b53cae3d64412b9b0a89d162311f4`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:29:48.040431 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-ab25b203-0066-48f6-b1a6-907a3ab3a768 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:29:48.054856 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1199/2402] 10.222.0.44 () {58 vars in 1009 bytes} [Thu Jun 16 12:29:48 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 12:29:48.068051 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917b4176-a297-48f0-92cc-43693c1a382a service nova] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:29:48.085043 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917b4176-a297-48f0-92cc-43693c1a382a service nova] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:29:48.090879 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762d8ce0-89f7-4932-9560-2251a5f8e442 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c159f79c1921496487101aac5d530ae5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '601361df39e34fcca71175aa94e425c4', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:29:48.091951 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762d8ce0-89f7-4932-9560-2251a5f8e442 service swift] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:29:48.092438 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762d8ce0-89f7-4932-9560-2251a5f8e442 service swift] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:29:48.093024 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762d8ce0-89f7-4932-9560-2251a5f8e442 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:29:48.102280 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762d8ce0-89f7-4932-9560-2251a5f8e442 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:29:48.103978 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762d8ce0-89f7-4932-9560-2251a5f8e442 service swift] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:29:48.113810 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1204/2403] 10.222.0.44 () {60 vars in 1384 bytes} [Thu Jun 16 12:29:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 16 12:29:58.031119 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=6 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:29:58.109472 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=50 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:30:00.109778 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2404e5b7-a379-4104-8e3d-743a8daf40f9 None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:30:00.110253 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2404e5b7-a379-4104-8e3d-743a8daf40f9 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:30:00.111143 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2404e5b7-a379-4104-8e3d-743a8daf40f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:30:00.129958 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-2404e5b7-a379-4104-8e3d-743a8daf40f9 None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:30:00.131717 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-2404e5b7-a379-4104-8e3d-743a8daf40f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:30:00.139899 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1200/2404] 10.222.0.16 () {58 vars in 1016 bytes} [Thu Jun 16 12:30:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:30:00.155955 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762d8ce0-89f7-4932-9560-2251a5f8e442 service swift] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:30:00.168596 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762d8ce0-89f7-4932-9560-2251a5f8e442 service swift] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:30:00.174397 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecc77a4-0f35-42b3-a617-c2954384fbd8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edfb12d445e74136b90800e93941f468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '601361df39e34fcca71175aa94e425c4', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:30:00.175044 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecc77a4-0f35-42b3-a617-c2954384fbd8 service nova] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:30:00.175325 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecc77a4-0f35-42b3-a617-c2954384fbd8 service nova] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:30:00.175597 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecc77a4-0f35-42b3-a617-c2954384fbd8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:30:00.184206 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecc77a4-0f35-42b3-a617-c2954384fbd8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:30:00.185879 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecc77a4-0f35-42b3-a617-c2954384fbd8 service nova] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:30:00.196054 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1205/2405] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 12:30:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 12:30:01.252622 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efefd87a-977e-4949-854e-f17ac7af4f8b None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:30:01.253166 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efefd87a-977e-4949-854e-f17ac7af4f8b None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:30:01.253275 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efefd87a-977e-4949-854e-f17ac7af4f8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:30:01.296053 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-efefd87a-977e-4949-854e-f17ac7af4f8b None None] MFA Rules not processed for user `222b53cae3d64412b9b0a89d162311f4`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:30:01.297396 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-efefd87a-977e-4949-854e-f17ac7af4f8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:30:01.311830 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1201/2406] 10.222.0.44 () {58 vars in 967 bytes} [Thu Jun 16 12:30:01 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:30:01.325142 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecc77a4-0f35-42b3-a617-c2954384fbd8 service nova] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:30:01.343001 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecc77a4-0f35-42b3-a617-c2954384fbd8 service nova] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:30:01.361368 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665dab63-9888-4266-b3e1-308c1a677379 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c159f79c1921496487101aac5d530ae5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '601361df39e34fcca71175aa94e425c4', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:30:01.362232 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665dab63-9888-4266-b3e1-308c1a677379 service swift] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:30:01.362580 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665dab63-9888-4266-b3e1-308c1a677379 service swift] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:30:01.362921 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665dab63-9888-4266-b3e1-308c1a677379 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:30:01.374775 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665dab63-9888-4266-b3e1-308c1a677379 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:30:01.382133 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665dab63-9888-4266-b3e1-308c1a677379 service swift] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:30:01.399984 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1206/2407] 10.222.0.44 () {60 vars in 1384 bytes} [Thu Jun 16 12:30:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 16 12:30:02.886621 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efefd87a-977e-4949-854e-f17ac7af4f8b None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:30:02.888025 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-efefd87a-977e-4949-854e-f17ac7af4f8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:30:02.980617 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efefd87a-977e-4949-854e-f17ac7af4f8b None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:30:02.985790 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1185b41e-e95c-475f-9b77-04b223e0f781 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8bff8ccf460a403d993c39327bbcbd29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '601361df39e34fcca71175aa94e425c4', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:30:02.986370 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1185b41e-e95c-475f-9b77-04b223e0f781 service placement] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:30:02.986649 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1185b41e-e95c-475f-9b77-04b223e0f781 service placement] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:30:02.986957 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1185b41e-e95c-475f-9b77-04b223e0f781 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:30:02.989027 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-1185b41e-e95c-475f-9b77-04b223e0f781 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:30:03.002280 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1185b41e-e95c-475f-9b77-04b223e0f781 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:30:03.004219 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1185b41e-e95c-475f-9b77-04b223e0f781 service placement] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:30:03.015014 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1202/2408] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 12:30:02 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 12:30:04.295232 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447d67b4-31fb-44a5-99c7-4f83d8a7ba24 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:30:04.295740 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447d67b4-31fb-44a5-99c7-4f83d8a7ba24 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:30:04.295853 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447d67b4-31fb-44a5-99c7-4f83d8a7ba24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:30:04.313835 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-447d67b4-31fb-44a5-99c7-4f83d8a7ba24 None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:30:04.315047 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-447d67b4-31fb-44a5-99c7-4f83d8a7ba24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:30:04.323001 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1207/2409] 10.222.0.16 () {58 vars in 1016 bytes} [Thu Jun 16 12:30:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:30:04.338119 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1185b41e-e95c-475f-9b77-04b223e0f781 service placement] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:30:04.358441 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1185b41e-e95c-475f-9b77-04b223e0f781 service placement] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:30:04.365192 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52e6412-94ee-4eb5-923b-bfb674ce9284 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edfb12d445e74136b90800e93941f468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '601361df39e34fcca71175aa94e425c4', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:30:04.365843 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52e6412-94ee-4eb5-923b-bfb674ce9284 service nova] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:30:04.366294 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52e6412-94ee-4eb5-923b-bfb674ce9284 service nova] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:30:04.366566 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52e6412-94ee-4eb5-923b-bfb674ce9284 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:30:04.375851 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52e6412-94ee-4eb5-923b-bfb674ce9284 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:30:04.378211 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52e6412-94ee-4eb5-923b-bfb674ce9284 service nova] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:30:04.388673 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1203/2410] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 12:30:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 12:30:07.468462 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856bf4fa-b213-4ee4-b98d-8d197a0a55d6 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:30:07.469015 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856bf4fa-b213-4ee4-b98d-8d197a0a55d6 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:30:07.469121 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856bf4fa-b213-4ee4-b98d-8d197a0a55d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:30:07.493322 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-856bf4fa-b213-4ee4-b98d-8d197a0a55d6 None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:30:07.494510 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-856bf4fa-b213-4ee4-b98d-8d197a0a55d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:30:07.506378 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1208/2411] 10.222.0.16 () {58 vars in 1016 bytes} [Thu Jun 16 12:30:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:30:07.529683 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52e6412-94ee-4eb5-923b-bfb674ce9284 service nova] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:30:07.531037 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-e52e6412-94ee-4eb5-923b-bfb674ce9284 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:30:07.546563 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52e6412-94ee-4eb5-923b-bfb674ce9284 service nova] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:30:07.551884 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15763b74-bf8c-42b0-878d-1d8a22acbbc0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edfb12d445e74136b90800e93941f468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '601361df39e34fcca71175aa94e425c4', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:30:07.553211 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15763b74-bf8c-42b0-878d-1d8a22acbbc0 service nova] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:30:07.553488 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15763b74-bf8c-42b0-878d-1d8a22acbbc0 service nova] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:30:07.553759 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15763b74-bf8c-42b0-878d-1d8a22acbbc0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:30:07.561898 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15763b74-bf8c-42b0-878d-1d8a22acbbc0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:30:07.563476 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15763b74-bf8c-42b0-878d-1d8a22acbbc0 service nova] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:30:07.572935 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1204/2412] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 12:30:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 12:30:17.483606 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=18 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:30:17.568675 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=59 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:30:22.034353 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856bf4fa-b213-4ee4-b98d-8d197a0a55d6 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:30:22.044499 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856bf4fa-b213-4ee4-b98d-8d197a0a55d6 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:30:22.048108 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df7ed30-0659-42db-b2b2-887ec6ec2224 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1094729b25a4be7b0b394998c9ca681', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '601361df39e34fcca71175aa94e425c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:30:22.048740 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df7ed30-0659-42db-b2b2-887ec6ec2224 service neutron] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:30:22.049058 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df7ed30-0659-42db-b2b2-887ec6ec2224 service neutron] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:30:22.049350 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df7ed30-0659-42db-b2b2-887ec6ec2224 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:30:22.058609 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df7ed30-0659-42db-b2b2-887ec6ec2224 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:30:22.060046 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df7ed30-0659-42db-b2b2-887ec6ec2224 service neutron] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:30:22.069404 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1209/2413] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 12:30:22 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 12:30:23.201460 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5315aea-e6e4-417d-bc29-94b7917ff669 None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:30:23.201980 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5315aea-e6e4-417d-bc29-94b7917ff669 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:30:23.202166 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5315aea-e6e4-417d-bc29-94b7917ff669 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:30:23.219604 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-c5315aea-e6e4-417d-bc29-94b7917ff669 None None] MFA Rules not processed for user `93da8714f87144e6a75e3bd076ebeab6`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:30:23.221082 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-c5315aea-e6e4-417d-bc29-94b7917ff669 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:30:23.278431 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1205/2414] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 12:30:23 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:30:32.065213 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=6 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:30:33.271086 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=25 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:30:38.951873 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df7ed30-0659-42db-b2b2-887ec6ec2224 service neutron] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:30:38.953375 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-4df7ed30-0659-42db-b2b2-887ec6ec2224 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:30:38.970111 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df7ed30-0659-42db-b2b2-887ec6ec2224 service neutron] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:30:38.974695 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b569443-1858-4c92-8d45-313ab2533ae8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:30:38.975554 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b569443-1858-4c92-8d45-313ab2533ae8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:30:38.975825 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b569443-1858-4c92-8d45-313ab2533ae8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:30:38.976090 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b569443-1858-4c92-8d45-313ab2533ae8 admin admin] PATH_INFO: `/v3/users/fc4d60019f15420898e9e5c3a527a0f6` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:30:38.977340 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b569443-1858-4c92-8d45-313ab2533ae8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fc4d60019f15420898e9e5c3a527a0f6)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:30:38.979252 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b569443-1858-4c92-8d45-313ab2533ae8 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:30:39.023499 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-9b569443-1858-4c92-8d45-313ab2533ae8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fc4d60019f15420898e9e5c3a527a0f6'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:30:39.024629 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-9b569443-1858-4c92-8d45-313ab2533ae8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fc4d60019f15420898e9e5c3a527a0f6'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:30:39.031798 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-9b569443-1858-4c92-8d45-313ab2533ae8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fc4d60019f15420898e9e5c3a527a0f6'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:30:39.032421 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-9b569443-1858-4c92-8d45-313ab2533ae8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fc4d60019f15420898e9e5c3a527a0f6'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:30:39.039658 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-9b569443-1858-4c92-8d45-313ab2533ae8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fc4d60019f15420898e9e5c3a527a0f6'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:30:39.056425 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1210/2415] 10.222.0.44 () {58 vars in 1223 bytes} [Thu Jun 16 12:30:38 2022] DELETE /identity/v3/users/fc4d60019f15420898e9e5c3a527a0f6 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:30:39.225345 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5315aea-e6e4-417d-bc29-94b7917ff669 None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:30:39.236481 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5315aea-e6e4-417d-bc29-94b7917ff669 None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:30:39.292529 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5db4edc-281e-4e5b-9ed7-89947b66d019 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:30:39.293350 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5db4edc-281e-4e5b-9ed7-89947b66d019 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:30:39.293634 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5db4edc-281e-4e5b-9ed7-89947b66d019 admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:30:39.293907 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5db4edc-281e-4e5b-9ed7-89947b66d019 admin admin] PATH_INFO: `/v3/projects/c2b21e9b99fe418e83448ac975b1262c` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:30:39.295085 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5db4edc-281e-4e5b-9ed7-89947b66d019 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c2b21e9b99fe418e83448ac975b1262c)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:30:39.297014 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5db4edc-281e-4e5b-9ed7-89947b66d019 admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:30:39.342589 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-f5db4edc-281e-4e5b-9ed7-89947b66d019 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c2b21e9b99fe418e83448ac975b1262c', 'request_id': 'req-f5db4edc-281e-4e5b-9ed7-89947b66d019'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:30:39.349221 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-f5db4edc-281e-4e5b-9ed7-89947b66d019 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c2b21e9b99fe418e83448ac975b1262c', 'request_id': 'req-f5db4edc-281e-4e5b-9ed7-89947b66d019'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:30:39.354856 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-f5db4edc-281e-4e5b-9ed7-89947b66d019 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c2b21e9b99fe418e83448ac975b1262c', 'request_id': 'req-f5db4edc-281e-4e5b-9ed7-89947b66d019'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:30:39.365463 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-f5db4edc-281e-4e5b-9ed7-89947b66d019 admin admin] The token cache is being invalidate because project c2b21e9b99fe418e83448ac975b1262c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 12:30:39.365744 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-f5db4edc-281e-4e5b-9ed7-89947b66d019 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:30:39.366362 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-f5db4edc-281e-4e5b-9ed7-89947b66d019 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:30:39.368423 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1206/2416] 10.222.0.44 () {58 vars in 1232 bytes} [Thu Jun 16 12:30:39 2022] DELETE /identity/v3/projects/c2b21e9b99fe418e83448ac975b1262c => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:30:39.373327 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe9c698-5a0d-484b-90ac-3a69093d8baf None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:30:39.373611 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe9c698-5a0d-484b-90ac-3a69093d8baf None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:30:39.373886 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe9c698-5a0d-484b-90ac-3a69093d8baf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:30:39.392208 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-7fe9c698-5a0d-484b-90ac-3a69093d8baf None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:30:39.393430 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-7fe9c698-5a0d-484b-90ac-3a69093d8baf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:30:39.455958 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1211/2417] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 12:30:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:30:39.463627 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b58bfdf-68b1-4b23-866b-d9ef9021e78d None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:30:39.463912 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b58bfdf-68b1-4b23-866b-d9ef9021e78d None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:30:39.464185 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b58bfdf-68b1-4b23-866b-d9ef9021e78d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:30:39.482106 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-4b58bfdf-68b1-4b23-866b-d9ef9021e78d None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:30:39.483310 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-4b58bfdf-68b1-4b23-866b-d9ef9021e78d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:30:39.491153 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1207/2418] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 12:30:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:30:39.495557 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe9c698-5a0d-484b-90ac-3a69093d8baf None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:30:39.505299 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe9c698-5a0d-484b-90ac-3a69093d8baf None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:30:39.510533 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1072aeb4-24c8-44a6-90c2-54bbe80f05ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:30:39.511179 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1072aeb4-24c8-44a6-90c2-54bbe80f05ce admin admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:30:39.511454 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1072aeb4-24c8-44a6-90c2-54bbe80f05ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:30:39.511724 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1072aeb4-24c8-44a6-90c2-54bbe80f05ce admin admin] PATH_INFO: `/v3/domains` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:30:39.512471 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1072aeb4-24c8-44a6-90c2-54bbe80f05ce admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:30:39.512798 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1072aeb4-24c8-44a6-90c2-54bbe80f05ce admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:30:39.514401 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1072aeb4-24c8-44a6-90c2-54bbe80f05ce admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:30:39.526242 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1212/2419] 10.222.0.44 () {58 vars in 1152 bytes} [Thu Jun 16 12:30:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:30:39.530688 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b58bfdf-68b1-4b23-866b-d9ef9021e78d None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:30:39.539760 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b58bfdf-68b1-4b23-866b-d9ef9021e78d None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:30:39.544357 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1403442-0bb8-4a9e-a914-27bf4c70fdf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:30:39.544969 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1403442-0bb8-4a9e-a914-27bf4c70fdf2 admin admin] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:30:39.545246 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1403442-0bb8-4a9e-a914-27bf4c70fdf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:30:39.545514 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1403442-0bb8-4a9e-a914-27bf4c70fdf2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:30:39.546188 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1403442-0bb8-4a9e-a914-27bf4c70fdf2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:30:39.548055 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1403442-0bb8-4a9e-a914-27bf4c70fdf2 admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:30:39.574032 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1208/2420] 10.222.0.44 () {60 vars in 1152 bytes} [Thu Jun 16 12:30:39 2022] POST /identity/v3/projects => generated 373 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 12:30:39.577367 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1072aeb4-24c8-44a6-90c2-54bbe80f05ce admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:30:39.588350 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1072aeb4-24c8-44a6-90c2-54bbe80f05ce admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:30:39.643723 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3b01c9-f445-499b-be51-7a95423d1b69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:30:39.644381 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3b01c9-f445-499b-be51-7a95423d1b69 admin admin] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:30:39.644663 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3b01c9-f445-499b-be51-7a95423d1b69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:30:39.644971 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3b01c9-f445-499b-be51-7a95423d1b69 admin admin] PATH_INFO: `/v3/users` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:30:39.645667 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3b01c9-f445-499b-be51-7a95423d1b69 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:30:39.647594 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3b01c9-f445-499b-be51-7a95423d1b69 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:30:39.654641 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:30:39.669176 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1213/2421] 10.222.0.44 () {60 vars in 1143 bytes} [Thu Jun 16 12:30:39 2022] POST /identity/v3/users => generated 287 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 12:30:39.672871 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1403442-0bb8-4a9e-a914-27bf4c70fdf2 admin admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:30:39.682975 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1403442-0bb8-4a9e-a914-27bf4c70fdf2 admin admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:30:39.693489 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2166ea-27fa-448d-a1de-f1b837c5d2be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:30:39.694155 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2166ea-27fa-448d-a1de-f1b837c5d2be admin admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:30:39.694438 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2166ea-27fa-448d-a1de-f1b837c5d2be admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:30:39.694713 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2166ea-27fa-448d-a1de-f1b837c5d2be admin admin] PATH_INFO: `/v3/roles` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:30:39.696015 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2166ea-27fa-448d-a1de-f1b837c5d2be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:30:39.697690 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2166ea-27fa-448d-a1de-f1b837c5d2be admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:30:39.708083 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1209/2422] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 12:30:39 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 12:30:39.712917 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3b01c9-f445-499b-be51-7a95423d1b69 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:30:39.722924 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3b01c9-f445-499b-be51-7a95423d1b69 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:30:39.727531 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18295cc-d3b2-42e0-858b-958ff6f7e44f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:30:39.728169 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18295cc-d3b2-42e0-858b-958ff6f7e44f admin admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:30:39.728446 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18295cc-d3b2-42e0-858b-958ff6f7e44f admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:30:39.728715 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18295cc-d3b2-42e0-858b-958ff6f7e44f admin admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:30:39.729484 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18295cc-d3b2-42e0-858b-958ff6f7e44f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:30:39.731070 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18295cc-d3b2-42e0-858b-958ff6f7e44f admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:30:39.740684 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1214/2423] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 12:30:39 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 12:30:39.744803 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2166ea-27fa-448d-a1de-f1b837c5d2be admin admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:30:39.754598 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2166ea-27fa-448d-a1de-f1b837c5d2be admin admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:30:39.759681 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec51fce-2891-40c5-aed0-ec7058d55f0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:30:39.760544 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec51fce-2891-40c5-aed0-ec7058d55f0d admin admin] REQUEST_METHOD: `PUT` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:30:39.760854 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec51fce-2891-40c5-aed0-ec7058d55f0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:30:39.761132 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec51fce-2891-40c5-aed0-ec7058d55f0d admin admin] PATH_INFO: `/v3/projects/0a9ebeba3c8c4768a4416341048df6bd/users/77fd97ffc6cc45559f91dba33faaa2ec/roles/c39882b202e942479a7cdac2fc6da72c` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:30:39.776610 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec51fce-2891-40c5-aed0-ec7058d55f0d admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a9ebeba3c8c4768a4416341048df6bd, user_id=77fd97ffc6cc45559f91dba33faaa2ec, role_id=c39882b202e942479a7cdac2fc6da72c)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:30:39.779282 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec51fce-2891-40c5-aed0-ec7058d55f0d admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:30:39.794281 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1210/2424] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 16 12:30:39 2022] PUT /identity/v3/projects/0a9ebeba3c8c4768a4416341048df6bd/users/77fd97ffc6cc45559f91dba33faaa2ec/roles/c39882b202e942479a7cdac2fc6da72c => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:30:39.799348 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9567b7-bece-46eb-aacb-4467c446a22a None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:30:39.799592 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9567b7-bece-46eb-aacb-4467c446a22a None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:30:39.799881 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9567b7-bece-46eb-aacb-4467c446a22a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:30:39.819113 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-7a9567b7-bece-46eb-aacb-4467c446a22a None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:30:39.820906 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-7a9567b7-bece-46eb-aacb-4467c446a22a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:30:39.878416 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1215/2425] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 12:30:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 12:30:39.888274 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec51fce-2891-40c5-aed0-ec7058d55f0d admin admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:30:39.889969 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-5ec51fce-2891-40c5-aed0-ec7058d55f0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:30:39.921481 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:30:39.949919 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec51fce-2891-40c5-aed0-ec7058d55f0d admin admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:30:39.953863 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cd548a-0ad5-4fe3-9212-4619cba67bd4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1094729b25a4be7b0b394998c9ca681', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '601361df39e34fcca71175aa94e425c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:30:39.954511 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cd548a-0ad5-4fe3-9212-4619cba67bd4 service neutron] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:30:39.954793 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cd548a-0ad5-4fe3-9212-4619cba67bd4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:30:39.955071 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cd548a-0ad5-4fe3-9212-4619cba67bd4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:30:39.964033 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cd548a-0ad5-4fe3-9212-4619cba67bd4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:30:39.965491 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cd548a-0ad5-4fe3-9212-4619cba67bd4 service neutron] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:30:39.975143 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1211/2426] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 12:30:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 12:30:44.144289 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b77d8b-6c5b-4bd1-a2eb-96dc3c042d39 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:30:44.144708 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b77d8b-6c5b-4bd1-a2eb-96dc3c042d39 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:30:44.144875 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b77d8b-6c5b-4bd1-a2eb-96dc3c042d39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:30:44.175753 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-17b77d8b-6c5b-4bd1-a2eb-96dc3c042d39 None None] MFA Rules not processed for user `77fd97ffc6cc45559f91dba33faaa2ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:30:44.177116 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-17b77d8b-6c5b-4bd1-a2eb-96dc3c042d39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:30:44.243859 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1216/2427] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 12:30:44 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:30:44.248661 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cd548a-0ad5-4fe3-9212-4619cba67bd4 service neutron] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:30:44.258769 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cd548a-0ad5-4fe3-9212-4619cba67bd4 service neutron] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:30:44.263332 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26be841b-1bfe-4b06-9214-ef5fbd600eea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:30:44.263983 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26be841b-1bfe-4b06-9214-ef5fbd600eea admin admin] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:30:44.264261 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26be841b-1bfe-4b06-9214-ef5fbd600eea admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:30:44.264531 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26be841b-1bfe-4b06-9214-ef5fbd600eea admin admin] PATH_INFO: `/v3/projects` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:30:44.265296 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26be841b-1bfe-4b06-9214-ef5fbd600eea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:30:44.267219 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26be841b-1bfe-4b06-9214-ef5fbd600eea admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:30:44.296033 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1212/2428] 10.222.0.44 () {60 vars in 1152 bytes} [Thu Jun 16 12:30:44 2022] POST /identity/v3/projects => generated 373 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 12:30:44.300403 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b77d8b-6c5b-4bd1-a2eb-96dc3c042d39 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:30:44.312229 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b77d8b-6c5b-4bd1-a2eb-96dc3c042d39 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:30:44.370383 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ef44f6-279a-4310-936c-88cb6247b93a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:30:44.371084 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ef44f6-279a-4310-936c-88cb6247b93a admin admin] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:30:44.371363 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ef44f6-279a-4310-936c-88cb6247b93a admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:30:44.371643 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ef44f6-279a-4310-936c-88cb6247b93a admin admin] PATH_INFO: `/v3/users` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:30:44.372330 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ef44f6-279a-4310-936c-88cb6247b93a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:30:44.374371 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ef44f6-279a-4310-936c-88cb6247b93a admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:30:44.389172 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:30:44.396549 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1217/2429] 10.222.0.44 () {60 vars in 1143 bytes} [Thu Jun 16 12:30:44 2022] POST /identity/v3/users => generated 293 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 12:30:44.400110 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26be841b-1bfe-4b06-9214-ef5fbd600eea admin admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:30:44.410639 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26be841b-1bfe-4b06-9214-ef5fbd600eea admin admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:30:44.415646 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8c7c96-78c0-4ede-8741-562b5214b409 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:30:44.416298 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8c7c96-78c0-4ede-8741-562b5214b409 admin admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:30:44.416581 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8c7c96-78c0-4ede-8741-562b5214b409 admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:30:44.416900 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8c7c96-78c0-4ede-8741-562b5214b409 admin admin] PATH_INFO: `/v3/roles` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:30:44.417621 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8c7c96-78c0-4ede-8741-562b5214b409 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:30:44.419202 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8c7c96-78c0-4ede-8741-562b5214b409 admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:30:44.430229 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1213/2430] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 12:30:44 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 12:30:44.434221 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ef44f6-279a-4310-936c-88cb6247b93a admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:30:44.444188 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ef44f6-279a-4310-936c-88cb6247b93a admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:30:44.448724 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4e23f1-7a86-4f93-9e7d-d2406ba77252 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:30:44.449632 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4e23f1-7a86-4f93-9e7d-d2406ba77252 admin admin] REQUEST_METHOD: `PUT` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:30:44.449911 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4e23f1-7a86-4f93-9e7d-d2406ba77252 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:30:44.450187 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4e23f1-7a86-4f93-9e7d-d2406ba77252 admin admin] PATH_INFO: `/v3/projects/865c7f1b06fc46659df1acaed3558323/users/aa0b42487302484688616aec57ada2be/roles/0688968254744e3f9913653cafea3091` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:30:44.464324 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4e23f1-7a86-4f93-9e7d-d2406ba77252 admin admin] RBAC: Authorizing `identity:create_grant(project_id=865c7f1b06fc46659df1acaed3558323, user_id=aa0b42487302484688616aec57ada2be, role_id=0688968254744e3f9913653cafea3091)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:30:44.467015 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4e23f1-7a86-4f93-9e7d-d2406ba77252 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:30:44.480065 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1218/2431] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 16 12:30:44 2022] PUT /identity/v3/projects/865c7f1b06fc46659df1acaed3558323/users/aa0b42487302484688616aec57ada2be/roles/0688968254744e3f9913653cafea3091 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:30:44.484111 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8c7c96-78c0-4ede-8741-562b5214b409 admin admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:30:44.494828 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8c7c96-78c0-4ede-8741-562b5214b409 admin admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:30:44.554535 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd5a3f4-618e-4114-8013-d0ed25546322 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:30:44.555255 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd5a3f4-618e-4114-8013-d0ed25546322 admin admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:30:44.555479 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd5a3f4-618e-4114-8013-d0ed25546322 admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:30:44.555758 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd5a3f4-618e-4114-8013-d0ed25546322 admin admin] PATH_INFO: `/v3/roles` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:30:44.556542 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd5a3f4-618e-4114-8013-d0ed25546322 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:30:44.558214 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd5a3f4-618e-4114-8013-d0ed25546322 admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:30:44.567987 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1214/2432] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 12:30:44 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 12:30:44.572788 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4e23f1-7a86-4f93-9e7d-d2406ba77252 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:30:44.583471 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4e23f1-7a86-4f93-9e7d-d2406ba77252 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:30:44.588696 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41234130-176c-437e-b722-c69c1c379f21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:30:44.590131 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41234130-176c-437e-b722-c69c1c379f21 admin admin] REQUEST_METHOD: `PUT` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:30:44.590131 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41234130-176c-437e-b722-c69c1c379f21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:30:44.590131 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41234130-176c-437e-b722-c69c1c379f21 admin admin] PATH_INFO: `/v3/projects/865c7f1b06fc46659df1acaed3558323/users/aa0b42487302484688616aec57ada2be/roles/0688968254744e3f9913653cafea3091` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:30:44.592173 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41234130-176c-437e-b722-c69c1c379f21 admin admin] RBAC: Authorizing `identity:create_grant(project_id=865c7f1b06fc46659df1acaed3558323, user_id=aa0b42487302484688616aec57ada2be, role_id=0688968254744e3f9913653cafea3091)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:30:44.594870 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41234130-176c-437e-b722-c69c1c379f21 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:30:44.606635 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1219/2433] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 16 12:30:44 2022] PUT /identity/v3/projects/865c7f1b06fc46659df1acaed3558323/users/aa0b42487302484688616aec57ada2be/roles/0688968254744e3f9913653cafea3091 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:30:51.456385 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2ecbd3-398c-4852-bf51-49e7835ebabe None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:30:51.458077 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2ecbd3-398c-4852-bf51-49e7835ebabe None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:30:51.458996 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2ecbd3-398c-4852-bf51-49e7835ebabe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:30:51.504795 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-9d2ecbd3-398c-4852-bf51-49e7835ebabe None None] MFA Rules not processed for user `aa0b42487302484688616aec57ada2be`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:30:51.507148 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-9d2ecbd3-398c-4852-bf51-49e7835ebabe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:30:51.672505 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1215/2434] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 12:30:51 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:30:51.679864 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41234130-176c-437e-b722-c69c1c379f21 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:30:51.681703 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-41234130-176c-437e-b722-c69c1c379f21 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:30:51.805907 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41234130-176c-437e-b722-c69c1c379f21 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:30:51.813451 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9d63f4-2f02-436a-b836-84c92063ab7c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edfb12d445e74136b90800e93941f468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '601361df39e34fcca71175aa94e425c4', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:30:51.815277 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9d63f4-2f02-436a-b836-84c92063ab7c service nova] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:30:51.815563 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9d63f4-2f02-436a-b836-84c92063ab7c service nova] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:30:51.815838 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9d63f4-2f02-436a-b836-84c92063ab7c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:30:51.891576 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9d63f4-2f02-436a-b836-84c92063ab7c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:30:51.893537 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9d63f4-2f02-436a-b836-84c92063ab7c service nova] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:30:51.906936 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1220/2435] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 12:30:51 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 12:30:53.689471 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8010422-dd64-4d88-9487-8144ef88216b None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:30:53.689964 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8010422-dd64-4d88-9487-8144ef88216b None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:30:53.690137 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8010422-dd64-4d88-9487-8144ef88216b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:30:53.719388 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-d8010422-dd64-4d88-9487-8144ef88216b None None] MFA Rules not processed for user `77fd97ffc6cc45559f91dba33faaa2ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:30:53.720649 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-d8010422-dd64-4d88-9487-8144ef88216b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:30:53.730221 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1216/2436] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 12:30:53 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:30:55.316370 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681eb659-40a6-4443-bcb2-0faf7b882e2e None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:30:55.316909 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681eb659-40a6-4443-bcb2-0faf7b882e2e None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:30:55.317167 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681eb659-40a6-4443-bcb2-0faf7b882e2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:30:55.339779 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-681eb659-40a6-4443-bcb2-0faf7b882e2e None None] MFA Rules not processed for user `dcb0b632b30649609216933c50f287b9`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:30:55.341189 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-681eb659-40a6-4443-bcb2-0faf7b882e2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:30:55.406046 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1221/2437] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 12:30:55 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:31:03.704544 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=94,keystone:INSERT=1 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:31:05.394976 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=97,keystone:INSERT=2 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:31:25.283790 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8010422-dd64-4d88-9487-8144ef88216b None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:31:25.353501 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8010422-dd64-4d88-9487-8144ef88216b None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:31:25.357048 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a57af2-154e-4329-b014-e89ceec64841 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1094729b25a4be7b0b394998c9ca681', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '601361df39e34fcca71175aa94e425c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:31:25.357704 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a57af2-154e-4329-b014-e89ceec64841 service neutron] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:31:25.357983 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a57af2-154e-4329-b014-e89ceec64841 service neutron] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:31:25.358252 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a57af2-154e-4329-b014-e89ceec64841 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:31:25.370577 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a57af2-154e-4329-b014-e89ceec64841 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:31:25.372192 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a57af2-154e-4329-b014-e89ceec64841 service neutron] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:31:25.384921 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1217/2438] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 12:31:25 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 12:31:35.087354 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681eb659-40a6-4443-bcb2-0faf7b882e2e None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:31:35.088848 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-681eb659-40a6-4443-bcb2-0faf7b882e2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:31:35.152033 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681eb659-40a6-4443-bcb2-0faf7b882e2e None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:31:35.156779 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044bcac7-596c-4684-aa26-3bedb22aabbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:31:35.157645 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044bcac7-596c-4684-aa26-3bedb22aabbf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:31:35.157920 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044bcac7-596c-4684-aa26-3bedb22aabbf admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:31:35.158189 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044bcac7-596c-4684-aa26-3bedb22aabbf admin admin] PATH_INFO: `/v3/users/93da8714f87144e6a75e3bd076ebeab6` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:31:35.159355 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044bcac7-596c-4684-aa26-3bedb22aabbf admin admin] RBAC: Authorizing `identity:delete_user(user_id=93da8714f87144e6a75e3bd076ebeab6)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:31:35.161300 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044bcac7-596c-4684-aa26-3bedb22aabbf admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:31:35.205841 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-044bcac7-596c-4684-aa26-3bedb22aabbf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '93da8714f87144e6a75e3bd076ebeab6'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:31:35.206535 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-044bcac7-596c-4684-aa26-3bedb22aabbf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '93da8714f87144e6a75e3bd076ebeab6'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:31:35.214270 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-044bcac7-596c-4684-aa26-3bedb22aabbf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '93da8714f87144e6a75e3bd076ebeab6'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:31:35.214902 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-044bcac7-596c-4684-aa26-3bedb22aabbf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '93da8714f87144e6a75e3bd076ebeab6'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:31:35.223066 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-044bcac7-596c-4684-aa26-3bedb22aabbf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '93da8714f87144e6a75e3bd076ebeab6'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:31:35.240035 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1222/2439] 10.222.0.44 () {58 vars in 1223 bytes} [Thu Jun 16 12:31:35 2022] DELETE /identity/v3/users/93da8714f87144e6a75e3bd076ebeab6 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:31:35.379512 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=26 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:31:35.414597 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a57af2-154e-4329-b014-e89ceec64841 service neutron] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:31:35.425709 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a57af2-154e-4329-b014-e89ceec64841 service neutron] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:31:35.487152 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bcc472-a976-457b-87f2-f6ddc4322be0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:31:35.488020 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bcc472-a976-457b-87f2-f6ddc4322be0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:31:35.488304 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bcc472-a976-457b-87f2-f6ddc4322be0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:31:35.488588 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bcc472-a976-457b-87f2-f6ddc4322be0 admin admin] PATH_INFO: `/v3/projects/fc803b34925d4a9aa0c3f92780976def` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:31:35.489805 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bcc472-a976-457b-87f2-f6ddc4322be0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fc803b34925d4a9aa0c3f92780976def)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:31:35.491707 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bcc472-a976-457b-87f2-f6ddc4322be0 admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:31:35.536172 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-b0bcc472-a976-457b-87f2-f6ddc4322be0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fc803b34925d4a9aa0c3f92780976def', 'request_id': 'req-b0bcc472-a976-457b-87f2-f6ddc4322be0'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:31:35.543608 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-b0bcc472-a976-457b-87f2-f6ddc4322be0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fc803b34925d4a9aa0c3f92780976def', 'request_id': 'req-b0bcc472-a976-457b-87f2-f6ddc4322be0'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:31:35.549070 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-b0bcc472-a976-457b-87f2-f6ddc4322be0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fc803b34925d4a9aa0c3f92780976def', 'request_id': 'req-b0bcc472-a976-457b-87f2-f6ddc4322be0'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:31:35.560097 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-b0bcc472-a976-457b-87f2-f6ddc4322be0 admin admin] The token cache is being invalidate because project fc803b34925d4a9aa0c3f92780976def was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 12:31:35.560383 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-b0bcc472-a976-457b-87f2-f6ddc4322be0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:31:35.561030 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-b0bcc472-a976-457b-87f2-f6ddc4322be0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:31:35.562529 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1218/2440] 10.222.0.44 () {58 vars in 1232 bytes} [Thu Jun 16 12:31:35 2022] DELETE /identity/v3/projects/fc803b34925d4a9aa0c3f92780976def => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:31:35.567556 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd10cece-5f7f-4f3f-9d2c-de708b4eae4f None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:31:35.567912 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd10cece-5f7f-4f3f-9d2c-de708b4eae4f None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:31:35.568215 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd10cece-5f7f-4f3f-9d2c-de708b4eae4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:31:35.585834 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-fd10cece-5f7f-4f3f-9d2c-de708b4eae4f None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:31:35.587031 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-fd10cece-5f7f-4f3f-9d2c-de708b4eae4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:31:35.646688 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1223/2441] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 12:31:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:31:35.654557 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7494be-d4d9-4126-b1c4-2ffb391c6408 None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:31:35.654840 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7494be-d4d9-4126-b1c4-2ffb391c6408 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:31:35.655208 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7494be-d4d9-4126-b1c4-2ffb391c6408 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:31:35.673934 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-2c7494be-d4d9-4126-b1c4-2ffb391c6408 None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:31:35.675131 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-2c7494be-d4d9-4126-b1c4-2ffb391c6408 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:31:35.682946 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1219/2442] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 12:31:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:31:35.686973 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd10cece-5f7f-4f3f-9d2c-de708b4eae4f None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:31:35.696680 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd10cece-5f7f-4f3f-9d2c-de708b4eae4f None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:31:35.701215 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3038e5-c5ee-414c-b2a2-8e414d9b1c6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:31:35.701861 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3038e5-c5ee-414c-b2a2-8e414d9b1c6f admin admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:31:35.702140 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3038e5-c5ee-414c-b2a2-8e414d9b1c6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:31:35.702414 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3038e5-c5ee-414c-b2a2-8e414d9b1c6f admin admin] PATH_INFO: `/v3/domains` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:31:35.703138 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3038e5-c5ee-414c-b2a2-8e414d9b1c6f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:31:35.703443 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3038e5-c5ee-414c-b2a2-8e414d9b1c6f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:31:35.705069 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3038e5-c5ee-414c-b2a2-8e414d9b1c6f admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:31:35.717371 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1224/2443] 10.222.0.44 () {58 vars in 1152 bytes} [Thu Jun 16 12:31:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:31:35.721519 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7494be-d4d9-4126-b1c4-2ffb391c6408 None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:31:35.731103 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7494be-d4d9-4126-b1c4-2ffb391c6408 None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:31:35.735698 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a6f58a-aa33-478c-b361-d0d3e31d7673 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:31:35.736334 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a6f58a-aa33-478c-b361-d0d3e31d7673 admin admin] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:31:35.736610 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a6f58a-aa33-478c-b361-d0d3e31d7673 admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:31:35.736923 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a6f58a-aa33-478c-b361-d0d3e31d7673 admin admin] PATH_INFO: `/v3/projects` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:31:35.737602 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a6f58a-aa33-478c-b361-d0d3e31d7673 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:31:35.739490 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a6f58a-aa33-478c-b361-d0d3e31d7673 admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:31:35.764554 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1220/2444] 10.222.0.44 () {60 vars in 1152 bytes} [Thu Jun 16 12:31:35 2022] POST /identity/v3/projects => generated 365 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 12:31:35.768662 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3038e5-c5ee-414c-b2a2-8e414d9b1c6f admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:31:35.779578 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3038e5-c5ee-414c-b2a2-8e414d9b1c6f admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:31:35.783140 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:31:35.838468 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371c8e45-cc3e-4aca-bda8-902b1893f0e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:31:35.839125 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371c8e45-cc3e-4aca-bda8-902b1893f0e1 admin admin] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:31:35.839402 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371c8e45-cc3e-4aca-bda8-902b1893f0e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:31:35.839672 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371c8e45-cc3e-4aca-bda8-902b1893f0e1 admin admin] PATH_INFO: `/v3/users` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:31:35.840345 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371c8e45-cc3e-4aca-bda8-902b1893f0e1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:31:35.842293 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371c8e45-cc3e-4aca-bda8-902b1893f0e1 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:31:35.861129 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1225/2445] 10.222.0.44 () {60 vars in 1143 bytes} [Thu Jun 16 12:31:35 2022] POST /identity/v3/users => generated 283 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 12:31:35.865209 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a6f58a-aa33-478c-b361-d0d3e31d7673 admin admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:31:35.876300 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a6f58a-aa33-478c-b361-d0d3e31d7673 admin admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:31:35.881829 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8e42ae-7bb2-4ca7-a48d-92cb482ba3b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:31:35.882533 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8e42ae-7bb2-4ca7-a48d-92cb482ba3b3 admin admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:31:35.882854 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8e42ae-7bb2-4ca7-a48d-92cb482ba3b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:31:35.883189 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8e42ae-7bb2-4ca7-a48d-92cb482ba3b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:31:35.884106 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8e42ae-7bb2-4ca7-a48d-92cb482ba3b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:31:35.885827 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8e42ae-7bb2-4ca7-a48d-92cb482ba3b3 admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:31:35.896974 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1221/2446] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 12:31:35 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 12:31:35.900917 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371c8e45-cc3e-4aca-bda8-902b1893f0e1 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:31:35.911189 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371c8e45-cc3e-4aca-bda8-902b1893f0e1 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:31:35.916334 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86422ed6-fc65-4c84-ac58-29cecf6b68a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:31:35.917036 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86422ed6-fc65-4c84-ac58-29cecf6b68a4 admin admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:31:35.917310 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86422ed6-fc65-4c84-ac58-29cecf6b68a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:31:35.917580 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86422ed6-fc65-4c84-ac58-29cecf6b68a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:31:35.918331 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86422ed6-fc65-4c84-ac58-29cecf6b68a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:31:35.919940 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86422ed6-fc65-4c84-ac58-29cecf6b68a4 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:31:35.930254 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1226/2447] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 12:31:35 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 12:31:35.934532 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8e42ae-7bb2-4ca7-a48d-92cb482ba3b3 admin admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:31:35.945043 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8e42ae-7bb2-4ca7-a48d-92cb482ba3b3 admin admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:31:35.949608 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32110630-adf0-4a51-acfe-a8814ae09e18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:31:35.950481 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32110630-adf0-4a51-acfe-a8814ae09e18 admin admin] REQUEST_METHOD: `PUT` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:31:35.950763 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32110630-adf0-4a51-acfe-a8814ae09e18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:31:35.951038 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32110630-adf0-4a51-acfe-a8814ae09e18 admin admin] PATH_INFO: `/v3/projects/880840d180184125b4a570fdb3508dc3/users/39acc90641054d2680c0272af52c9b15/roles/c39882b202e942479a7cdac2fc6da72c` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:31:35.967156 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32110630-adf0-4a51-acfe-a8814ae09e18 admin admin] RBAC: Authorizing `identity:create_grant(project_id=880840d180184125b4a570fdb3508dc3, user_id=39acc90641054d2680c0272af52c9b15, role_id=c39882b202e942479a7cdac2fc6da72c)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:31:35.969852 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32110630-adf0-4a51-acfe-a8814ae09e18 admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:31:35.983247 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1222/2448] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 16 12:31:35 2022] PUT /identity/v3/projects/880840d180184125b4a570fdb3508dc3/users/39acc90641054d2680c0272af52c9b15/roles/c39882b202e942479a7cdac2fc6da72c => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:31:35.993270 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd738a3-67c6-41e3-8fad-37179145e30b None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:31:35.993556 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd738a3-67c6-41e3-8fad-37179145e30b None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:31:35.993833 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd738a3-67c6-41e3-8fad-37179145e30b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:31:36.020197 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-4cd738a3-67c6-41e3-8fad-37179145e30b None None] MFA Rules not processed for user `39acc90641054d2680c0272af52c9b15`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:31:36.021974 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-4cd738a3-67c6-41e3-8fad-37179145e30b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:31:36.084654 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1227/2449] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 12:31:35 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:31:36.095710 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32110630-adf0-4a51-acfe-a8814ae09e18 admin admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:31:36.097437 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-32110630-adf0-4a51-acfe-a8814ae09e18 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:31:36.127146 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:31:36.175957 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32110630-adf0-4a51-acfe-a8814ae09e18 admin admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:31:36.179827 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290bcb64-fa7a-44c3-9686-0dc2e053b718 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f96fc14ed89478c8a8c2f11c87511e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '601361df39e34fcca71175aa94e425c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:31:36.180496 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290bcb64-fa7a-44c3-9686-0dc2e053b718 service cinder] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:31:36.180802 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290bcb64-fa7a-44c3-9686-0dc2e053b718 service cinder] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:31:36.181080 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290bcb64-fa7a-44c3-9686-0dc2e053b718 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:31:36.189188 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290bcb64-fa7a-44c3-9686-0dc2e053b718 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:31:36.190609 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290bcb64-fa7a-44c3-9686-0dc2e053b718 service cinder] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:31:36.199645 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1223/2450] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 12:31:36 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 12:31:42.279638 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fb28f7-de4e-45d6-b94f-68033551745d None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:31:42.280198 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fb28f7-de4e-45d6-b94f-68033551745d None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:31:42.280198 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fb28f7-de4e-45d6-b94f-68033551745d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:31:42.297206 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-f9fb28f7-de4e-45d6-b94f-68033551745d None None] MFA Rules not processed for user `ec95d8dfa98b4d3db7edaad4e37925b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:31:42.298415 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-f9fb28f7-de4e-45d6-b94f-68033551745d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:31:42.351880 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1228/2451] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 12:31:42 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:31:44.650407 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290bcb64-fa7a-44c3-9686-0dc2e053b718 service cinder] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:31:44.727226 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290bcb64-fa7a-44c3-9686-0dc2e053b718 service cinder] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:31:44.731783 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79738e94-11e7-448e-8ef1-f2830c02d781 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:31:44.732657 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79738e94-11e7-448e-8ef1-f2830c02d781 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:31:44.732972 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79738e94-11e7-448e-8ef1-f2830c02d781 admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:31:44.733374 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79738e94-11e7-448e-8ef1-f2830c02d781 admin admin] PATH_INFO: `/v3/users/39acc90641054d2680c0272af52c9b15` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:31:44.734575 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79738e94-11e7-448e-8ef1-f2830c02d781 admin admin] RBAC: Authorizing `identity:delete_user(user_id=39acc90641054d2680c0272af52c9b15)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:31:44.736488 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79738e94-11e7-448e-8ef1-f2830c02d781 admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:31:44.784154 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-79738e94-11e7-448e-8ef1-f2830c02d781 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '39acc90641054d2680c0272af52c9b15'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:31:44.799042 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-79738e94-11e7-448e-8ef1-f2830c02d781 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '39acc90641054d2680c0272af52c9b15'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:31:44.807474 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-79738e94-11e7-448e-8ef1-f2830c02d781 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '39acc90641054d2680c0272af52c9b15'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:31:44.808384 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-79738e94-11e7-448e-8ef1-f2830c02d781 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '39acc90641054d2680c0272af52c9b15'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:31:44.809803 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-79738e94-11e7-448e-8ef1-f2830c02d781 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '39acc90641054d2680c0272af52c9b15'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:31:44.827249 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1224/2452] 10.222.0.44 () {58 vars in 1223 bytes} [Thu Jun 16 12:31:44 2022] DELETE /identity/v3/users/39acc90641054d2680c0272af52c9b15 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:31:44.831747 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796c0486-b9c7-4972-8749-6f569caf0534 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:31:44.832220 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796c0486-b9c7-4972-8749-6f569caf0534 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:31:44.832302 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796c0486-b9c7-4972-8749-6f569caf0534 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:31:44.850909 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-796c0486-b9c7-4972-8749-6f569caf0534 None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:31:44.852119 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-796c0486-b9c7-4972-8749-6f569caf0534 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:31:44.866404 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:31:44.914585 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1229/2453] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 12:31:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 12:31:44.924572 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79738e94-11e7-448e-8ef1-f2830c02d781 admin admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:31:44.926082 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-79738e94-11e7-448e-8ef1-f2830c02d781 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:31:44.959597 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:31:44.987419 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79738e94-11e7-448e-8ef1-f2830c02d781 admin admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:31:44.991604 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ce443a-1476-4869-a140-03231a6595a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1094729b25a4be7b0b394998c9ca681', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '601361df39e34fcca71175aa94e425c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:31:44.992247 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ce443a-1476-4869-a140-03231a6595a1 service neutron] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:31:44.992526 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ce443a-1476-4869-a140-03231a6595a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:31:44.992826 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ce443a-1476-4869-a140-03231a6595a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:31:45.001905 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ce443a-1476-4869-a140-03231a6595a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:31:45.003330 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ce443a-1476-4869-a140-03231a6595a1 service neutron] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:31:45.014642 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1225/2454] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 12:31:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 12:31:45.440606 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796c0486-b9c7-4972-8749-6f569caf0534 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:31:45.442205 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-796c0486-b9c7-4972-8749-6f569caf0534 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:31:45.455372 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796c0486-b9c7-4972-8749-6f569caf0534 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:31:45.461082 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503a056a-9b28-4114-a892-28ddacdbe3c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:31:45.462193 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503a056a-9b28-4114-a892-28ddacdbe3c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:31:45.462841 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503a056a-9b28-4114-a892-28ddacdbe3c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:31:45.463338 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503a056a-9b28-4114-a892-28ddacdbe3c6 admin admin] PATH_INFO: `/v3/projects/880840d180184125b4a570fdb3508dc3` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:31:45.464692 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503a056a-9b28-4114-a892-28ddacdbe3c6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=880840d180184125b4a570fdb3508dc3)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:31:45.466731 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503a056a-9b28-4114-a892-28ddacdbe3c6 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:31:45.526122 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-503a056a-9b28-4114-a892-28ddacdbe3c6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '880840d180184125b4a570fdb3508dc3', 'request_id': 'req-503a056a-9b28-4114-a892-28ddacdbe3c6'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:31:45.533459 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-503a056a-9b28-4114-a892-28ddacdbe3c6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '880840d180184125b4a570fdb3508dc3', 'request_id': 'req-503a056a-9b28-4114-a892-28ddacdbe3c6'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:31:45.541141 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-503a056a-9b28-4114-a892-28ddacdbe3c6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '880840d180184125b4a570fdb3508dc3', 'request_id': 'req-503a056a-9b28-4114-a892-28ddacdbe3c6'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:31:45.551928 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-503a056a-9b28-4114-a892-28ddacdbe3c6 admin admin] The token cache is being invalidate because project 880840d180184125b4a570fdb3508dc3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 12:31:45.552206 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-503a056a-9b28-4114-a892-28ddacdbe3c6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:31:45.552887 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-503a056a-9b28-4114-a892-28ddacdbe3c6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:31:45.554425 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1230/2455] 10.222.0.44 () {58 vars in 1232 bytes} [Thu Jun 16 12:31:45 2022] DELETE /identity/v3/projects/880840d180184125b4a570fdb3508dc3 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:31:45.559326 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefaa7c7-3bda-423f-8169-7971f30a9daf None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:31:45.559952 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefaa7c7-3bda-423f-8169-7971f30a9daf None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:31:45.559952 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefaa7c7-3bda-423f-8169-7971f30a9daf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:31:45.585380 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-cefaa7c7-3bda-423f-8169-7971f30a9daf None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:31:45.587546 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-cefaa7c7-3bda-423f-8169-7971f30a9daf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:31:45.650662 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1226/2456] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 12:31:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:31:45.659925 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a090b98-7992-4c07-8a5a-f2bfbc328816 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:31:45.660210 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a090b98-7992-4c07-8a5a-f2bfbc328816 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:31:45.660502 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a090b98-7992-4c07-8a5a-f2bfbc328816 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:31:45.678477 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-3a090b98-7992-4c07-8a5a-f2bfbc328816 None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:31:45.679692 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-3a090b98-7992-4c07-8a5a-f2bfbc328816 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:31:45.689871 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1231/2457] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 12:31:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:31:45.694691 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefaa7c7-3bda-423f-8169-7971f30a9daf None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:31:45.704481 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefaa7c7-3bda-423f-8169-7971f30a9daf None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:31:45.709751 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbc860a-9774-46f4-a168-9764d6049de4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:31:45.710413 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbc860a-9774-46f4-a168-9764d6049de4 admin admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:31:45.710696 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbc860a-9774-46f4-a168-9764d6049de4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:31:45.710971 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbc860a-9774-46f4-a168-9764d6049de4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:31:45.711697 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbc860a-9774-46f4-a168-9764d6049de4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:31:45.712004 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbc860a-9774-46f4-a168-9764d6049de4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:31:45.713674 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbc860a-9774-46f4-a168-9764d6049de4 admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:31:45.725577 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1227/2458] 10.222.0.44 () {58 vars in 1152 bytes} [Thu Jun 16 12:31:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:31:45.729910 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a090b98-7992-4c07-8a5a-f2bfbc328816 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:31:45.739285 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a090b98-7992-4c07-8a5a-f2bfbc328816 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:31:45.743859 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd7955d-009b-428d-bf96-24edbcfed6a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:31:45.744500 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd7955d-009b-428d-bf96-24edbcfed6a1 admin admin] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:31:45.744799 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd7955d-009b-428d-bf96-24edbcfed6a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:31:45.745073 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd7955d-009b-428d-bf96-24edbcfed6a1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:31:45.745768 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd7955d-009b-428d-bf96-24edbcfed6a1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:31:45.747706 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd7955d-009b-428d-bf96-24edbcfed6a1 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:31:45.775015 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1232/2459] 10.222.0.44 () {60 vars in 1152 bytes} [Thu Jun 16 12:31:45 2022] POST /identity/v3/projects => generated 379 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 12:31:45.779671 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbc860a-9774-46f4-a168-9764d6049de4 admin admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:31:45.790351 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbc860a-9774-46f4-a168-9764d6049de4 admin admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:31:45.847831 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2da8d42-cdb0-4561-8348-1a8dc19d8b9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:31:45.848522 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2da8d42-cdb0-4561-8348-1a8dc19d8b9b admin admin] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:31:45.848840 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2da8d42-cdb0-4561-8348-1a8dc19d8b9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:31:45.849117 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2da8d42-cdb0-4561-8348-1a8dc19d8b9b admin admin] PATH_INFO: `/v3/users` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:31:45.849811 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2da8d42-cdb0-4561-8348-1a8dc19d8b9b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:31:45.851725 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2da8d42-cdb0-4561-8348-1a8dc19d8b9b admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:31:45.870734 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1228/2460] 10.222.0.44 () {60 vars in 1143 bytes} [Thu Jun 16 12:31:45 2022] POST /identity/v3/users => generated 290 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 12:31:45.874954 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd7955d-009b-428d-bf96-24edbcfed6a1 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:31:45.886350 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd7955d-009b-428d-bf96-24edbcfed6a1 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:31:45.891228 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45898637-6caf-4213-9814-2a11d5727cd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:31:45.891875 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45898637-6caf-4213-9814-2a11d5727cd6 admin admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:31:45.892149 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45898637-6caf-4213-9814-2a11d5727cd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:31:45.892418 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45898637-6caf-4213-9814-2a11d5727cd6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:31:45.893169 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45898637-6caf-4213-9814-2a11d5727cd6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:31:45.894754 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45898637-6caf-4213-9814-2a11d5727cd6 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:31:45.905844 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1233/2461] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 12:31:45 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 12:31:45.909768 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2da8d42-cdb0-4561-8348-1a8dc19d8b9b admin admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:31:45.919566 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2da8d42-cdb0-4561-8348-1a8dc19d8b9b admin admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:31:45.924200 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9ed1da-479d-49be-a042-2f7c042981c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:31:45.924895 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9ed1da-479d-49be-a042-2f7c042981c5 admin admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:31:45.925183 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9ed1da-479d-49be-a042-2f7c042981c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:31:45.925470 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9ed1da-479d-49be-a042-2f7c042981c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:31:45.926185 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9ed1da-479d-49be-a042-2f7c042981c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:31:45.927782 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9ed1da-479d-49be-a042-2f7c042981c5 admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:31:45.937784 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1229/2462] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 12:31:45 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 12:31:45.941796 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45898637-6caf-4213-9814-2a11d5727cd6 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:31:45.952200 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45898637-6caf-4213-9814-2a11d5727cd6 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:31:45.956677 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e329a73-9917-42be-80ec-b8e85ae4b5e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:31:45.957579 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e329a73-9917-42be-80ec-b8e85ae4b5e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:31:45.958431 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e329a73-9917-42be-80ec-b8e85ae4b5e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:31:45.958700 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e329a73-9917-42be-80ec-b8e85ae4b5e5 admin admin] PATH_INFO: `/v3/projects/93c1707345024f3d822ed92d9a07314e/users/248d5e07fd644c1aaa5ad5d2668f3646/roles/c39882b202e942479a7cdac2fc6da72c` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:31:45.973042 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e329a73-9917-42be-80ec-b8e85ae4b5e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=93c1707345024f3d822ed92d9a07314e, user_id=248d5e07fd644c1aaa5ad5d2668f3646, role_id=c39882b202e942479a7cdac2fc6da72c)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:31:45.975739 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e329a73-9917-42be-80ec-b8e85ae4b5e5 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:31:45.988476 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1234/2463] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 16 12:31:45 2022] PUT /identity/v3/projects/93c1707345024f3d822ed92d9a07314e/users/248d5e07fd644c1aaa5ad5d2668f3646/roles/c39882b202e942479a7cdac2fc6da72c => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:31:45.999337 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13cadc1-6fb3-46ac-9bea-4fd14c7111eb None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:31:45.999644 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13cadc1-6fb3-46ac-9bea-4fd14c7111eb None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:31:45.999956 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13cadc1-6fb3-46ac-9bea-4fd14c7111eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:31:46.026316 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-c13cadc1-6fb3-46ac-9bea-4fd14c7111eb None None] MFA Rules not processed for user `248d5e07fd644c1aaa5ad5d2668f3646`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:31:46.027535 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-c13cadc1-6fb3-46ac-9bea-4fd14c7111eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:31:46.053957 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:31:46.093057 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1230/2464] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 12:31:45 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:31:46.097497 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e329a73-9917-42be-80ec-b8e85ae4b5e5 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:31:46.143152 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:31:46.163954 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e329a73-9917-42be-80ec-b8e85ae4b5e5 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:31:46.168614 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ec8c1b-5263-41ec-94f7-c2d093563fa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:31:46.169316 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ec8c1b-5263-41ec-94f7-c2d093563fa1 admin admin] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:31:46.169598 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ec8c1b-5263-41ec-94f7-c2d093563fa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:31:46.169874 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ec8c1b-5263-41ec-94f7-c2d093563fa1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:31:46.170569 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ec8c1b-5263-41ec-94f7-c2d093563fa1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:31:46.172478 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ec8c1b-5263-41ec-94f7-c2d093563fa1 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:31:46.197916 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1235/2465] 10.222.0.44 () {60 vars in 1152 bytes} [Thu Jun 16 12:31:46 2022] POST /identity/v3/projects => generated 381 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 12:31:46.201965 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13cadc1-6fb3-46ac-9bea-4fd14c7111eb None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:31:46.212437 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13cadc1-6fb3-46ac-9bea-4fd14c7111eb None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:31:46.266636 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b4c641-e674-41ed-8a6b-79af487e717e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:31:46.267227 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b4c641-e674-41ed-8a6b-79af487e717e admin admin] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:31:46.267509 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b4c641-e674-41ed-8a6b-79af487e717e admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:31:46.267781 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b4c641-e674-41ed-8a6b-79af487e717e admin admin] PATH_INFO: `/v3/users` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:31:46.268462 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b4c641-e674-41ed-8a6b-79af487e717e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:31:46.270466 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b4c641-e674-41ed-8a6b-79af487e717e admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:31:46.292777 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1231/2466] 10.222.0.44 () {60 vars in 1143 bytes} [Thu Jun 16 12:31:46 2022] POST /identity/v3/users => generated 297 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 12:31:46.293834 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ec8c1b-5263-41ec-94f7-c2d093563fa1 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:31:46.304902 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ec8c1b-5263-41ec-94f7-c2d093563fa1 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:31:46.309535 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d3959a-046d-4f3b-b5d2-0c2ba4a9d77b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:31:46.310184 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d3959a-046d-4f3b-b5d2-0c2ba4a9d77b admin admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:31:46.310460 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d3959a-046d-4f3b-b5d2-0c2ba4a9d77b admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:31:46.310732 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d3959a-046d-4f3b-b5d2-0c2ba4a9d77b admin admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:31:46.311445 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d3959a-046d-4f3b-b5d2-0c2ba4a9d77b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:31:46.313081 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d3959a-046d-4f3b-b5d2-0c2ba4a9d77b admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:31:46.324669 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1236/2467] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 12:31:46 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 12:31:46.328869 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b4c641-e674-41ed-8a6b-79af487e717e admin admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:31:46.338580 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b4c641-e674-41ed-8a6b-79af487e717e admin admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:31:46.343102 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7368ed45-ec65-40ee-9c1a-e612db004d30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:31:46.343964 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7368ed45-ec65-40ee-9c1a-e612db004d30 admin admin] REQUEST_METHOD: `PUT` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:31:46.344243 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7368ed45-ec65-40ee-9c1a-e612db004d30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:31:46.344516 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7368ed45-ec65-40ee-9c1a-e612db004d30 admin admin] PATH_INFO: `/v3/projects/e7bac209acba4614942adf8ad883d7aa/users/b41adb473be948e6a91ac5932fd8bd9d/roles/0688968254744e3f9913653cafea3091` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:31:46.359445 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7368ed45-ec65-40ee-9c1a-e612db004d30 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e7bac209acba4614942adf8ad883d7aa, user_id=b41adb473be948e6a91ac5932fd8bd9d, role_id=0688968254744e3f9913653cafea3091)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:31:46.362106 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7368ed45-ec65-40ee-9c1a-e612db004d30 admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:31:46.375902 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1232/2468] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 16 12:31:46 2022] PUT /identity/v3/projects/e7bac209acba4614942adf8ad883d7aa/users/b41adb473be948e6a91ac5932fd8bd9d/roles/0688968254744e3f9913653cafea3091 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:31:46.380079 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d3959a-046d-4f3b-b5d2-0c2ba4a9d77b admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:31:46.390103 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d3959a-046d-4f3b-b5d2-0c2ba4a9d77b admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:31:46.430137 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7368ed45-ec65-40ee-9c1a-e612db004d30 admin admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:31:46.431962 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-7368ed45-ec65-40ee-9c1a-e612db004d30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:31:46.446530 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a739b53-6c54-4643-9848-ee015a8bffb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:31:46.447199 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a739b53-6c54-4643-9848-ee015a8bffb0 admin admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:31:46.447478 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a739b53-6c54-4643-9848-ee015a8bffb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:31:46.447749 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a739b53-6c54-4643-9848-ee015a8bffb0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:31:46.448469 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a739b53-6c54-4643-9848-ee015a8bffb0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:31:46.450109 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a739b53-6c54-4643-9848-ee015a8bffb0 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:31:46.460567 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1237/2469] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 12:31:46 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 12:31:46.464591 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a739b53-6c54-4643-9848-ee015a8bffb0 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:31:46.475272 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a739b53-6c54-4643-9848-ee015a8bffb0 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:31:46.479856 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaed413e-c5be-4b6f-8370-6f6a34d5c63f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:31:46.480698 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaed413e-c5be-4b6f-8370-6f6a34d5c63f admin admin] REQUEST_METHOD: `PUT` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:31:46.481012 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaed413e-c5be-4b6f-8370-6f6a34d5c63f admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:31:46.481280 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaed413e-c5be-4b6f-8370-6f6a34d5c63f admin admin] PATH_INFO: `/v3/projects/e7bac209acba4614942adf8ad883d7aa/users/b41adb473be948e6a91ac5932fd8bd9d/roles/0688968254744e3f9913653cafea3091` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:31:46.483215 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaed413e-c5be-4b6f-8370-6f6a34d5c63f admin admin] RBAC: Authorizing `identity:create_grant(project_id=e7bac209acba4614942adf8ad883d7aa, user_id=b41adb473be948e6a91ac5932fd8bd9d, role_id=0688968254744e3f9913653cafea3091)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:31:46.485889 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaed413e-c5be-4b6f-8370-6f6a34d5c63f admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:31:46.489475 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7368ed45-ec65-40ee-9c1a-e612db004d30 admin admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:31:46.493236 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9709c122-7697-43de-b400-82e55868d0b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1094729b25a4be7b0b394998c9ca681', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '601361df39e34fcca71175aa94e425c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:31:46.493879 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9709c122-7697-43de-b400-82e55868d0b8 service neutron] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:31:46.494157 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9709c122-7697-43de-b400-82e55868d0b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:31:46.494426 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9709c122-7697-43de-b400-82e55868d0b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:31:46.496251 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-9709c122-7697-43de-b400-82e55868d0b8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:31:46.500826 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1238/2470] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 16 12:31:46 2022] PUT /identity/v3/projects/e7bac209acba4614942adf8ad883d7aa/users/b41adb473be948e6a91ac5932fd8bd9d/roles/0688968254744e3f9913653cafea3091 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 12:31:46.507825 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd600a80-55f9-4c12-8247-21404bd69204 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:31:46.508279 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd600a80-55f9-4c12-8247-21404bd69204 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:31:46.508718 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd600a80-55f9-4c12-8247-21404bd69204 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:31:46.535893 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-bd600a80-55f9-4c12-8247-21404bd69204 None None] MFA Rules not processed for user `b41adb473be948e6a91ac5932fd8bd9d`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:31:46.537062 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-bd600a80-55f9-4c12-8247-21404bd69204 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:31:46.545517 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:31:46.572697 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9709c122-7697-43de-b400-82e55868d0b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:31:46.574167 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9709c122-7697-43de-b400-82e55868d0b8 service neutron] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:31:46.585901 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1233/2471] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 12:31:46 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 12:31:46.608602 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1239/2472] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 12:31:46 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 12:31:46.623015 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9709c122-7697-43de-b400-82e55868d0b8 service neutron] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:31:46.624462 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-9709c122-7697-43de-b400-82e55868d0b8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:31:46.682105 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9709c122-7697-43de-b400-82e55868d0b8 service neutron] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:31:46.733294 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08354a5f-8a7a-43d3-8855-595390beef08 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f96fc14ed89478c8a8c2f11c87511e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '601361df39e34fcca71175aa94e425c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:31:46.733953 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08354a5f-8a7a-43d3-8855-595390beef08 service cinder] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:31:46.734330 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08354a5f-8a7a-43d3-8855-595390beef08 service cinder] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:31:46.734604 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08354a5f-8a7a-43d3-8855-595390beef08 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:31:46.753296 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08354a5f-8a7a-43d3-8855-595390beef08 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:31:46.753296 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08354a5f-8a7a-43d3-8855-595390beef08 service cinder] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:31:46.757365 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1234/2473] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 12:31:46 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 12:31:46.832464 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd600a80-55f9-4c12-8247-21404bd69204 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:31:46.841853 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd600a80-55f9-4c12-8247-21404bd69204 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:31:46.845365 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c63ff9d-d9d1-40e6-8b6c-a94aedffb60a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f96fc14ed89478c8a8c2f11c87511e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '601361df39e34fcca71175aa94e425c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:31:46.845995 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c63ff9d-d9d1-40e6-8b6c-a94aedffb60a service cinder] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:31:46.846269 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c63ff9d-d9d1-40e6-8b6c-a94aedffb60a service cinder] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:31:46.846536 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c63ff9d-d9d1-40e6-8b6c-a94aedffb60a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:31:46.865589 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:31:46.906503 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c63ff9d-d9d1-40e6-8b6c-a94aedffb60a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:31:46.907956 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c63ff9d-d9d1-40e6-8b6c-a94aedffb60a service cinder] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:31:46.917157 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1240/2474] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 12:31:46 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 12:31:47.807963 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08354a5f-8a7a-43d3-8855-595390beef08 service cinder] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:31:47.809496 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-08354a5f-8a7a-43d3-8855-595390beef08 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:31:47.865029 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08354a5f-8a7a-43d3-8855-595390beef08 service cinder] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:31:47.868566 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f7db3e-adab-4e33-9929-44759e7e475b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1094729b25a4be7b0b394998c9ca681', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '601361df39e34fcca71175aa94e425c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:31:47.869231 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f7db3e-adab-4e33-9929-44759e7e475b service neutron] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:31:47.869512 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f7db3e-adab-4e33-9929-44759e7e475b service neutron] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:31:47.869789 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f7db3e-adab-4e33-9929-44759e7e475b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:31:47.871542 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-71f7db3e-adab-4e33-9929-44759e7e475b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:31:47.916075 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:31:47.941250 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f7db3e-adab-4e33-9929-44759e7e475b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:31:47.943192 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f7db3e-adab-4e33-9929-44759e7e475b service neutron] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:31:47.953930 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1235/2475] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 12:31:47 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 12:31:53.690049 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c63ff9d-d9d1-40e6-8b6c-a94aedffb60a service cinder] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:31:53.765948 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c63ff9d-d9d1-40e6-8b6c-a94aedffb60a service cinder] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:31:53.771947 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28eafa7-6dd3-4503-b950-0bcee602e252 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:31:53.773126 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28eafa7-6dd3-4503-b950-0bcee602e252 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:31:53.773493 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28eafa7-6dd3-4503-b950-0bcee602e252 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:31:53.773829 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28eafa7-6dd3-4503-b950-0bcee602e252 admin admin] PATH_INFO: `/v3/users/248d5e07fd644c1aaa5ad5d2668f3646` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:31:53.775357 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28eafa7-6dd3-4503-b950-0bcee602e252 admin admin] RBAC: Authorizing `identity:delete_user(user_id=248d5e07fd644c1aaa5ad5d2668f3646)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:31:53.777488 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28eafa7-6dd3-4503-b950-0bcee602e252 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:31:53.830442 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-f28eafa7-6dd3-4503-b950-0bcee602e252 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '248d5e07fd644c1aaa5ad5d2668f3646'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:31:53.831173 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-f28eafa7-6dd3-4503-b950-0bcee602e252 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '248d5e07fd644c1aaa5ad5d2668f3646'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:31:53.839670 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-f28eafa7-6dd3-4503-b950-0bcee602e252 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '248d5e07fd644c1aaa5ad5d2668f3646'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:31:53.840282 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-f28eafa7-6dd3-4503-b950-0bcee602e252 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '248d5e07fd644c1aaa5ad5d2668f3646'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:31:53.849370 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-f28eafa7-6dd3-4503-b950-0bcee602e252 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '248d5e07fd644c1aaa5ad5d2668f3646'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:31:53.872944 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1241/2476] 10.222.0.44 () {58 vars in 1223 bytes} [Thu Jun 16 12:31:53 2022] DELETE /identity/v3/users/248d5e07fd644c1aaa5ad5d2668f3646 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:31:53.876690 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4fb323-207f-477d-9d19-dad69b44caeb None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:31:53.877263 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4fb323-207f-477d-9d19-dad69b44caeb None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:31:53.877497 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4fb323-207f-477d-9d19-dad69b44caeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:31:53.897759 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-4a4fb323-207f-477d-9d19-dad69b44caeb None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:31:53.899247 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-4a4fb323-207f-477d-9d19-dad69b44caeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:31:53.966887 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1236/2477] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 12:31:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 12:31:53.977040 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28eafa7-6dd3-4503-b950-0bcee602e252 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:31:53.978719 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-f28eafa7-6dd3-4503-b950-0bcee602e252 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:31:54.031253 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:31:54.049602 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28eafa7-6dd3-4503-b950-0bcee602e252 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:31:54.055051 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe5eb98-28d5-45b0-8b5f-f9f5211eba6d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1094729b25a4be7b0b394998c9ca681', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '601361df39e34fcca71175aa94e425c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:31:54.055789 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe5eb98-28d5-45b0-8b5f-f9f5211eba6d service neutron] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:31:54.056934 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe5eb98-28d5-45b0-8b5f-f9f5211eba6d service neutron] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:31:54.056934 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe5eb98-28d5-45b0-8b5f-f9f5211eba6d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:31:54.068069 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe5eb98-28d5-45b0-8b5f-f9f5211eba6d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:31:54.069812 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe5eb98-28d5-45b0-8b5f-f9f5211eba6d service neutron] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:31:54.092491 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1242/2478] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 12:31:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 12:31:54.478069 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4fb323-207f-477d-9d19-dad69b44caeb None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:31:54.480456 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-4a4fb323-207f-477d-9d19-dad69b44caeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:31:54.512031 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4fb323-207f-477d-9d19-dad69b44caeb None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:31:54.528899 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46653084-39dd-40d9-9354-a49ccbc4f536 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:31:54.530111 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46653084-39dd-40d9-9354-a49ccbc4f536 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:31:54.539823 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46653084-39dd-40d9-9354-a49ccbc4f536 admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:31:54.540140 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46653084-39dd-40d9-9354-a49ccbc4f536 admin admin] PATH_INFO: `/v3/projects/93c1707345024f3d822ed92d9a07314e` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:31:54.541911 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46653084-39dd-40d9-9354-a49ccbc4f536 admin admin] RBAC: Authorizing `identity:delete_project(project_id=93c1707345024f3d822ed92d9a07314e)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:31:54.544451 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46653084-39dd-40d9-9354-a49ccbc4f536 admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:31:54.617111 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-46653084-39dd-40d9-9354-a49ccbc4f536 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '93c1707345024f3d822ed92d9a07314e', 'request_id': 'req-46653084-39dd-40d9-9354-a49ccbc4f536'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:31:54.628222 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-46653084-39dd-40d9-9354-a49ccbc4f536 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '93c1707345024f3d822ed92d9a07314e', 'request_id': 'req-46653084-39dd-40d9-9354-a49ccbc4f536'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:31:54.636120 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-46653084-39dd-40d9-9354-a49ccbc4f536 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '93c1707345024f3d822ed92d9a07314e', 'request_id': 'req-46653084-39dd-40d9-9354-a49ccbc4f536'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:31:54.648307 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-46653084-39dd-40d9-9354-a49ccbc4f536 admin admin] The token cache is being invalidate because project 93c1707345024f3d822ed92d9a07314e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 12:31:54.648651 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-46653084-39dd-40d9-9354-a49ccbc4f536 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:31:54.649349 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-46653084-39dd-40d9-9354-a49ccbc4f536 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:31:54.651181 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1237/2479] 10.222.0.44 () {58 vars in 1232 bytes} [Thu Jun 16 12:31:54 2022] DELETE /identity/v3/projects/93c1707345024f3d822ed92d9a07314e => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:31:54.655145 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe5eb98-28d5-45b0-8b5f-f9f5211eba6d service neutron] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:31:54.665727 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe5eb98-28d5-45b0-8b5f-f9f5211eba6d service neutron] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:31:54.734852 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c2f3a9-0578-4c9d-bcf3-cd0a40da36e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:31:54.735765 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c2f3a9-0578-4c9d-bcf3-cd0a40da36e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:31:54.736044 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c2f3a9-0578-4c9d-bcf3-cd0a40da36e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:31:54.736317 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c2f3a9-0578-4c9d-bcf3-cd0a40da36e6 admin admin] PATH_INFO: `/v3/users/b41adb473be948e6a91ac5932fd8bd9d` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:31:54.737733 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c2f3a9-0578-4c9d-bcf3-cd0a40da36e6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b41adb473be948e6a91ac5932fd8bd9d)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:31:54.740255 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c2f3a9-0578-4c9d-bcf3-cd0a40da36e6 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:31:54.797106 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-06c2f3a9-0578-4c9d-bcf3-cd0a40da36e6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b41adb473be948e6a91ac5932fd8bd9d'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:31:54.797926 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-06c2f3a9-0578-4c9d-bcf3-cd0a40da36e6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b41adb473be948e6a91ac5932fd8bd9d'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:31:54.806752 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-06c2f3a9-0578-4c9d-bcf3-cd0a40da36e6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b41adb473be948e6a91ac5932fd8bd9d'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:31:54.807424 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-06c2f3a9-0578-4c9d-bcf3-cd0a40da36e6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b41adb473be948e6a91ac5932fd8bd9d'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:31:54.814851 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-06c2f3a9-0578-4c9d-bcf3-cd0a40da36e6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b41adb473be948e6a91ac5932fd8bd9d'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:31:54.833233 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1243/2480] 10.222.0.44 () {58 vars in 1223 bytes} [Thu Jun 16 12:31:54 2022] DELETE /identity/v3/users/b41adb473be948e6a91ac5932fd8bd9d => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:31:55.117531 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46653084-39dd-40d9-9354-a49ccbc4f536 admin admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:31:55.119148 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-46653084-39dd-40d9-9354-a49ccbc4f536 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:31:55.135291 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46653084-39dd-40d9-9354-a49ccbc4f536 admin admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:31:55.189314 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:31:55.196849 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719437b3-28d3-448c-a71a-ce9093611724 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:31:55.197721 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719437b3-28d3-448c-a71a-ce9093611724 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:31:55.198188 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719437b3-28d3-448c-a71a-ce9093611724 admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:31:55.198868 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719437b3-28d3-448c-a71a-ce9093611724 admin admin] PATH_INFO: `/v3/projects/e7bac209acba4614942adf8ad883d7aa` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:31:55.200285 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719437b3-28d3-448c-a71a-ce9093611724 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e7bac209acba4614942adf8ad883d7aa)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:31:55.202733 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719437b3-28d3-448c-a71a-ce9093611724 admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:31:55.248858 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-719437b3-28d3-448c-a71a-ce9093611724 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e7bac209acba4614942adf8ad883d7aa', 'request_id': 'req-719437b3-28d3-448c-a71a-ce9093611724'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:31:55.255873 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-719437b3-28d3-448c-a71a-ce9093611724 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e7bac209acba4614942adf8ad883d7aa', 'request_id': 'req-719437b3-28d3-448c-a71a-ce9093611724'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:31:55.261266 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-719437b3-28d3-448c-a71a-ce9093611724 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e7bac209acba4614942adf8ad883d7aa', 'request_id': 'req-719437b3-28d3-448c-a71a-ce9093611724'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:31:55.272535 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-719437b3-28d3-448c-a71a-ce9093611724 admin admin] The token cache is being invalidate because project e7bac209acba4614942adf8ad883d7aa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 12:31:55.272844 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-719437b3-28d3-448c-a71a-ce9093611724 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:31:55.273475 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-719437b3-28d3-448c-a71a-ce9093611724 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:31:55.274986 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1238/2481] 10.222.0.44 () {58 vars in 1232 bytes} [Thu Jun 16 12:31:55 2022] DELETE /identity/v3/projects/e7bac209acba4614942adf8ad883d7aa => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:31:55.280899 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42faf99f-0f2b-4611-abf4-d76ed2b542e4 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:31:55.281182 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42faf99f-0f2b-4611-abf4-d76ed2b542e4 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:31:55.281457 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42faf99f-0f2b-4611-abf4-d76ed2b542e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:31:55.299861 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-42faf99f-0f2b-4611-abf4-d76ed2b542e4 None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:31:55.301080 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-42faf99f-0f2b-4611-abf4-d76ed2b542e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:31:55.359038 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1244/2482] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 12:31:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 12:31:55.367916 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a13f6f2-00cf-4413-a42e-da8b3b716116 None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:31:55.368226 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a13f6f2-00cf-4413-a42e-da8b3b716116 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:31:55.368505 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a13f6f2-00cf-4413-a42e-da8b3b716116 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:31:55.387189 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-1a13f6f2-00cf-4413-a42e-da8b3b716116 None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:31:55.388402 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-1a13f6f2-00cf-4413-a42e-da8b3b716116 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:31:55.397528 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1239/2483] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 12:31:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:31:55.401634 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42faf99f-0f2b-4611-abf4-d76ed2b542e4 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:31:55.407072 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:31:55.413697 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42faf99f-0f2b-4611-abf4-d76ed2b542e4 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:31:55.419370 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a36e59-0e02-4f1a-88a1-0087ad28c700 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:31:55.420025 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a36e59-0e02-4f1a-88a1-0087ad28c700 admin admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:31:55.420308 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a36e59-0e02-4f1a-88a1-0087ad28c700 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:31:55.420585 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a36e59-0e02-4f1a-88a1-0087ad28c700 admin admin] PATH_INFO: `/v3/domains` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:31:55.421343 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a36e59-0e02-4f1a-88a1-0087ad28c700 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:31:55.421652 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a36e59-0e02-4f1a-88a1-0087ad28c700 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:31:55.423251 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a36e59-0e02-4f1a-88a1-0087ad28c700 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:31:55.434739 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1245/2484] 10.222.0.44 () {58 vars in 1152 bytes} [Thu Jun 16 12:31:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:31:55.439046 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a13f6f2-00cf-4413-a42e-da8b3b716116 None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:31:55.448834 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a13f6f2-00cf-4413-a42e-da8b3b716116 None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:31:55.453442 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1313bec6-7f3a-4000-bb07-da399b8f0b7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:31:55.454082 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1313bec6-7f3a-4000-bb07-da399b8f0b7e admin admin] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:31:55.454363 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1313bec6-7f3a-4000-bb07-da399b8f0b7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:31:55.454637 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1313bec6-7f3a-4000-bb07-da399b8f0b7e admin admin] PATH_INFO: `/v3/projects` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:31:55.455332 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1313bec6-7f3a-4000-bb07-da399b8f0b7e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:31:55.457828 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1313bec6-7f3a-4000-bb07-da399b8f0b7e admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:31:55.482258 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1240/2485] 10.222.0.44 () {60 vars in 1152 bytes} [Thu Jun 16 12:31:55 2022] POST /identity/v3/projects => generated 369 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 12:31:55.486228 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a36e59-0e02-4f1a-88a1-0087ad28c700 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:31:55.496283 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a36e59-0e02-4f1a-88a1-0087ad28c700 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:31:55.551258 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2839d48-3f0f-43ae-b45a-fa86018bc39a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:31:55.551919 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2839d48-3f0f-43ae-b45a-fa86018bc39a admin admin] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:31:55.552210 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2839d48-3f0f-43ae-b45a-fa86018bc39a admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:31:55.552472 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2839d48-3f0f-43ae-b45a-fa86018bc39a admin admin] PATH_INFO: `/v3/users` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:31:55.553202 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2839d48-3f0f-43ae-b45a-fa86018bc39a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:31:55.555142 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2839d48-3f0f-43ae-b45a-fa86018bc39a admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:31:55.574951 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1246/2486] 10.222.0.44 () {60 vars in 1143 bytes} [Thu Jun 16 12:31:55 2022] POST /identity/v3/users => generated 285 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 12:31:55.579014 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1313bec6-7f3a-4000-bb07-da399b8f0b7e admin admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:31:55.589665 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1313bec6-7f3a-4000-bb07-da399b8f0b7e admin admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:31:55.594672 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b2a791-1de2-4c3f-b5e1-6e67e81ba96c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:31:55.595337 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b2a791-1de2-4c3f-b5e1-6e67e81ba96c admin admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:31:55.595621 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b2a791-1de2-4c3f-b5e1-6e67e81ba96c admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:31:55.595898 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b2a791-1de2-4c3f-b5e1-6e67e81ba96c admin admin] PATH_INFO: `/v3/roles` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:31:55.596630 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b2a791-1de2-4c3f-b5e1-6e67e81ba96c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:31:55.598778 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b2a791-1de2-4c3f-b5e1-6e67e81ba96c admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:31:55.610360 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1241/2487] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 12:31:55 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 12:31:55.615053 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2839d48-3f0f-43ae-b45a-fa86018bc39a admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:31:55.624983 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2839d48-3f0f-43ae-b45a-fa86018bc39a admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:31:55.629599 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4eca629-d760-4daf-95ca-7073f3628899 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:31:55.630241 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4eca629-d760-4daf-95ca-7073f3628899 admin admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:31:55.630860 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4eca629-d760-4daf-95ca-7073f3628899 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:31:55.631141 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4eca629-d760-4daf-95ca-7073f3628899 admin admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:31:55.632199 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4eca629-d760-4daf-95ca-7073f3628899 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:31:55.633872 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4eca629-d760-4daf-95ca-7073f3628899 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:31:55.643938 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1247/2488] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 12:31:55 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 12:31:55.647827 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b2a791-1de2-4c3f-b5e1-6e67e81ba96c admin admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:31:55.657883 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b2a791-1de2-4c3f-b5e1-6e67e81ba96c admin admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:31:55.662960 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a368fba-fd34-4691-a7f2-ad610c04a4be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:31:55.663822 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a368fba-fd34-4691-a7f2-ad610c04a4be admin admin] REQUEST_METHOD: `PUT` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:31:55.664099 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a368fba-fd34-4691-a7f2-ad610c04a4be admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:31:55.664372 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a368fba-fd34-4691-a7f2-ad610c04a4be admin admin] PATH_INFO: `/v3/projects/b38c738cd61448879f1218196621cbb8/users/b6695a5bf4814b91b387ce15d714f213/roles/c39882b202e942479a7cdac2fc6da72c` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:31:55.679005 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a368fba-fd34-4691-a7f2-ad610c04a4be admin admin] RBAC: Authorizing `identity:create_grant(project_id=b38c738cd61448879f1218196621cbb8, user_id=b6695a5bf4814b91b387ce15d714f213, role_id=c39882b202e942479a7cdac2fc6da72c)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:31:55.681731 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a368fba-fd34-4691-a7f2-ad610c04a4be admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:31:55.694880 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1242/2489] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 16 12:31:55 2022] PUT /identity/v3/projects/b38c738cd61448879f1218196621cbb8/users/b6695a5bf4814b91b387ce15d714f213/roles/c39882b202e942479a7cdac2fc6da72c => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:31:55.704968 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc4c790-62da-4059-b013-ee9eba73fd6d None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:31:55.705260 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc4c790-62da-4059-b013-ee9eba73fd6d None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:31:55.705539 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc4c790-62da-4059-b013-ee9eba73fd6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:31:55.734111 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-0bc4c790-62da-4059-b013-ee9eba73fd6d None None] MFA Rules not processed for user `b6695a5bf4814b91b387ce15d714f213`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:31:55.735325 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-0bc4c790-62da-4059-b013-ee9eba73fd6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:31:55.803252 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1248/2490] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 12:31:55 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:31:55.807819 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a368fba-fd34-4691-a7f2-ad610c04a4be admin admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:31:55.873247 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a368fba-fd34-4691-a7f2-ad610c04a4be admin admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:31:55.877810 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bd5f21-59b7-4751-9d2c-bf79637e6fb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:31:55.878545 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bd5f21-59b7-4751-9d2c-bf79637e6fb5 admin admin] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:31:55.878743 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bd5f21-59b7-4751-9d2c-bf79637e6fb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:31:55.879018 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bd5f21-59b7-4751-9d2c-bf79637e6fb5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:31:55.879747 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bd5f21-59b7-4751-9d2c-bf79637e6fb5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:31:55.882061 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bd5f21-59b7-4751-9d2c-bf79637e6fb5 admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:31:55.909898 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1243/2491] 10.222.0.44 () {60 vars in 1152 bytes} [Thu Jun 16 12:31:55 2022] POST /identity/v3/projects => generated 369 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 12:31:55.914663 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc4c790-62da-4059-b013-ee9eba73fd6d None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:31:55.931271 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc4c790-62da-4059-b013-ee9eba73fd6d None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:31:55.985878 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:31:55.993016 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afd1758-5f16-49a1-8934-8d71ce711f6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:31:55.993686 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afd1758-5f16-49a1-8934-8d71ce711f6c admin admin] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:31:55.993968 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afd1758-5f16-49a1-8934-8d71ce711f6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:31:55.994244 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afd1758-5f16-49a1-8934-8d71ce711f6c admin admin] PATH_INFO: `/v3/users` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:31:55.994943 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afd1758-5f16-49a1-8934-8d71ce711f6c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:31:55.996973 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afd1758-5f16-49a1-8934-8d71ce711f6c admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:31:56.015148 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1249/2492] 10.222.0.44 () {60 vars in 1143 bytes} [Thu Jun 16 12:31:55 2022] POST /identity/v3/users => generated 291 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 12:31:56.019230 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bd5f21-59b7-4751-9d2c-bf79637e6fb5 admin admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:31:56.030401 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bd5f21-59b7-4751-9d2c-bf79637e6fb5 admin admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:31:56.035070 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d2e561-23e7-4495-b2f8-9840344082a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:31:56.036382 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d2e561-23e7-4495-b2f8-9840344082a9 admin admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:31:56.036664 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d2e561-23e7-4495-b2f8-9840344082a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:31:56.036984 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d2e561-23e7-4495-b2f8-9840344082a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:31:56.037713 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d2e561-23e7-4495-b2f8-9840344082a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:31:56.039305 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d2e561-23e7-4495-b2f8-9840344082a9 admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:31:56.041361 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:31:56.052241 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1244/2493] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 12:31:56 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 12:31:56.056410 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afd1758-5f16-49a1-8934-8d71ce711f6c admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:31:56.067463 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afd1758-5f16-49a1-8934-8d71ce711f6c admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:31:56.072050 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50198997-4557-49c0-8a10-4aa207c9449a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:31:56.072947 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50198997-4557-49c0-8a10-4aa207c9449a admin admin] REQUEST_METHOD: `PUT` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:31:56.073270 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50198997-4557-49c0-8a10-4aa207c9449a admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:31:56.073542 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50198997-4557-49c0-8a10-4aa207c9449a admin admin] PATH_INFO: `/v3/projects/ef8d0064d0f14353be83fbae7af85a77/users/3f70c87f579c491eba0ad5aaf4d53d85/roles/0688968254744e3f9913653cafea3091` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:31:56.088474 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50198997-4557-49c0-8a10-4aa207c9449a admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef8d0064d0f14353be83fbae7af85a77, user_id=3f70c87f579c491eba0ad5aaf4d53d85, role_id=0688968254744e3f9913653cafea3091)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:31:56.091312 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50198997-4557-49c0-8a10-4aa207c9449a admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:31:56.104512 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1250/2494] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 16 12:31:56 2022] PUT /identity/v3/projects/ef8d0064d0f14353be83fbae7af85a77/users/3f70c87f579c491eba0ad5aaf4d53d85/roles/0688968254744e3f9913653cafea3091 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 12:31:56.108695 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d2e561-23e7-4495-b2f8-9840344082a9 admin admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:31:56.119468 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d2e561-23e7-4495-b2f8-9840344082a9 admin admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:31:56.174437 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69981f7b-d0e0-4e4a-8f61-f88ce96ee6ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:31:56.175074 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69981f7b-d0e0-4e4a-8f61-f88ce96ee6ae admin admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:31:56.175355 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69981f7b-d0e0-4e4a-8f61-f88ce96ee6ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:31:56.175627 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69981f7b-d0e0-4e4a-8f61-f88ce96ee6ae admin admin] PATH_INFO: `/v3/roles` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:31:56.176920 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69981f7b-d0e0-4e4a-8f61-f88ce96ee6ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:31:56.178504 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69981f7b-d0e0-4e4a-8f61-f88ce96ee6ae admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:31:56.188043 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1245/2495] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 12:31:56 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 12:31:56.192240 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50198997-4557-49c0-8a10-4aa207c9449a admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:31:56.202340 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50198997-4557-49c0-8a10-4aa207c9449a admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:31:56.206927 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c2d8c8-1eaa-456d-ae11-d40ed51eae90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:31:56.207803 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c2d8c8-1eaa-456d-ae11-d40ed51eae90 admin admin] REQUEST_METHOD: `PUT` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:31:56.208080 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c2d8c8-1eaa-456d-ae11-d40ed51eae90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:31:56.208355 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c2d8c8-1eaa-456d-ae11-d40ed51eae90 admin admin] PATH_INFO: `/v3/projects/ef8d0064d0f14353be83fbae7af85a77/users/3f70c87f579c491eba0ad5aaf4d53d85/roles/0688968254744e3f9913653cafea3091` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:31:56.210347 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c2d8c8-1eaa-456d-ae11-d40ed51eae90 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef8d0064d0f14353be83fbae7af85a77, user_id=3f70c87f579c491eba0ad5aaf4d53d85, role_id=0688968254744e3f9913653cafea3091)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:31:56.213020 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c2d8c8-1eaa-456d-ae11-d40ed51eae90 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:31:56.223454 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1251/2496] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 16 12:31:56 2022] PUT /identity/v3/projects/ef8d0064d0f14353be83fbae7af85a77/users/3f70c87f579c491eba0ad5aaf4d53d85/roles/0688968254744e3f9913653cafea3091 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:31:56.234317 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230f9f63-0581-4c46-bfe7-4349a7d84072 None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:31:56.234605 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230f9f63-0581-4c46-bfe7-4349a7d84072 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:31:56.234883 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230f9f63-0581-4c46-bfe7-4349a7d84072 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:31:56.262706 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-230f9f63-0581-4c46-bfe7-4349a7d84072 None None] MFA Rules not processed for user `3f70c87f579c491eba0ad5aaf4d53d85`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:31:56.263927 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-230f9f63-0581-4c46-bfe7-4349a7d84072 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:31:56.330942 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1246/2497] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 12:31:56 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:31:56.341741 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c2d8c8-1eaa-456d-ae11-d40ed51eae90 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:31:56.343582 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-d8c2d8c8-1eaa-456d-ae11-d40ed51eae90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:31:56.399558 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c2d8c8-1eaa-456d-ae11-d40ed51eae90 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:31:56.403493 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56835ba9-112b-4ed8-80eb-bca0de9af469 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f96fc14ed89478c8a8c2f11c87511e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '601361df39e34fcca71175aa94e425c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:31:56.404126 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56835ba9-112b-4ed8-80eb-bca0de9af469 service cinder] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:31:56.404411 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56835ba9-112b-4ed8-80eb-bca0de9af469 service cinder] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:31:56.404682 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56835ba9-112b-4ed8-80eb-bca0de9af469 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:31:56.414087 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56835ba9-112b-4ed8-80eb-bca0de9af469 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:31:56.415513 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56835ba9-112b-4ed8-80eb-bca0de9af469 service cinder] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:31:56.424868 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1252/2498] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 12:31:56 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 12:31:57.703618 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230f9f63-0581-4c46-bfe7-4349a7d84072 None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:31:57.763432 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230f9f63-0581-4c46-bfe7-4349a7d84072 None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:31:57.770254 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bbea1b-7ed1-4011-8c01-cb67a957e533 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:31:57.771151 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bbea1b-7ed1-4011-8c01-cb67a957e533 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:31:57.771432 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bbea1b-7ed1-4011-8c01-cb67a957e533 admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:31:57.771702 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bbea1b-7ed1-4011-8c01-cb67a957e533 admin admin] PATH_INFO: `/v3/users/b6695a5bf4814b91b387ce15d714f213` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:31:57.772915 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bbea1b-7ed1-4011-8c01-cb67a957e533 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b6695a5bf4814b91b387ce15d714f213)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:31:57.774816 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bbea1b-7ed1-4011-8c01-cb67a957e533 admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:31:57.797488 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:31:57.822006 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-78bbea1b-7ed1-4011-8c01-cb67a957e533 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b6695a5bf4814b91b387ce15d714f213'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:31:57.833669 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-78bbea1b-7ed1-4011-8c01-cb67a957e533 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b6695a5bf4814b91b387ce15d714f213'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:31:57.840342 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-78bbea1b-7ed1-4011-8c01-cb67a957e533 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b6695a5bf4814b91b387ce15d714f213'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:31:57.841029 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-78bbea1b-7ed1-4011-8c01-cb67a957e533 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b6695a5bf4814b91b387ce15d714f213'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:31:57.841651 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-78bbea1b-7ed1-4011-8c01-cb67a957e533 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b6695a5bf4814b91b387ce15d714f213'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:31:57.854793 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1247/2499] 10.222.0.44 () {58 vars in 1223 bytes} [Thu Jun 16 12:31:57 2022] DELETE /identity/v3/users/b6695a5bf4814b91b387ce15d714f213 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:31:57.859329 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cab50c-4549-40c9-9629-ca0cb78eccdb None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:31:57.859820 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cab50c-4549-40c9-9629-ca0cb78eccdb None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:31:57.859928 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cab50c-4549-40c9-9629-ca0cb78eccdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:31:57.878961 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-d3cab50c-4549-40c9-9629-ca0cb78eccdb None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:31:57.880170 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-d3cab50c-4549-40c9-9629-ca0cb78eccdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:31:57.939644 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1253/2500] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 12:31:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:31:57.949269 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bbea1b-7ed1-4011-8c01-cb67a957e533 admin admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:31:57.950659 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-78bbea1b-7ed1-4011-8c01-cb67a957e533 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:31:58.006497 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bbea1b-7ed1-4011-8c01-cb67a957e533 admin admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:31:58.010322 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77480438-0656-4411-a26f-d0d63e453cee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1094729b25a4be7b0b394998c9ca681', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '601361df39e34fcca71175aa94e425c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:31:58.010973 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77480438-0656-4411-a26f-d0d63e453cee service neutron] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:31:58.011259 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77480438-0656-4411-a26f-d0d63e453cee service neutron] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:31:58.011533 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77480438-0656-4411-a26f-d0d63e453cee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:31:58.021275 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77480438-0656-4411-a26f-d0d63e453cee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:31:58.022707 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77480438-0656-4411-a26f-d0d63e453cee service neutron] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:31:58.032729 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1248/2501] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 12:31:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 12:31:58.313580 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cab50c-4549-40c9-9629-ca0cb78eccdb None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:31:58.315025 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-d3cab50c-4549-40c9-9629-ca0cb78eccdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:31:58.336212 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cab50c-4549-40c9-9629-ca0cb78eccdb None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:31:58.347903 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa59a09-2dc6-40d7-b024-a461a0520e90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:31:58.348813 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa59a09-2dc6-40d7-b024-a461a0520e90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:31:58.349103 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa59a09-2dc6-40d7-b024-a461a0520e90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:31:58.349375 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa59a09-2dc6-40d7-b024-a461a0520e90 admin admin] PATH_INFO: `/v3/projects/b38c738cd61448879f1218196621cbb8` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:31:58.350567 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa59a09-2dc6-40d7-b024-a461a0520e90 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b38c738cd61448879f1218196621cbb8)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:31:58.352527 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa59a09-2dc6-40d7-b024-a461a0520e90 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:31:58.397141 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=91,keystone:INSERT=5,keystone:DELETE=4 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:31:58.398671 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-afa59a09-2dc6-40d7-b024-a461a0520e90 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b38c738cd61448879f1218196621cbb8', 'request_id': 'req-afa59a09-2dc6-40d7-b024-a461a0520e90'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:31:58.407331 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-afa59a09-2dc6-40d7-b024-a461a0520e90 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b38c738cd61448879f1218196621cbb8', 'request_id': 'req-afa59a09-2dc6-40d7-b024-a461a0520e90'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:31:58.413239 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-afa59a09-2dc6-40d7-b024-a461a0520e90 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b38c738cd61448879f1218196621cbb8', 'request_id': 'req-afa59a09-2dc6-40d7-b024-a461a0520e90'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:31:58.423936 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-afa59a09-2dc6-40d7-b024-a461a0520e90 admin admin] The token cache is being invalidate because project b38c738cd61448879f1218196621cbb8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 12:31:58.424218 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-afa59a09-2dc6-40d7-b024-a461a0520e90 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:31:58.424882 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-afa59a09-2dc6-40d7-b024-a461a0520e90 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:31:58.426418 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1254/2502] 10.222.0.44 () {58 vars in 1232 bytes} [Thu Jun 16 12:31:58 2022] DELETE /identity/v3/projects/b38c738cd61448879f1218196621cbb8 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:31:58.430354 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77480438-0656-4411-a26f-d0d63e453cee service neutron] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:31:58.439749 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77480438-0656-4411-a26f-d0d63e453cee service neutron] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:31:58.493907 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bdc2e7-61f0-4f6c-bc19-9c642b01f8d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:31:58.494689 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bdc2e7-61f0-4f6c-bc19-9c642b01f8d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:31:58.494963 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bdc2e7-61f0-4f6c-bc19-9c642b01f8d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:31:58.495232 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bdc2e7-61f0-4f6c-bc19-9c642b01f8d4 admin admin] PATH_INFO: `/v3/users/3f70c87f579c491eba0ad5aaf4d53d85` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:31:58.496388 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bdc2e7-61f0-4f6c-bc19-9c642b01f8d4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3f70c87f579c491eba0ad5aaf4d53d85)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:31:58.498496 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bdc2e7-61f0-4f6c-bc19-9c642b01f8d4 admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:31:58.541224 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:31:58.544207 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-62bdc2e7-61f0-4f6c-bc19-9c642b01f8d4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3f70c87f579c491eba0ad5aaf4d53d85'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:31:58.558051 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-62bdc2e7-61f0-4f6c-bc19-9c642b01f8d4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3f70c87f579c491eba0ad5aaf4d53d85'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:31:58.564666 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-62bdc2e7-61f0-4f6c-bc19-9c642b01f8d4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3f70c87f579c491eba0ad5aaf4d53d85'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:31:58.565345 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-62bdc2e7-61f0-4f6c-bc19-9c642b01f8d4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3f70c87f579c491eba0ad5aaf4d53d85'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:31:58.565942 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-62bdc2e7-61f0-4f6c-bc19-9c642b01f8d4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3f70c87f579c491eba0ad5aaf4d53d85'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:31:58.578293 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1249/2503] 10.222.0.44 () {58 vars in 1223 bytes} [Thu Jun 16 12:31:58 2022] DELETE /identity/v3/users/3f70c87f579c491eba0ad5aaf4d53d85 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:31:58.845484 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa59a09-2dc6-40d7-b024-a461a0520e90 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:31:58.846974 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-afa59a09-2dc6-40d7-b024-a461a0520e90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:31:58.863764 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa59a09-2dc6-40d7-b024-a461a0520e90 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:31:58.923299 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47825926-7a1f-4d87-b853-99669d8f0817 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:31:58.924173 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47825926-7a1f-4d87-b853-99669d8f0817 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:31:58.924453 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47825926-7a1f-4d87-b853-99669d8f0817 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:31:58.924729 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47825926-7a1f-4d87-b853-99669d8f0817 admin admin] PATH_INFO: `/v3/projects/ef8d0064d0f14353be83fbae7af85a77` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:31:58.925959 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47825926-7a1f-4d87-b853-99669d8f0817 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ef8d0064d0f14353be83fbae7af85a77)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:31:58.927873 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47825926-7a1f-4d87-b853-99669d8f0817 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:31:58.976192 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-47825926-7a1f-4d87-b853-99669d8f0817 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ef8d0064d0f14353be83fbae7af85a77', 'request_id': 'req-47825926-7a1f-4d87-b853-99669d8f0817'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:31:58.983304 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-47825926-7a1f-4d87-b853-99669d8f0817 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ef8d0064d0f14353be83fbae7af85a77', 'request_id': 'req-47825926-7a1f-4d87-b853-99669d8f0817'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:31:58.988661 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-47825926-7a1f-4d87-b853-99669d8f0817 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ef8d0064d0f14353be83fbae7af85a77', 'request_id': 'req-47825926-7a1f-4d87-b853-99669d8f0817'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:31:58.999339 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-47825926-7a1f-4d87-b853-99669d8f0817 admin admin] The token cache is being invalidate because project ef8d0064d0f14353be83fbae7af85a77 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 12:31:58.999610 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-47825926-7a1f-4d87-b853-99669d8f0817 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:31:59.000233 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-47825926-7a1f-4d87-b853-99669d8f0817 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:31:59.001791 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1255/2504] 10.222.0.44 () {58 vars in 1232 bytes} [Thu Jun 16 12:31:58 2022] DELETE /identity/v3/projects/ef8d0064d0f14353be83fbae7af85a77 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:31:59.006602 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7595eec-b200-452c-9183-7c0d03145a0b None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:31:59.007105 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7595eec-b200-452c-9183-7c0d03145a0b None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:31:59.007221 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7595eec-b200-452c-9183-7c0d03145a0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:31:59.026508 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-c7595eec-b200-452c-9183-7c0d03145a0b None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:31:59.027896 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-c7595eec-b200-452c-9183-7c0d03145a0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:31:59.085828 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1250/2505] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 12:31:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:31:59.093607 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0e6e34-80c2-4224-9cde-e93c25287eec None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:31:59.093894 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0e6e34-80c2-4224-9cde-e93c25287eec None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:31:59.094173 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0e6e34-80c2-4224-9cde-e93c25287eec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:31:59.114048 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-fd0e6e34-80c2-4224-9cde-e93c25287eec None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:31:59.115253 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-fd0e6e34-80c2-4224-9cde-e93c25287eec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:31:59.123052 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1256/2506] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 12:31:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:31:59.127154 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7595eec-b200-452c-9183-7c0d03145a0b None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:31:59.136615 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7595eec-b200-452c-9183-7c0d03145a0b None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:31:59.141207 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48ba654-ef6f-4525-ac3a-8691fbadf854 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:31:59.141852 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48ba654-ef6f-4525-ac3a-8691fbadf854 admin admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:31:59.142133 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48ba654-ef6f-4525-ac3a-8691fbadf854 admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:31:59.142404 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48ba654-ef6f-4525-ac3a-8691fbadf854 admin admin] PATH_INFO: `/v3/domains` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:31:59.143125 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48ba654-ef6f-4525-ac3a-8691fbadf854 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:31:59.143428 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48ba654-ef6f-4525-ac3a-8691fbadf854 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:31:59.145102 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48ba654-ef6f-4525-ac3a-8691fbadf854 admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:31:59.156611 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1251/2507] 10.222.0.44 () {58 vars in 1152 bytes} [Thu Jun 16 12:31:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:31:59.161212 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0e6e34-80c2-4224-9cde-e93c25287eec None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:31:59.170296 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0e6e34-80c2-4224-9cde-e93c25287eec None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:31:59.174879 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ec4c50-836b-44c5-81a0-a9adf52fa982 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:31:59.176129 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ec4c50-836b-44c5-81a0-a9adf52fa982 admin admin] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:31:59.176395 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ec4c50-836b-44c5-81a0-a9adf52fa982 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:31:59.176669 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ec4c50-836b-44c5-81a0-a9adf52fa982 admin admin] PATH_INFO: `/v3/projects` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:31:59.177457 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ec4c50-836b-44c5-81a0-a9adf52fa982 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:31:59.179398 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ec4c50-836b-44c5-81a0-a9adf52fa982 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:31:59.204846 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1257/2508] 10.222.0.44 () {60 vars in 1152 bytes} [Thu Jun 16 12:31:59 2022] POST /identity/v3/projects => generated 389 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 12:31:59.209005 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48ba654-ef6f-4525-ac3a-8691fbadf854 admin admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:31:59.218763 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48ba654-ef6f-4525-ac3a-8691fbadf854 admin admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:31:59.274298 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a86f77f-c7bf-4fe5-b64b-adbfec2d0e67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:31:59.274951 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a86f77f-c7bf-4fe5-b64b-adbfec2d0e67 admin admin] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:31:59.275233 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a86f77f-c7bf-4fe5-b64b-adbfec2d0e67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:31:59.275507 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a86f77f-c7bf-4fe5-b64b-adbfec2d0e67 admin admin] PATH_INFO: `/v3/users` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:31:59.276185 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a86f77f-c7bf-4fe5-b64b-adbfec2d0e67 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:31:59.278435 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a86f77f-c7bf-4fe5-b64b-adbfec2d0e67 admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:31:59.298554 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1252/2509] 10.222.0.44 () {60 vars in 1143 bytes} [Thu Jun 16 12:31:59 2022] POST /identity/v3/users => generated 295 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 12:31:59.303426 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ec4c50-836b-44c5-81a0-a9adf52fa982 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:31:59.313806 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ec4c50-836b-44c5-81a0-a9adf52fa982 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:31:59.318795 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51061031-7f58-4fde-80b5-f652c6548232 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:31:59.319547 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51061031-7f58-4fde-80b5-f652c6548232 admin admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:31:59.319887 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51061031-7f58-4fde-80b5-f652c6548232 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:31:59.320224 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51061031-7f58-4fde-80b5-f652c6548232 admin admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:31:59.321044 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51061031-7f58-4fde-80b5-f652c6548232 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:31:59.322711 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51061031-7f58-4fde-80b5-f652c6548232 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:31:59.332947 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1258/2510] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 12:31:59 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 12:31:59.337025 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a86f77f-c7bf-4fe5-b64b-adbfec2d0e67 admin admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:31:59.347071 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a86f77f-c7bf-4fe5-b64b-adbfec2d0e67 admin admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:31:59.352209 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aad5084-558a-4c42-a1f5-381d085becae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:31:59.352900 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aad5084-558a-4c42-a1f5-381d085becae admin admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:31:59.353186 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aad5084-558a-4c42-a1f5-381d085becae admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:31:59.353463 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aad5084-558a-4c42-a1f5-381d085becae admin admin] PATH_INFO: `/v3/roles` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:31:59.354472 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aad5084-558a-4c42-a1f5-381d085becae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:31:59.356071 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aad5084-558a-4c42-a1f5-381d085becae admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:31:59.366945 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1253/2511] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 12:31:59 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 12:31:59.371256 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51061031-7f58-4fde-80b5-f652c6548232 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:31:59.382801 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51061031-7f58-4fde-80b5-f652c6548232 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:31:59.387690 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e3ddbc-036e-46b8-8f06-eab808b9d057 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:31:59.388689 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e3ddbc-036e-46b8-8f06-eab808b9d057 admin admin] REQUEST_METHOD: `PUT` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:31:59.389018 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e3ddbc-036e-46b8-8f06-eab808b9d057 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:31:59.389280 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e3ddbc-036e-46b8-8f06-eab808b9d057 admin admin] PATH_INFO: `/v3/projects/84c2dbf82000485dbc57107f046ce3d0/users/e895863d474744a3b37879becf700b36/roles/c39882b202e942479a7cdac2fc6da72c` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:31:59.405068 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e3ddbc-036e-46b8-8f06-eab808b9d057 admin admin] RBAC: Authorizing `identity:create_grant(project_id=84c2dbf82000485dbc57107f046ce3d0, user_id=e895863d474744a3b37879becf700b36, role_id=c39882b202e942479a7cdac2fc6da72c)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:31:59.407908 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e3ddbc-036e-46b8-8f06-eab808b9d057 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:31:59.421767 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1259/2512] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 16 12:31:59 2022] PUT /identity/v3/projects/84c2dbf82000485dbc57107f046ce3d0/users/e895863d474744a3b37879becf700b36/roles/c39882b202e942479a7cdac2fc6da72c => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:31:59.432186 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71eb9139-d534-406f-bbdf-bf2e75b24b8e None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:31:59.432559 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71eb9139-d534-406f-bbdf-bf2e75b24b8e None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:31:59.432945 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71eb9139-d534-406f-bbdf-bf2e75b24b8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:31:59.461240 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-71eb9139-d534-406f-bbdf-bf2e75b24b8e None None] MFA Rules not processed for user `e895863d474744a3b37879becf700b36`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:31:59.462565 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-71eb9139-d534-406f-bbdf-bf2e75b24b8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:31:59.477518 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:DELETE=4,keystone:SELECT=92,keystone:INSERT=4 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:31:59.530436 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1254/2513] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 12:31:59 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:31:59.534774 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e3ddbc-036e-46b8-8f06-eab808b9d057 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:31:59.539304 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:31:59.596712 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e3ddbc-036e-46b8-8f06-eab808b9d057 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:31:59.601378 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f687d6c0-e20e-44d4-92b0-e7b1193c14b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:31:59.602020 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f687d6c0-e20e-44d4-92b0-e7b1193c14b5 admin admin] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:31:59.602298 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f687d6c0-e20e-44d4-92b0-e7b1193c14b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:31:59.602569 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f687d6c0-e20e-44d4-92b0-e7b1193c14b5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:31:59.603254 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f687d6c0-e20e-44d4-92b0-e7b1193c14b5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:31:59.605198 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f687d6c0-e20e-44d4-92b0-e7b1193c14b5 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:31:59.630993 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1260/2514] 10.222.0.44 () {60 vars in 1152 bytes} [Thu Jun 16 12:31:59 2022] POST /identity/v3/projects => generated 387 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 12:31:59.634973 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71eb9139-d534-406f-bbdf-bf2e75b24b8e None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:31:59.645464 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71eb9139-d534-406f-bbdf-bf2e75b24b8e None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:31:59.702844 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623303c5-02d7-4512-8e6a-72be037c8584 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:31:59.703518 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623303c5-02d7-4512-8e6a-72be037c8584 admin admin] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:31:59.703805 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623303c5-02d7-4512-8e6a-72be037c8584 admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:31:59.704080 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623303c5-02d7-4512-8e6a-72be037c8584 admin admin] PATH_INFO: `/v3/users` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:31:59.705099 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623303c5-02d7-4512-8e6a-72be037c8584 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:31:59.707055 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623303c5-02d7-4512-8e6a-72be037c8584 admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:31:59.726206 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1255/2515] 10.222.0.44 () {60 vars in 1143 bytes} [Thu Jun 16 12:31:59 2022] POST /identity/v3/users => generated 300 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 12:31:59.730283 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f687d6c0-e20e-44d4-92b0-e7b1193c14b5 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:31:59.741296 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f687d6c0-e20e-44d4-92b0-e7b1193c14b5 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:31:59.745982 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61361f3-e7b7-4b01-899d-756e7096749e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:31:59.746893 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61361f3-e7b7-4b01-899d-756e7096749e admin admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:31:59.747178 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61361f3-e7b7-4b01-899d-756e7096749e admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:31:59.747450 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61361f3-e7b7-4b01-899d-756e7096749e admin admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:31:59.748171 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61361f3-e7b7-4b01-899d-756e7096749e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:31:59.749830 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61361f3-e7b7-4b01-899d-756e7096749e admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:31:59.761395 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1261/2516] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 12:31:59 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 12:31:59.765398 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623303c5-02d7-4512-8e6a-72be037c8584 admin admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:31:59.775736 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623303c5-02d7-4512-8e6a-72be037c8584 admin admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:31:59.780673 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a930ef6-c1ec-49fa-a617-3cfbf1478ae2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:31:59.781764 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a930ef6-c1ec-49fa-a617-3cfbf1478ae2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:31:59.782080 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a930ef6-c1ec-49fa-a617-3cfbf1478ae2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:31:59.782355 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a930ef6-c1ec-49fa-a617-3cfbf1478ae2 admin admin] PATH_INFO: `/v3/projects/0b7cb6cf477b409c93a4bc86b5c5171b/users/677d9f4e91044d53a328f42c0286448f/roles/0688968254744e3f9913653cafea3091` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:31:59.799373 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a930ef6-c1ec-49fa-a617-3cfbf1478ae2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b7cb6cf477b409c93a4bc86b5c5171b, user_id=677d9f4e91044d53a328f42c0286448f, role_id=0688968254744e3f9913653cafea3091)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:31:59.803956 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a930ef6-c1ec-49fa-a617-3cfbf1478ae2 admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:31:59.817241 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1256/2517] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 16 12:31:59 2022] PUT /identity/v3/projects/0b7cb6cf477b409c93a4bc86b5c5171b/users/677d9f4e91044d53a328f42c0286448f/roles/0688968254744e3f9913653cafea3091 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:31:59.821307 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61361f3-e7b7-4b01-899d-756e7096749e admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:31:59.831487 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61361f3-e7b7-4b01-899d-756e7096749e admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:31:59.887445 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264c30f5-d0f7-4b1c-8a98-78de31482bc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:31:59.888133 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264c30f5-d0f7-4b1c-8a98-78de31482bc0 admin admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:31:59.888381 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264c30f5-d0f7-4b1c-8a98-78de31482bc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:31:59.888650 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264c30f5-d0f7-4b1c-8a98-78de31482bc0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:31:59.889405 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264c30f5-d0f7-4b1c-8a98-78de31482bc0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:31:59.891007 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264c30f5-d0f7-4b1c-8a98-78de31482bc0 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:31:59.900975 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1262/2518] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 12:31:59 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 12:31:59.906088 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a930ef6-c1ec-49fa-a617-3cfbf1478ae2 admin admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:31:59.916619 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a930ef6-c1ec-49fa-a617-3cfbf1478ae2 admin admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:31:59.921259 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3868a33d-421a-40f2-973b-bf3df253d1d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:31:59.922131 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3868a33d-421a-40f2-973b-bf3df253d1d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:31:59.922407 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3868a33d-421a-40f2-973b-bf3df253d1d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:31:59.922685 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3868a33d-421a-40f2-973b-bf3df253d1d8 admin admin] PATH_INFO: `/v3/projects/0b7cb6cf477b409c93a4bc86b5c5171b/users/677d9f4e91044d53a328f42c0286448f/roles/0688968254744e3f9913653cafea3091` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:31:59.924663 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3868a33d-421a-40f2-973b-bf3df253d1d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b7cb6cf477b409c93a4bc86b5c5171b, user_id=677d9f4e91044d53a328f42c0286448f, role_id=0688968254744e3f9913653cafea3091)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:31:59.928057 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3868a33d-421a-40f2-973b-bf3df253d1d8 admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:31:59.938691 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1257/2519] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 16 12:31:59 2022] PUT /identity/v3/projects/0b7cb6cf477b409c93a4bc86b5c5171b/users/677d9f4e91044d53a328f42c0286448f/roles/0688968254744e3f9913653cafea3091 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:31:59.949723 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cf7e34-3107-4a55-a5cb-d1f83c7b7130 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:31:59.950046 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cf7e34-3107-4a55-a5cb-d1f83c7b7130 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:31:59.950329 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cf7e34-3107-4a55-a5cb-d1f83c7b7130 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:31:59.976480 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-46cf7e34-3107-4a55-a5cb-d1f83c7b7130 None None] MFA Rules not processed for user `677d9f4e91044d53a328f42c0286448f`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:31:59.977763 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-46cf7e34-3107-4a55-a5cb-d1f83c7b7130 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:32:00.041038 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:32:00.046554 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1263/2520] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 12:31:59 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:32:00.057575 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3868a33d-421a-40f2-973b-bf3df253d1d8 admin admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:32:00.059266 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-3868a33d-421a-40f2-973b-bf3df253d1d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:32:00.121225 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3868a33d-421a-40f2-973b-bf3df253d1d8 admin admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:32:00.124812 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b3d89b-b3b3-4740-90b2-11429b2fd9b8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f96fc14ed89478c8a8c2f11c87511e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '601361df39e34fcca71175aa94e425c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:32:00.125447 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b3d89b-b3b3-4740-90b2-11429b2fd9b8 service cinder] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:32:00.125722 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b3d89b-b3b3-4740-90b2-11429b2fd9b8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:32:00.125989 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b3d89b-b3b3-4740-90b2-11429b2fd9b8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:32:00.135402 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b3d89b-b3b3-4740-90b2-11429b2fd9b8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:32:00.136841 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b3d89b-b3b3-4740-90b2-11429b2fd9b8 service cinder] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:32:00.146668 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1258/2521] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 12:32:00 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 12:32:00.271483 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cf7e34-3107-4a55-a5cb-d1f83c7b7130 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:32:00.331458 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cf7e34-3107-4a55-a5cb-d1f83c7b7130 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:32:00.336327 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39769eb3-8d78-4577-8ec0-52a1b3518601 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:32:00.337220 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39769eb3-8d78-4577-8ec0-52a1b3518601 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:32:00.337499 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39769eb3-8d78-4577-8ec0-52a1b3518601 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:32:00.337769 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39769eb3-8d78-4577-8ec0-52a1b3518601 admin admin] PATH_INFO: `/v3/users/e895863d474744a3b37879becf700b36` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:32:00.338931 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39769eb3-8d78-4577-8ec0-52a1b3518601 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e895863d474744a3b37879becf700b36)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:32:00.340889 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39769eb3-8d78-4577-8ec0-52a1b3518601 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:32:00.385277 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-39769eb3-8d78-4577-8ec0-52a1b3518601 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e895863d474744a3b37879becf700b36'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:32:00.385913 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-39769eb3-8d78-4577-8ec0-52a1b3518601 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e895863d474744a3b37879becf700b36'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:32:00.392551 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-39769eb3-8d78-4577-8ec0-52a1b3518601 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e895863d474744a3b37879becf700b36'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:32:00.393193 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-39769eb3-8d78-4577-8ec0-52a1b3518601 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e895863d474744a3b37879becf700b36'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:32:00.400915 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-39769eb3-8d78-4577-8ec0-52a1b3518601 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e895863d474744a3b37879becf700b36'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:32:00.418722 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1264/2522] 10.222.0.44 () {58 vars in 1223 bytes} [Thu Jun 16 12:32:00 2022] DELETE /identity/v3/users/e895863d474744a3b37879becf700b36 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:32:00.423141 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b35d6de-d7ac-48ab-83b0-eb77e03a757c None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:32:00.423433 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b35d6de-d7ac-48ab-83b0-eb77e03a757c None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:32:00.423713 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b35d6de-d7ac-48ab-83b0-eb77e03a757c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:32:00.440564 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-0b35d6de-d7ac-48ab-83b0-eb77e03a757c None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:32:00.441793 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-0b35d6de-d7ac-48ab-83b0-eb77e03a757c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:32:00.446640 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:32:00.501582 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1259/2523] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 12:32:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:32:00.512231 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39769eb3-8d78-4577-8ec0-52a1b3518601 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:32:00.513731 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-39769eb3-8d78-4577-8ec0-52a1b3518601 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:32:00.571588 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39769eb3-8d78-4577-8ec0-52a1b3518601 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:32:00.575250 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65938b79-ecdc-4219-8417-8c02dae0bbd8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1094729b25a4be7b0b394998c9ca681', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '601361df39e34fcca71175aa94e425c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:32:00.576275 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65938b79-ecdc-4219-8417-8c02dae0bbd8 service neutron] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:32:00.576275 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65938b79-ecdc-4219-8417-8c02dae0bbd8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:32:00.576475 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65938b79-ecdc-4219-8417-8c02dae0bbd8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:32:00.585892 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65938b79-ecdc-4219-8417-8c02dae0bbd8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:32:00.587249 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65938b79-ecdc-4219-8417-8c02dae0bbd8 service neutron] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:32:00.596910 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1265/2524] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 12:32:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 12:32:00.863546 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b35d6de-d7ac-48ab-83b0-eb77e03a757c None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:32:00.865505 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-0b35d6de-d7ac-48ab-83b0-eb77e03a757c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:32:00.878497 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b35d6de-d7ac-48ab-83b0-eb77e03a757c None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:32:00.883722 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d99306-dceb-4cd2-8a40-8085dc171f4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:32:00.884596 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d99306-dceb-4cd2-8a40-8085dc171f4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:32:00.885690 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d99306-dceb-4cd2-8a40-8085dc171f4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:32:00.885957 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d99306-dceb-4cd2-8a40-8085dc171f4f admin admin] PATH_INFO: `/v3/projects/84c2dbf82000485dbc57107f046ce3d0` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:32:00.887229 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d99306-dceb-4cd2-8a40-8085dc171f4f admin admin] RBAC: Authorizing `identity:delete_project(project_id=84c2dbf82000485dbc57107f046ce3d0)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:32:00.889178 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d99306-dceb-4cd2-8a40-8085dc171f4f admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:32:00.938647 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-b9d99306-dceb-4cd2-8a40-8085dc171f4f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '84c2dbf82000485dbc57107f046ce3d0', 'request_id': 'req-b9d99306-dceb-4cd2-8a40-8085dc171f4f'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:32:00.946304 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-b9d99306-dceb-4cd2-8a40-8085dc171f4f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '84c2dbf82000485dbc57107f046ce3d0', 'request_id': 'req-b9d99306-dceb-4cd2-8a40-8085dc171f4f'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:32:00.952024 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-b9d99306-dceb-4cd2-8a40-8085dc171f4f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '84c2dbf82000485dbc57107f046ce3d0', 'request_id': 'req-b9d99306-dceb-4cd2-8a40-8085dc171f4f'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:32:00.963718 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-b9d99306-dceb-4cd2-8a40-8085dc171f4f admin admin] The token cache is being invalidate because project 84c2dbf82000485dbc57107f046ce3d0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 12:32:00.964007 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-b9d99306-dceb-4cd2-8a40-8085dc171f4f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:32:00.964663 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-b9d99306-dceb-4cd2-8a40-8085dc171f4f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:32:00.966233 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1260/2525] 10.222.0.44 () {58 vars in 1232 bytes} [Thu Jun 16 12:32:00 2022] DELETE /identity/v3/projects/84c2dbf82000485dbc57107f046ce3d0 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:32:00.970218 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65938b79-ecdc-4219-8417-8c02dae0bbd8 service neutron] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:32:00.980469 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65938b79-ecdc-4219-8417-8c02dae0bbd8 service neutron] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:32:00.996407 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:32:01.039735 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09662cba-8fff-4ba9-abc2-c8491d7729aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:32:01.040609 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09662cba-8fff-4ba9-abc2-c8491d7729aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:32:01.040921 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09662cba-8fff-4ba9-abc2-c8491d7729aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:32:01.041197 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09662cba-8fff-4ba9-abc2-c8491d7729aa admin admin] PATH_INFO: `/v3/users/677d9f4e91044d53a328f42c0286448f` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:32:01.042391 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09662cba-8fff-4ba9-abc2-c8491d7729aa admin admin] RBAC: Authorizing `identity:delete_user(user_id=677d9f4e91044d53a328f42c0286448f)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:32:01.044331 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09662cba-8fff-4ba9-abc2-c8491d7729aa admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:32:01.091649 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-09662cba-8fff-4ba9-abc2-c8491d7729aa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '677d9f4e91044d53a328f42c0286448f'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:32:01.092299 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-09662cba-8fff-4ba9-abc2-c8491d7729aa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '677d9f4e91044d53a328f42c0286448f'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:32:01.099289 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-09662cba-8fff-4ba9-abc2-c8491d7729aa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '677d9f4e91044d53a328f42c0286448f'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:32:01.100013 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-09662cba-8fff-4ba9-abc2-c8491d7729aa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '677d9f4e91044d53a328f42c0286448f'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:32:01.107006 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-09662cba-8fff-4ba9-abc2-c8491d7729aa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '677d9f4e91044d53a328f42c0286448f'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:32:01.125504 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1266/2526] 10.222.0.44 () {58 vars in 1223 bytes} [Thu Jun 16 12:32:00 2022] DELETE /identity/v3/users/677d9f4e91044d53a328f42c0286448f => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:32:01.524971 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d99306-dceb-4cd2-8a40-8085dc171f4f admin admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:32:01.526514 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-b9d99306-dceb-4cd2-8a40-8085dc171f4f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:32:01.540182 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d99306-dceb-4cd2-8a40-8085dc171f4f admin admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:32:01.631350 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb8d46e-9c5a-477c-803d-d94e4dcd6855 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:32:01.633685 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb8d46e-9c5a-477c-803d-d94e4dcd6855 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:32:01.633966 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb8d46e-9c5a-477c-803d-d94e4dcd6855 admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:32:01.634239 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb8d46e-9c5a-477c-803d-d94e4dcd6855 admin admin] PATH_INFO: `/v3/projects/0b7cb6cf477b409c93a4bc86b5c5171b` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:32:01.639621 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb8d46e-9c5a-477c-803d-d94e4dcd6855 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0b7cb6cf477b409c93a4bc86b5c5171b)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:32:01.642485 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb8d46e-9c5a-477c-803d-d94e4dcd6855 admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:32:01.717557 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:32:01.731713 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-fdb8d46e-9c5a-477c-803d-d94e4dcd6855 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b7cb6cf477b409c93a4bc86b5c5171b', 'request_id': 'req-fdb8d46e-9c5a-477c-803d-d94e4dcd6855'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:32:01.742525 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-fdb8d46e-9c5a-477c-803d-d94e4dcd6855 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b7cb6cf477b409c93a4bc86b5c5171b', 'request_id': 'req-fdb8d46e-9c5a-477c-803d-d94e4dcd6855'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:32:01.751333 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-fdb8d46e-9c5a-477c-803d-d94e4dcd6855 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b7cb6cf477b409c93a4bc86b5c5171b', 'request_id': 'req-fdb8d46e-9c5a-477c-803d-d94e4dcd6855'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:32:01.764332 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-fdb8d46e-9c5a-477c-803d-d94e4dcd6855 admin admin] The token cache is being invalidate because project 0b7cb6cf477b409c93a4bc86b5c5171b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 12:32:01.764799 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-fdb8d46e-9c5a-477c-803d-d94e4dcd6855 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:32:01.765584 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-fdb8d46e-9c5a-477c-803d-d94e4dcd6855 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:32:01.771888 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1261/2527] 10.222.0.44 () {58 vars in 1232 bytes} [Thu Jun 16 12:32:01 2022] DELETE /identity/v3/projects/0b7cb6cf477b409c93a4bc86b5c5171b => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:32:01.773019 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3bb613-ddfe-4fb1-8b6b-14d3f2936958 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:32:01.773309 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3bb613-ddfe-4fb1-8b6b-14d3f2936958 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:32:01.773591 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3bb613-ddfe-4fb1-8b6b-14d3f2936958 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:32:01.810753 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-ee3bb613-ddfe-4fb1-8b6b-14d3f2936958 None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:32:01.818643 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-ee3bb613-ddfe-4fb1-8b6b-14d3f2936958 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:32:01.983950 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1267/2528] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 12:32:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:32:01.987227 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4264f983-75f5-4bf7-81a6-ba5bd3e662ac None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:32:01.988502 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4264f983-75f5-4bf7-81a6-ba5bd3e662ac None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:32:01.989655 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4264f983-75f5-4bf7-81a6-ba5bd3e662ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:32:02.025694 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-4264f983-75f5-4bf7-81a6-ba5bd3e662ac None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:32:02.027907 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-4264f983-75f5-4bf7-81a6-ba5bd3e662ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:32:02.043507 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3bb613-ddfe-4fb1-8b6b-14d3f2936958 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:32:02.054888 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1262/2529] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 12:32:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:32:02.057881 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3bb613-ddfe-4fb1-8b6b-14d3f2936958 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:32:02.068489 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d839992-a21c-4a73-a03a-b94c333106ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:32:02.068489 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d839992-a21c-4a73-a03a-b94c333106ee admin admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:32:02.068489 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d839992-a21c-4a73-a03a-b94c333106ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:32:02.068489 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d839992-a21c-4a73-a03a-b94c333106ee admin admin] PATH_INFO: `/v3/domains` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:32:02.080788 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d839992-a21c-4a73-a03a-b94c333106ee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:32:02.081111 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d839992-a21c-4a73-a03a-b94c333106ee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:32:02.096760 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d839992-a21c-4a73-a03a-b94c333106ee admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:32:02.131992 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1268/2530] 10.222.0.44 () {58 vars in 1152 bytes} [Thu Jun 16 12:32:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:32:02.137246 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4264f983-75f5-4bf7-81a6-ba5bd3e662ac None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:32:02.150225 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4264f983-75f5-4bf7-81a6-ba5bd3e662ac None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:32:02.161070 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e90c60-9d0c-4fd3-9818-3432221bf470 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:32:02.161753 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e90c60-9d0c-4fd3-9818-3432221bf470 admin admin] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:32:02.162036 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e90c60-9d0c-4fd3-9818-3432221bf470 admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:32:02.162310 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e90c60-9d0c-4fd3-9818-3432221bf470 admin admin] PATH_INFO: `/v3/projects` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:32:02.163019 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e90c60-9d0c-4fd3-9818-3432221bf470 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:32:02.165016 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e90c60-9d0c-4fd3-9818-3432221bf470 admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:32:02.211781 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1263/2531] 10.222.0.44 () {60 vars in 1152 bytes} [Thu Jun 16 12:32:02 2022] POST /identity/v3/projects => generated 371 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 12:32:02.217849 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d839992-a21c-4a73-a03a-b94c333106ee admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:32:02.231097 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d839992-a21c-4a73-a03a-b94c333106ee admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:32:02.267329 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:32:02.312233 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c918295-0089-47d9-b53b-4fb25f971456 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:32:02.313125 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c918295-0089-47d9-b53b-4fb25f971456 admin admin] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:32:02.314135 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c918295-0089-47d9-b53b-4fb25f971456 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:32:02.314135 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c918295-0089-47d9-b53b-4fb25f971456 admin admin] PATH_INFO: `/v3/users` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:32:02.314688 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c918295-0089-47d9-b53b-4fb25f971456 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:32:02.316715 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c918295-0089-47d9-b53b-4fb25f971456 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:32:02.340963 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1269/2532] 10.222.0.44 () {60 vars in 1143 bytes} [Thu Jun 16 12:32:02 2022] POST /identity/v3/users => generated 286 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 12:32:02.342134 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e90c60-9d0c-4fd3-9818-3432221bf470 admin admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:32:02.355484 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e90c60-9d0c-4fd3-9818-3432221bf470 admin admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:32:02.360904 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53a1bf1-742e-47e5-8941-37b9cd7b4160 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:32:02.361856 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53a1bf1-742e-47e5-8941-37b9cd7b4160 admin admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:32:02.362143 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53a1bf1-742e-47e5-8941-37b9cd7b4160 admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:32:02.362524 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53a1bf1-742e-47e5-8941-37b9cd7b4160 admin admin] PATH_INFO: `/v3/roles` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:32:02.363386 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53a1bf1-742e-47e5-8941-37b9cd7b4160 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:32:02.365981 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53a1bf1-742e-47e5-8941-37b9cd7b4160 admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:32:02.380090 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1264/2533] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 12:32:02 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 12:32:02.384128 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c918295-0089-47d9-b53b-4fb25f971456 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:32:02.396788 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c918295-0089-47d9-b53b-4fb25f971456 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:32:02.402948 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a69c176-e125-4e27-8759-cb85a7ef3837 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:32:02.403619 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a69c176-e125-4e27-8759-cb85a7ef3837 admin admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:32:02.403908 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a69c176-e125-4e27-8759-cb85a7ef3837 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:32:02.404184 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a69c176-e125-4e27-8759-cb85a7ef3837 admin admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:32:02.405136 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a69c176-e125-4e27-8759-cb85a7ef3837 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:32:02.406777 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a69c176-e125-4e27-8759-cb85a7ef3837 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:32:02.419736 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1270/2534] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 12:32:02 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 12:32:02.423688 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53a1bf1-742e-47e5-8941-37b9cd7b4160 admin admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:32:02.434552 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53a1bf1-742e-47e5-8941-37b9cd7b4160 admin admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:32:02.440050 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b4c341-0b8e-4ef4-a2c4-beac7154ccfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:32:02.441112 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b4c341-0b8e-4ef4-a2c4-beac7154ccfa admin admin] REQUEST_METHOD: `PUT` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:32:02.441496 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b4c341-0b8e-4ef4-a2c4-beac7154ccfa admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:32:02.441870 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b4c341-0b8e-4ef4-a2c4-beac7154ccfa admin admin] PATH_INFO: `/v3/projects/d2f52002c7384340aa95d4cd0e8caed9/users/9100c34835d8494fa49fcbff6bbdd1f3/roles/c39882b202e942479a7cdac2fc6da72c` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:32:02.457332 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b4c341-0b8e-4ef4-a2c4-beac7154ccfa admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2f52002c7384340aa95d4cd0e8caed9, user_id=9100c34835d8494fa49fcbff6bbdd1f3, role_id=c39882b202e942479a7cdac2fc6da72c)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:32:02.461243 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b4c341-0b8e-4ef4-a2c4-beac7154ccfa admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:32:02.477174 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1265/2535] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 16 12:32:02 2022] PUT /identity/v3/projects/d2f52002c7384340aa95d4cd0e8caed9/users/9100c34835d8494fa49fcbff6bbdd1f3/roles/c39882b202e942479a7cdac2fc6da72c => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:32:02.487379 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c563c6f-bfe9-4f8f-ba8a-e5d39e2eb821 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:32:02.487727 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c563c6f-bfe9-4f8f-ba8a-e5d39e2eb821 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:32:02.488092 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c563c6f-bfe9-4f8f-ba8a-e5d39e2eb821 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:32:02.515520 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-9c563c6f-bfe9-4f8f-ba8a-e5d39e2eb821 None None] MFA Rules not processed for user `9100c34835d8494fa49fcbff6bbdd1f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:32:02.518382 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-9c563c6f-bfe9-4f8f-ba8a-e5d39e2eb821 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:32:02.587106 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1271/2536] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 12:32:02 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:32:02.604055 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b4c341-0b8e-4ef4-a2c4-beac7154ccfa admin admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:32:02.604055 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-68b4c341-0b8e-4ef4-a2c4-beac7154ccfa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:32:02.664973 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b4c341-0b8e-4ef4-a2c4-beac7154ccfa admin admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:32:02.668551 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcbc305-08f7-401d-afce-7e4731b20b21 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f96fc14ed89478c8a8c2f11c87511e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '601361df39e34fcca71175aa94e425c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:32:02.669225 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcbc305-08f7-401d-afce-7e4731b20b21 service cinder] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:32:02.669499 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcbc305-08f7-401d-afce-7e4731b20b21 service cinder] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:32:02.669765 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcbc305-08f7-401d-afce-7e4731b20b21 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:32:02.680960 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcbc305-08f7-401d-afce-7e4731b20b21 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:32:02.682422 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcbc305-08f7-401d-afce-7e4731b20b21 service cinder] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:32:02.691253 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1266/2537] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 12:32:02 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 12:32:02.715293 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c563c6f-bfe9-4f8f-ba8a-e5d39e2eb821 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:32:02.779173 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c563c6f-bfe9-4f8f-ba8a-e5d39e2eb821 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:32:02.783895 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f64fdfb-ca77-484a-abcd-0c08acf1fce0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:32:02.784889 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f64fdfb-ca77-484a-abcd-0c08acf1fce0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:32:02.785165 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f64fdfb-ca77-484a-abcd-0c08acf1fce0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:32:02.785431 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f64fdfb-ca77-484a-abcd-0c08acf1fce0 admin admin] PATH_INFO: `/v3/users/9100c34835d8494fa49fcbff6bbdd1f3` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:32:02.787116 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f64fdfb-ca77-484a-abcd-0c08acf1fce0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9100c34835d8494fa49fcbff6bbdd1f3)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:32:02.789101 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f64fdfb-ca77-484a-abcd-0c08acf1fce0 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:32:02.832105 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:32:02.841942 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-3f64fdfb-ca77-484a-abcd-0c08acf1fce0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9100c34835d8494fa49fcbff6bbdd1f3'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:32:02.842823 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-3f64fdfb-ca77-484a-abcd-0c08acf1fce0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9100c34835d8494fa49fcbff6bbdd1f3'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:32:02.851160 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-3f64fdfb-ca77-484a-abcd-0c08acf1fce0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9100c34835d8494fa49fcbff6bbdd1f3'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:32:02.852290 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-3f64fdfb-ca77-484a-abcd-0c08acf1fce0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9100c34835d8494fa49fcbff6bbdd1f3'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:32:02.860645 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-3f64fdfb-ca77-484a-abcd-0c08acf1fce0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9100c34835d8494fa49fcbff6bbdd1f3'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:32:02.878552 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1272/2538] 10.222.0.44 () {58 vars in 1223 bytes} [Thu Jun 16 12:32:02 2022] DELETE /identity/v3/users/9100c34835d8494fa49fcbff6bbdd1f3 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:32:02.883528 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1d871d-2818-4f46-86db-d36a5badc9bb None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:32:02.883925 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1d871d-2818-4f46-86db-d36a5badc9bb None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:32:02.884297 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1d871d-2818-4f46-86db-d36a5badc9bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:32:02.902850 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-3d1d871d-2818-4f46-86db-d36a5badc9bb None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:32:02.904850 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-3d1d871d-2818-4f46-86db-d36a5badc9bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:32:03.001425 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1267/2539] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 12:32:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:32:03.013350 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f64fdfb-ca77-484a-abcd-0c08acf1fce0 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:32:03.015311 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-3f64fdfb-ca77-484a-abcd-0c08acf1fce0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:32:03.082870 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f64fdfb-ca77-484a-abcd-0c08acf1fce0 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:32:03.087377 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0602f3-a742-4f95-a7ef-31d2d164eacc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1094729b25a4be7b0b394998c9ca681', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '601361df39e34fcca71175aa94e425c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:32:03.088618 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0602f3-a742-4f95-a7ef-31d2d164eacc service neutron] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:32:03.088961 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0602f3-a742-4f95-a7ef-31d2d164eacc service neutron] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:32:03.089335 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0602f3-a742-4f95-a7ef-31d2d164eacc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:32:03.102231 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0602f3-a742-4f95-a7ef-31d2d164eacc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:32:03.103707 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0602f3-a742-4f95-a7ef-31d2d164eacc service neutron] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:32:03.117190 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1273/2540] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 12:32:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 12:32:03.437309 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1d871d-2818-4f46-86db-d36a5badc9bb None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:32:03.439016 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-3d1d871d-2818-4f46-86db-d36a5badc9bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:32:03.449568 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:32:03.454676 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1d871d-2818-4f46-86db-d36a5badc9bb None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:32:03.461246 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6bfb43-ddf0-4418-8758-a541f9e301d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:32:03.462261 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6bfb43-ddf0-4418-8758-a541f9e301d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:32:03.462713 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6bfb43-ddf0-4418-8758-a541f9e301d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:32:03.463200 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6bfb43-ddf0-4418-8758-a541f9e301d9 admin admin] PATH_INFO: `/v3/projects/d2f52002c7384340aa95d4cd0e8caed9` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:32:03.464576 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6bfb43-ddf0-4418-8758-a541f9e301d9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d2f52002c7384340aa95d4cd0e8caed9)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:32:03.466531 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6bfb43-ddf0-4418-8758-a541f9e301d9 admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:32:03.517833 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-4c6bfb43-ddf0-4418-8758-a541f9e301d9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd2f52002c7384340aa95d4cd0e8caed9', 'request_id': 'req-4c6bfb43-ddf0-4418-8758-a541f9e301d9'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:32:03.525563 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-4c6bfb43-ddf0-4418-8758-a541f9e301d9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd2f52002c7384340aa95d4cd0e8caed9', 'request_id': 'req-4c6bfb43-ddf0-4418-8758-a541f9e301d9'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:32:03.533132 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-4c6bfb43-ddf0-4418-8758-a541f9e301d9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd2f52002c7384340aa95d4cd0e8caed9', 'request_id': 'req-4c6bfb43-ddf0-4418-8758-a541f9e301d9'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:32:03.545566 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-4c6bfb43-ddf0-4418-8758-a541f9e301d9 admin admin] The token cache is being invalidate because project d2f52002c7384340aa95d4cd0e8caed9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 12:32:03.545848 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-4c6bfb43-ddf0-4418-8758-a541f9e301d9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:32:03.546507 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-4c6bfb43-ddf0-4418-8758-a541f9e301d9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:32:03.548094 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1268/2541] 10.222.0.44 () {58 vars in 1232 bytes} [Thu Jun 16 12:32:03 2022] DELETE /identity/v3/projects/d2f52002c7384340aa95d4cd0e8caed9 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:32:03.763243 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0602f3-a742-4f95-a7ef-31d2d164eacc service neutron] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:32:03.774607 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0602f3-a742-4f95-a7ef-31d2d164eacc service neutron] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:32:03.836425 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31f6d20-e8d5-4c9a-9a3e-061f938271ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1094729b25a4be7b0b394998c9ca681', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '601361df39e34fcca71175aa94e425c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:32:03.837164 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31f6d20-e8d5-4c9a-9a3e-061f938271ca service neutron] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:32:03.837450 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31f6d20-e8d5-4c9a-9a3e-061f938271ca service neutron] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:32:03.837699 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31f6d20-e8d5-4c9a-9a3e-061f938271ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:32:03.840243 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-a31f6d20-e8d5-4c9a-9a3e-061f938271ca service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:32:03.850787 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31f6d20-e8d5-4c9a-9a3e-061f938271ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:32:03.852237 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31f6d20-e8d5-4c9a-9a3e-061f938271ca service neutron] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:32:03.861868 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1274/2542] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 12:32:03 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 12:32:04.158064 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6bfb43-ddf0-4418-8758-a541f9e301d9 admin admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:32:04.159868 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-4c6bfb43-ddf0-4418-8758-a541f9e301d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:32:04.240416 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6bfb43-ddf0-4418-8758-a541f9e301d9 admin admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:32:04.247212 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be15b5e-9e11-4f94-80a5-39b9f89be198 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edfb12d445e74136b90800e93941f468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '601361df39e34fcca71175aa94e425c4', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:32:04.248518 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be15b5e-9e11-4f94-80a5-39b9f89be198 service nova] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:32:04.248922 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be15b5e-9e11-4f94-80a5-39b9f89be198 service nova] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:32:04.249118 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be15b5e-9e11-4f94-80a5-39b9f89be198 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:32:04.250926 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-4be15b5e-9e11-4f94-80a5-39b9f89be198 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:32:04.316863 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be15b5e-9e11-4f94-80a5-39b9f89be198 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:32:04.318513 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be15b5e-9e11-4f94-80a5-39b9f89be198 service nova] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:32:04.328668 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1269/2543] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 12:32:04 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 12:32:09.386864 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44585b94-017a-4294-8122-2c9deeb3d261 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:32:09.387698 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44585b94-017a-4294-8122-2c9deeb3d261 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:32:09.387979 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44585b94-017a-4294-8122-2c9deeb3d261 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:32:09.407072 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-44585b94-017a-4294-8122-2c9deeb3d261 None None] MFA Rules not processed for user `222b53cae3d64412b9b0a89d162311f4`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:32:09.408298 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-44585b94-017a-4294-8122-2c9deeb3d261 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:32:09.466185 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1275/2544] 10.222.0.44 () {58 vars in 967 bytes} [Thu Jun 16 12:32:09 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:32:09.512989 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be15b5e-9e11-4f94-80a5-39b9f89be198 service nova] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:32:09.514397 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-4be15b5e-9e11-4f94-80a5-39b9f89be198 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:32:09.542259 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:32:09.597736 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be15b5e-9e11-4f94-80a5-39b9f89be198 service nova] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:32:09.602686 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3df746-c981-47e9-8d3c-998ea26c95a5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c159f79c1921496487101aac5d530ae5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '601361df39e34fcca71175aa94e425c4', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:32:09.603321 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3df746-c981-47e9-8d3c-998ea26c95a5 service swift] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:32:09.603602 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3df746-c981-47e9-8d3c-998ea26c95a5 service swift] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:32:09.603875 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3df746-c981-47e9-8d3c-998ea26c95a5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:32:09.611707 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3df746-c981-47e9-8d3c-998ea26c95a5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:32:09.613316 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3df746-c981-47e9-8d3c-998ea26c95a5 service swift] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:32:09.621222 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1270/2545] 10.222.0.44 () {60 vars in 1384 bytes} [Thu Jun 16 12:32:09 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 16 12:32:12.422344 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44410f42-8148-4749-b821-44d16ae43262 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:32:12.422857 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44410f42-8148-4749-b821-44d16ae43262 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:32:12.422962 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44410f42-8148-4749-b821-44d16ae43262 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:32:12.435901 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:32:12.443158 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-44410f42-8148-4749-b821-44d16ae43262 None None] MFA Rules not processed for user `222b53cae3d64412b9b0a89d162311f4`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:32:12.445854 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-44410f42-8148-4749-b821-44d16ae43262 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:32:12.455615 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1276/2546] 10.222.0.44 () {58 vars in 1009 bytes} [Thu Jun 16 12:32:12 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:32:12.469889 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3df746-c981-47e9-8d3c-998ea26c95a5 service swift] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:32:12.481908 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3df746-c981-47e9-8d3c-998ea26c95a5 service swift] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:32:12.487668 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b349a97c-9acf-4c83-9987-7bbd4ab07a2c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c159f79c1921496487101aac5d530ae5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '601361df39e34fcca71175aa94e425c4', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:32:12.488820 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b349a97c-9acf-4c83-9987-7bbd4ab07a2c service swift] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:32:12.488820 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b349a97c-9acf-4c83-9987-7bbd4ab07a2c service swift] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:32:12.489027 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b349a97c-9acf-4c83-9987-7bbd4ab07a2c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:32:12.497923 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b349a97c-9acf-4c83-9987-7bbd4ab07a2c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:32:12.499498 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b349a97c-9acf-4c83-9987-7bbd4ab07a2c service swift] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:32:12.507653 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1271/2547] 10.222.0.44 () {60 vars in 1384 bytes} [Thu Jun 16 12:32:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 16 12:32:13.343444 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44410f42-8148-4749-b821-44d16ae43262 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:32:13.345550 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-44410f42-8148-4749-b821-44d16ae43262 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:32:13.500979 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44410f42-8148-4749-b821-44d16ae43262 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:32:13.531116 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7089a1-5c3c-46be-9cf4-d1db530733b0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8bff8ccf460a403d993c39327bbcbd29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '601361df39e34fcca71175aa94e425c4', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:32:13.531980 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7089a1-5c3c-46be-9cf4-d1db530733b0 service placement] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:32:13.532527 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7089a1-5c3c-46be-9cf4-d1db530733b0 service placement] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:32:13.532995 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7089a1-5c3c-46be-9cf4-d1db530733b0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:32:13.539486 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-cc7089a1-5c3c-46be-9cf4-d1db530733b0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:32:13.558301 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7089a1-5c3c-46be-9cf4-d1db530733b0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:32:13.560248 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7089a1-5c3c-46be-9cf4-d1db530733b0 service placement] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:32:13.577798 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1277/2548] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 12:32:13 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 12:32:17.573116 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b349a97c-9acf-4c83-9987-7bbd4ab07a2c service swift] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:32:17.575163 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-b349a97c-9acf-4c83-9987-7bbd4ab07a2c service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:32:17.661585 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b349a97c-9acf-4c83-9987-7bbd4ab07a2c service swift] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:32:17.666238 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa61ef6-d4f7-4ea5-a385-226b828d87fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:32:17.667182 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa61ef6-d4f7-4ea5-a385-226b828d87fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:32:17.667568 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa61ef6-d4f7-4ea5-a385-226b828d87fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:32:17.667904 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa61ef6-d4f7-4ea5-a385-226b828d87fe admin admin] PATH_INFO: `/v3/users/1eeb134860684ab0a4b2477e97f04caf` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:32:17.669224 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa61ef6-d4f7-4ea5-a385-226b828d87fe admin admin] RBAC: Authorizing `identity:delete_user(user_id=1eeb134860684ab0a4b2477e97f04caf)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:32:17.671235 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa61ef6-d4f7-4ea5-a385-226b828d87fe admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:32:17.724611 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-efa61ef6-d4f7-4ea5-a385-226b828d87fe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1eeb134860684ab0a4b2477e97f04caf'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:32:17.743374 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-efa61ef6-d4f7-4ea5-a385-226b828d87fe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1eeb134860684ab0a4b2477e97f04caf'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:32:17.750638 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-efa61ef6-d4f7-4ea5-a385-226b828d87fe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1eeb134860684ab0a4b2477e97f04caf'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:32:17.752127 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-efa61ef6-d4f7-4ea5-a385-226b828d87fe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1eeb134860684ab0a4b2477e97f04caf'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:32:17.753173 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-efa61ef6-d4f7-4ea5-a385-226b828d87fe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1eeb134860684ab0a4b2477e97f04caf'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:32:17.768341 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1272/2549] 10.222.0.44 () {58 vars in 1223 bytes} [Thu Jun 16 12:32:17 2022] DELETE /identity/v3/users/1eeb134860684ab0a4b2477e97f04caf => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:32:17.965476 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7089a1-5c3c-46be-9cf4-d1db530733b0 service placement] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:32:17.989828 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7089a1-5c3c-46be-9cf4-d1db530733b0 service placement] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:32:18.088820 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a96363a-150d-4ad5-a9ee-a1028e4b1b3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:32:18.089727 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a96363a-150d-4ad5-a9ee-a1028e4b1b3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:32:18.090073 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a96363a-150d-4ad5-a9ee-a1028e4b1b3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:32:18.090416 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a96363a-150d-4ad5-a9ee-a1028e4b1b3b admin admin] PATH_INFO: `/v3/projects/648dcd7b1d814429a17ba5365b4882bd` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:32:18.091699 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a96363a-150d-4ad5-a9ee-a1028e4b1b3b admin admin] RBAC: Authorizing `identity:delete_project(project_id=648dcd7b1d814429a17ba5365b4882bd)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:32:18.093858 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a96363a-150d-4ad5-a9ee-a1028e4b1b3b admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:32:18.164647 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-1a96363a-150d-4ad5-a9ee-a1028e4b1b3b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '648dcd7b1d814429a17ba5365b4882bd', 'request_id': 'req-1a96363a-150d-4ad5-a9ee-a1028e4b1b3b'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:32:18.173514 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-1a96363a-150d-4ad5-a9ee-a1028e4b1b3b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '648dcd7b1d814429a17ba5365b4882bd', 'request_id': 'req-1a96363a-150d-4ad5-a9ee-a1028e4b1b3b'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:32:18.181389 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-1a96363a-150d-4ad5-a9ee-a1028e4b1b3b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '648dcd7b1d814429a17ba5365b4882bd', 'request_id': 'req-1a96363a-150d-4ad5-a9ee-a1028e4b1b3b'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:32:18.194243 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-1a96363a-150d-4ad5-a9ee-a1028e4b1b3b admin admin] The token cache is being invalidate because project 648dcd7b1d814429a17ba5365b4882bd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 12:32:18.194621 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-1a96363a-150d-4ad5-a9ee-a1028e4b1b3b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:32:18.195352 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-1a96363a-150d-4ad5-a9ee-a1028e4b1b3b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:32:18.201103 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa61ef6-d4f7-4ea5-a385-226b828d87fe admin admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:32:18.201634 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1278/2550] 10.222.0.44 () {58 vars in 1232 bytes} [Thu Jun 16 12:32:17 2022] DELETE /identity/v3/projects/648dcd7b1d814429a17ba5365b4882bd => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:32:18.202541 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-efa61ef6-d4f7-4ea5-a385-226b828d87fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:32:18.216289 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa61ef6-d4f7-4ea5-a385-226b828d87fe admin admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:32:18.221892 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:32:18.283128 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2800c0bf-55a3-44cf-8ec2-e596a6b3f458 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:32:18.284131 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2800c0bf-55a3-44cf-8ec2-e596a6b3f458 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:32:18.284472 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2800c0bf-55a3-44cf-8ec2-e596a6b3f458 admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:32:18.285407 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2800c0bf-55a3-44cf-8ec2-e596a6b3f458 admin admin] PATH_INFO: `/v3/users/d907b5796c3c47b5814f52f6c54bda8c` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:32:18.286691 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2800c0bf-55a3-44cf-8ec2-e596a6b3f458 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d907b5796c3c47b5814f52f6c54bda8c)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:32:18.288686 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2800c0bf-55a3-44cf-8ec2-e596a6b3f458 admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:32:18.340398 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-2800c0bf-55a3-44cf-8ec2-e596a6b3f458 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd907b5796c3c47b5814f52f6c54bda8c'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:32:18.354613 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-2800c0bf-55a3-44cf-8ec2-e596a6b3f458 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd907b5796c3c47b5814f52f6c54bda8c'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:32:18.364419 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-2800c0bf-55a3-44cf-8ec2-e596a6b3f458 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd907b5796c3c47b5814f52f6c54bda8c'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:32:18.365322 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-2800c0bf-55a3-44cf-8ec2-e596a6b3f458 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd907b5796c3c47b5814f52f6c54bda8c'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:32:18.366474 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-2800c0bf-55a3-44cf-8ec2-e596a6b3f458 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd907b5796c3c47b5814f52f6c54bda8c'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:32:18.384415 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1273/2551] 10.222.0.44 () {58 vars in 1223 bytes} [Thu Jun 16 12:32:18 2022] DELETE /identity/v3/users/d907b5796c3c47b5814f52f6c54bda8c => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:32:18.574905 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a96363a-150d-4ad5-a9ee-a1028e4b1b3b admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:32:18.576484 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-1a96363a-150d-4ad5-a9ee-a1028e4b1b3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:32:18.592191 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a96363a-150d-4ad5-a9ee-a1028e4b1b3b admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:32:18.610695 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:32:18.682410 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a687b3e9-31ec-4a9c-9c7b-ed1f7b1f929a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:32:18.683282 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a687b3e9-31ec-4a9c-9c7b-ed1f7b1f929a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:32:18.683563 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a687b3e9-31ec-4a9c-9c7b-ed1f7b1f929a admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:32:18.683835 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a687b3e9-31ec-4a9c-9c7b-ed1f7b1f929a admin admin] PATH_INFO: `/v3/projects/3a01bd9ca596488ead66db704730f1ff` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:32:18.685142 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a687b3e9-31ec-4a9c-9c7b-ed1f7b1f929a admin admin] RBAC: Authorizing `identity:delete_project(project_id=3a01bd9ca596488ead66db704730f1ff)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:32:18.687087 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a687b3e9-31ec-4a9c-9c7b-ed1f7b1f929a admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:32:18.755557 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-a687b3e9-31ec-4a9c-9c7b-ed1f7b1f929a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3a01bd9ca596488ead66db704730f1ff', 'request_id': 'req-a687b3e9-31ec-4a9c-9c7b-ed1f7b1f929a'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:32:18.764793 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-a687b3e9-31ec-4a9c-9c7b-ed1f7b1f929a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3a01bd9ca596488ead66db704730f1ff', 'request_id': 'req-a687b3e9-31ec-4a9c-9c7b-ed1f7b1f929a'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:32:18.770863 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-a687b3e9-31ec-4a9c-9c7b-ed1f7b1f929a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3a01bd9ca596488ead66db704730f1ff', 'request_id': 'req-a687b3e9-31ec-4a9c-9c7b-ed1f7b1f929a'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:32:18.783028 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-a687b3e9-31ec-4a9c-9c7b-ed1f7b1f929a admin admin] The token cache is being invalidate because project 3a01bd9ca596488ead66db704730f1ff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 12:32:18.783315 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-a687b3e9-31ec-4a9c-9c7b-ed1f7b1f929a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:32:18.783986 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-a687b3e9-31ec-4a9c-9c7b-ed1f7b1f929a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:32:18.785827 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1279/2552] 10.222.0.44 () {58 vars in 1232 bytes} [Thu Jun 16 12:32:18 2022] DELETE /identity/v3/projects/3a01bd9ca596488ead66db704730f1ff => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 12:32:25.012364 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2800c0bf-55a3-44cf-8ec2-e596a6b3f458 admin admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:32:25.014052 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-2800c0bf-55a3-44cf-8ec2-e596a6b3f458 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:32:25.090617 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2800c0bf-55a3-44cf-8ec2-e596a6b3f458 admin admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:32:25.115513 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:32:25.158104 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bb04cc-0d03-4212-b635-e47fe13067af service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edfb12d445e74136b90800e93941f468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '601361df39e34fcca71175aa94e425c4', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:32:25.158675 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bb04cc-0d03-4212-b635-e47fe13067af service nova] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:32:25.158951 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bb04cc-0d03-4212-b635-e47fe13067af service nova] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:32:25.159257 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bb04cc-0d03-4212-b635-e47fe13067af service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:32:25.161595 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-b0bb04cc-0d03-4212-b635-e47fe13067af service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:32:25.173481 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bb04cc-0d03-4212-b635-e47fe13067af service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:32:25.175155 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bb04cc-0d03-4212-b635-e47fe13067af service nova] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:32:25.185565 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1274/2553] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 12:32:25 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 12:32:25.994486 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a687b3e9-31ec-4a9c-9c7b-ed1f7b1f929a admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:32:25.995904 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-a687b3e9-31ec-4a9c-9c7b-ed1f7b1f929a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:32:26.053868 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a687b3e9-31ec-4a9c-9c7b-ed1f7b1f929a admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:32:26.057532 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1e3b98-44a1-4a85-9c21-66abfeab2e3b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1094729b25a4be7b0b394998c9ca681', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '601361df39e34fcca71175aa94e425c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:32:26.058178 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1e3b98-44a1-4a85-9c21-66abfeab2e3b service neutron] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:32:26.058460 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1e3b98-44a1-4a85-9c21-66abfeab2e3b service neutron] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:32:26.058736 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1e3b98-44a1-4a85-9c21-66abfeab2e3b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:32:26.060519 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-dc1e3b98-44a1-4a85-9c21-66abfeab2e3b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:32:26.070588 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1e3b98-44a1-4a85-9c21-66abfeab2e3b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:32:26.072014 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1e3b98-44a1-4a85-9c21-66abfeab2e3b service neutron] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:32:26.079936 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1280/2554] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 12:32:25 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 12:32:26.183013 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9be0b0-82ab-438e-a236-27adcc8e74cc None None] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:32:26.183571 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9be0b0-82ab-438e-a236-27adcc8e74cc None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:32:26.183697 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9be0b0-82ab-438e-a236-27adcc8e74cc None None] PATH_INFO: `/` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:32:26.185240 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1275/2555] 10.222.0.44 () {54 vars in 921 bytes} [Thu Jun 16 12:32:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 12:32:26.191058 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a31cb62-af0d-47f6-8ed0-67d1a0670e54 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:32:26.191371 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a31cb62-af0d-47f6-8ed0-67d1a0670e54 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:32:26.191632 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a31cb62-af0d-47f6-8ed0-67d1a0670e54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:32:26.210237 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-7a31cb62-af0d-47f6-8ed0-67d1a0670e54 None None] MFA Rules not processed for user `edfb12d445e74136b90800e93941f468`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:32:26.211442 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-7a31cb62-af0d-47f6-8ed0-67d1a0670e54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:32:26.220834 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1281/2556] 10.222.0.44 () {58 vars in 1018 bytes} [Thu Jun 16 12:32:26 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:32:26.234333 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9be0b0-82ab-438e-a236-27adcc8e74cc None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:32:26.236137 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-2c9be0b0-82ab-438e-a236-27adcc8e74cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:32:26.320402 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9be0b0-82ab-438e-a236-27adcc8e74cc None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:32:26.323977 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a7dcad-3514-47d4-91f0-ab501a921ec2 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42dedbccc64747d581c862a69ae20941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '601361df39e34fcca71175aa94e425c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:32:26.324622 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a7dcad-3514-47d4-91f0-ab501a921ec2 service glance] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:32:26.325005 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a7dcad-3514-47d4-91f0-ab501a921ec2 service glance] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:32:26.325282 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a7dcad-3514-47d4-91f0-ab501a921ec2 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:32:26.335348 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a7dcad-3514-47d4-91f0-ab501a921ec2 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:32:26.336780 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a7dcad-3514-47d4-91f0-ab501a921ec2 service glance] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:32:26.347892 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1276/2557] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 12:32:26 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 12:32:26.412281 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ec0446-5346-4c0f-83f6-f0bec428ca3e None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:32:26.412564 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ec0446-5346-4c0f-83f6-f0bec428ca3e None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:32:26.412876 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ec0446-5346-4c0f-83f6-f0bec428ca3e None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:32:26.414248 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1282/2558] 10.222.0.44 () {54 vars in 921 bytes} [Thu Jun 16 12:32:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 12:32:26.419112 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafdbe11-ca48-40b0-9063-7cddcde3fdb8 None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:32:26.419432 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafdbe11-ca48-40b0-9063-7cddcde3fdb8 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:32:26.419713 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafdbe11-ca48-40b0-9063-7cddcde3fdb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:32:26.439149 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-dafdbe11-ca48-40b0-9063-7cddcde3fdb8 None None] MFA Rules not processed for user `e1094729b25a4be7b0b394998c9ca681`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:32:26.440292 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-dafdbe11-ca48-40b0-9063-7cddcde3fdb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:32:26.446917 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1277/2559] 10.222.0.44 () {58 vars in 1018 bytes} [Thu Jun 16 12:32:26 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:32:26.459193 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ec0446-5346-4c0f-83f6-f0bec428ca3e None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:32:26.460851 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-12ec0446-5346-4c0f-83f6-f0bec428ca3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:32:26.474359 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ec0446-5346-4c0f-83f6-f0bec428ca3e None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:32:26.477780 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cae2c71-93ad-4c76-9e07-7a5f60f5bb44 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1094729b25a4be7b0b394998c9ca681', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '601361df39e34fcca71175aa94e425c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:32:26.478401 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cae2c71-93ad-4c76-9e07-7a5f60f5bb44 service neutron] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:32:26.478676 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cae2c71-93ad-4c76-9e07-7a5f60f5bb44 service neutron] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:32:26.478944 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cae2c71-93ad-4c76-9e07-7a5f60f5bb44 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:32:26.485846 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cae2c71-93ad-4c76-9e07-7a5f60f5bb44 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:32:26.487257 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cae2c71-93ad-4c76-9e07-7a5f60f5bb44 service neutron] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:32:26.494783 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1283/2560] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 12:32:26 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 12:32:26.605647 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3987087-0c31-47e9-ab47-45e11f48b9a3 None None] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:32:26.605934 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3987087-0c31-47e9-ab47-45e11f48b9a3 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:32:26.606209 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3987087-0c31-47e9-ab47-45e11f48b9a3 None None] PATH_INFO: `/` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:32:26.607602 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1278/2561] 10.222.0.44 () {54 vars in 921 bytes} [Thu Jun 16 12:32:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 12:32:26.613144 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0408ed-2419-429f-8af7-439bc8b62647 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:32:26.613429 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0408ed-2419-429f-8af7-439bc8b62647 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:32:26.613701 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0408ed-2419-429f-8af7-439bc8b62647 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:32:26.632212 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-fd0408ed-2419-429f-8af7-439bc8b62647 None None] MFA Rules not processed for user `edfb12d445e74136b90800e93941f468`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:32:26.633431 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-fd0408ed-2419-429f-8af7-439bc8b62647 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:32:26.642842 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1284/2562] 10.222.0.44 () {58 vars in 1018 bytes} [Thu Jun 16 12:32:26 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:32:26.653262 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3987087-0c31-47e9-ab47-45e11f48b9a3 None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:32:26.663952 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3987087-0c31-47e9-ab47-45e11f48b9a3 None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:32:26.667363 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8731e6b8-a687-4a0f-9218-a82943ac52d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1094729b25a4be7b0b394998c9ca681', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '601361df39e34fcca71175aa94e425c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:32:26.667988 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8731e6b8-a687-4a0f-9218-a82943ac52d5 service neutron] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:32:26.668268 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8731e6b8-a687-4a0f-9218-a82943ac52d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:32:26.668536 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8731e6b8-a687-4a0f-9218-a82943ac52d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:32:26.679011 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8731e6b8-a687-4a0f-9218-a82943ac52d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:32:26.680421 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8731e6b8-a687-4a0f-9218-a82943ac52d5 service neutron] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:32:26.691542 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1279/2563] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 12:32:26 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 12:32:26.754582 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0408ed-2419-429f-8af7-439bc8b62647 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:32:26.755998 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-fd0408ed-2419-429f-8af7-439bc8b62647 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:32:26.783515 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:32:26.825756 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0408ed-2419-429f-8af7-439bc8b62647 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:32:26.830804 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76d6d21-d605-4865-8847-3410cf0759fc service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8bff8ccf460a403d993c39327bbcbd29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '601361df39e34fcca71175aa94e425c4', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:32:26.832109 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76d6d21-d605-4865-8847-3410cf0759fc service placement] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:32:26.832388 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76d6d21-d605-4865-8847-3410cf0759fc service placement] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:32:26.832660 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76d6d21-d605-4865-8847-3410cf0759fc service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:32:26.834594 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-f76d6d21-d605-4865-8847-3410cf0759fc service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:32:26.845948 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76d6d21-d605-4865-8847-3410cf0759fc service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:32:26.847534 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76d6d21-d605-4865-8847-3410cf0759fc service placement] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:32:26.857334 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1285/2564] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 12:32:26 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 12:32:28.575763 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a8ce9b-d92b-4b4f-aa75-9295da38d15b None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:32:28.576259 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a8ce9b-d92b-4b4f-aa75-9295da38d15b None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:32:28.576351 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a8ce9b-d92b-4b4f-aa75-9295da38d15b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:32:28.594171 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-b8a8ce9b-d92b-4b4f-aa75-9295da38d15b None None] MFA Rules not processed for user `222b53cae3d64412b9b0a89d162311f4`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:32:28.595431 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-b8a8ce9b-d92b-4b4f-aa75-9295da38d15b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:32:28.655145 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1280/2565] 10.222.0.44 () {58 vars in 1009 bytes} [Thu Jun 16 12:32:28 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:32:28.666996 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76d6d21-d605-4865-8847-3410cf0759fc service placement] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:32:28.668379 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-f76d6d21-d605-4865-8847-3410cf0759fc service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:32:28.735136 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76d6d21-d605-4865-8847-3410cf0759fc service placement] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:32:28.740636 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fff6b0-508a-47fd-a0ef-9aed19acc5cf service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c159f79c1921496487101aac5d530ae5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '601361df39e34fcca71175aa94e425c4', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:32:28.741297 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fff6b0-508a-47fd-a0ef-9aed19acc5cf service swift] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:32:28.741594 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fff6b0-508a-47fd-a0ef-9aed19acc5cf service swift] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:32:28.741862 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fff6b0-508a-47fd-a0ef-9aed19acc5cf service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:32:28.749823 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fff6b0-508a-47fd-a0ef-9aed19acc5cf service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:32:28.751315 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fff6b0-508a-47fd-a0ef-9aed19acc5cf service swift] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:32:28.759801 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1286/2566] 10.222.0.44 () {60 vars in 1384 bytes} [Thu Jun 16 12:32:28 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 16 12:32:38.648143 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=91 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:32:38.756635 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=53 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:32:42.839517 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7b924e-7bf7-4b37-a92d-9f45879efc47 None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:32:42.839965 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7b924e-7bf7-4b37-a92d-9f45879efc47 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:32:42.840075 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7b924e-7bf7-4b37-a92d-9f45879efc47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:32:42.859715 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-6d7b924e-7bf7-4b37-a92d-9f45879efc47 None None] MFA Rules not processed for user `222b53cae3d64412b9b0a89d162311f4`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:32:42.860958 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-6d7b924e-7bf7-4b37-a92d-9f45879efc47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:32:42.868700 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1281/2567] 10.222.0.44 () {58 vars in 967 bytes} [Thu Jun 16 12:32:42 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:32:42.883405 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fff6b0-508a-47fd-a0ef-9aed19acc5cf service swift] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:32:42.894795 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fff6b0-508a-47fd-a0ef-9aed19acc5cf service swift] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:32:42.899769 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12c85fa-62c7-4430-be7b-62fef4d4a0e7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c159f79c1921496487101aac5d530ae5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '601361df39e34fcca71175aa94e425c4', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:32:42.900415 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12c85fa-62c7-4430-be7b-62fef4d4a0e7 service swift] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:32:42.900710 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12c85fa-62c7-4430-be7b-62fef4d4a0e7 service swift] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:32:42.901269 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12c85fa-62c7-4430-be7b-62fef4d4a0e7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:32:42.909309 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12c85fa-62c7-4430-be7b-62fef4d4a0e7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:32:42.910897 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12c85fa-62c7-4430-be7b-62fef4d4a0e7 service swift] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:32:42.918905 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1287/2568] 10.222.0.44 () {60 vars in 1384 bytes} [Thu Jun 16 12:32:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 16 12:32:49.232362 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7b924e-7bf7-4b37-a92d-9f45879efc47 None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:32:49.233868 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-6d7b924e-7bf7-4b37-a92d-9f45879efc47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:32:49.250497 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7b924e-7bf7-4b37-a92d-9f45879efc47 None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:32:49.258678 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cd6e79-6d7e-4647-991e-cfcb4ea6e2e5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edfb12d445e74136b90800e93941f468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '601361df39e34fcca71175aa94e425c4', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:32:49.259891 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cd6e79-6d7e-4647-991e-cfcb4ea6e2e5 service nova] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:32:49.260246 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cd6e79-6d7e-4647-991e-cfcb4ea6e2e5 service nova] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:32:49.260591 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cd6e79-6d7e-4647-991e-cfcb4ea6e2e5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:32:49.262532 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-f7cd6e79-6d7e-4647-991e-cfcb4ea6e2e5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:32:49.275383 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cd6e79-6d7e-4647-991e-cfcb4ea6e2e5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:32:49.277340 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cd6e79-6d7e-4647-991e-cfcb4ea6e2e5 service nova] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:32:49.289346 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1282/2569] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 12:32:49 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 12:32:52.915726 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=6 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:32:54.252713 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12c85fa-62c7-4430-be7b-62fef4d4a0e7 service swift] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:32:54.262611 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12c85fa-62c7-4430-be7b-62fef4d4a0e7 service swift] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:32:54.266159 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf3d030-4cf6-4e4b-9341-3c7fbca03664 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1094729b25a4be7b0b394998c9ca681', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '601361df39e34fcca71175aa94e425c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:32:54.266785 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf3d030-4cf6-4e4b-9341-3c7fbca03664 service neutron] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:32:54.267062 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf3d030-4cf6-4e4b-9341-3c7fbca03664 service neutron] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:32:54.267334 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf3d030-4cf6-4e4b-9341-3c7fbca03664 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:32:54.269118 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-ccf3d030-4cf6-4e4b-9341-3c7fbca03664 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:32:54.330811 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf3d030-4cf6-4e4b-9341-3c7fbca03664 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:32:54.332274 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf3d030-4cf6-4e4b-9341-3c7fbca03664 service neutron] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:32:54.345090 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1288/2570] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 12:32:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 12:32:57.310747 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cd6e79-6d7e-4647-991e-cfcb4ea6e2e5 service nova] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:32:57.312265 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-f7cd6e79-6d7e-4647-991e-cfcb4ea6e2e5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:32:57.326993 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cd6e79-6d7e-4647-991e-cfcb4ea6e2e5 service nova] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:32:57.331743 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee00332-a008-45f9-a2d7-78c88b7862c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:32:57.332822 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee00332-a008-45f9-a2d7-78c88b7862c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:32:57.333103 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee00332-a008-45f9-a2d7-78c88b7862c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:32:57.333376 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee00332-a008-45f9-a2d7-78c88b7862c2 admin admin] PATH_INFO: `/v3/users/ec95d8dfa98b4d3db7edaad4e37925b4` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:32:57.334580 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee00332-a008-45f9-a2d7-78c88b7862c2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ec95d8dfa98b4d3db7edaad4e37925b4)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:32:57.336494 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee00332-a008-45f9-a2d7-78c88b7862c2 admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:32:57.386294 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-aee00332-a008-45f9-a2d7-78c88b7862c2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ec95d8dfa98b4d3db7edaad4e37925b4'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:32:57.398244 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-aee00332-a008-45f9-a2d7-78c88b7862c2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ec95d8dfa98b4d3db7edaad4e37925b4'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:32:57.405401 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-aee00332-a008-45f9-a2d7-78c88b7862c2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ec95d8dfa98b4d3db7edaad4e37925b4'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:32:57.406089 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-aee00332-a008-45f9-a2d7-78c88b7862c2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ec95d8dfa98b4d3db7edaad4e37925b4'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:32:57.406685 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-aee00332-a008-45f9-a2d7-78c88b7862c2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ec95d8dfa98b4d3db7edaad4e37925b4'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:32:57.418816 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1283/2571] 10.222.0.44 () {58 vars in 1223 bytes} [Thu Jun 16 12:32:57 2022] DELETE /identity/v3/users/ec95d8dfa98b4d3db7edaad4e37925b4 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:32:57.588611 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf3d030-4cf6-4e4b-9341-3c7fbca03664 service neutron] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:32:57.598945 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf3d030-4cf6-4e4b-9341-3c7fbca03664 service neutron] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:32:57.657835 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5017746-7f1e-426d-8d82-66a8680806ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:32:57.658691 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5017746-7f1e-426d-8d82-66a8680806ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:32:57.658969 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5017746-7f1e-426d-8d82-66a8680806ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:32:57.659242 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5017746-7f1e-426d-8d82-66a8680806ab admin admin] PATH_INFO: `/v3/projects/ddfe22d9f67f42868c09938f3039e6e8` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:32:57.660920 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5017746-7f1e-426d-8d82-66a8680806ab admin admin] RBAC: Authorizing `identity:delete_project(project_id=ddfe22d9f67f42868c09938f3039e6e8)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:32:57.662862 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5017746-7f1e-426d-8d82-66a8680806ab admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:32:57.707375 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-e5017746-7f1e-426d-8d82-66a8680806ab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ddfe22d9f67f42868c09938f3039e6e8', 'request_id': 'req-e5017746-7f1e-426d-8d82-66a8680806ab'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:32:57.714469 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-e5017746-7f1e-426d-8d82-66a8680806ab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ddfe22d9f67f42868c09938f3039e6e8', 'request_id': 'req-e5017746-7f1e-426d-8d82-66a8680806ab'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:32:57.719956 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-e5017746-7f1e-426d-8d82-66a8680806ab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ddfe22d9f67f42868c09938f3039e6e8', 'request_id': 'req-e5017746-7f1e-426d-8d82-66a8680806ab'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:32:57.731014 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-e5017746-7f1e-426d-8d82-66a8680806ab admin admin] The token cache is being invalidate because project ddfe22d9f67f42868c09938f3039e6e8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 12:32:57.731298 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-e5017746-7f1e-426d-8d82-66a8680806ab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:32:57.731949 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-e5017746-7f1e-426d-8d82-66a8680806ab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:32:57.733503 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1289/2572] 10.222.0.44 () {58 vars in 1232 bytes} [Thu Jun 16 12:32:57 2022] DELETE /identity/v3/projects/ddfe22d9f67f42868c09938f3039e6e8 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:32:57.738416 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f6dca6-c052-4219-82b7-6fda0bb90519 None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:32:57.739440 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f6dca6-c052-4219-82b7-6fda0bb90519 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:32:57.739793 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f6dca6-c052-4219-82b7-6fda0bb90519 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:32:57.757628 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-94f6dca6-c052-4219-82b7-6fda0bb90519 None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:32:57.758840 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-94f6dca6-c052-4219-82b7-6fda0bb90519 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:32:57.818067 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1284/2573] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 12:32:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:32:57.825990 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a8edd7-75a3-4949-9cd6-529276d2340a None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:32:57.826278 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a8edd7-75a3-4949-9cd6-529276d2340a None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:32:57.826559 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a8edd7-75a3-4949-9cd6-529276d2340a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:32:57.846142 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-07a8edd7-75a3-4949-9cd6-529276d2340a None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:32:57.847294 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-07a8edd7-75a3-4949-9cd6-529276d2340a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:32:57.855828 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1290/2574] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 12:32:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:32:57.859817 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f6dca6-c052-4219-82b7-6fda0bb90519 None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:32:57.869401 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f6dca6-c052-4219-82b7-6fda0bb90519 None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:32:57.873918 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfdaeae-9440-4947-a016-7596073e9292 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:32:57.874564 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfdaeae-9440-4947-a016-7596073e9292 admin admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:32:57.874862 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfdaeae-9440-4947-a016-7596073e9292 admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:32:57.875133 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfdaeae-9440-4947-a016-7596073e9292 admin admin] PATH_INFO: `/v3/domains` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:32:57.875854 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfdaeae-9440-4947-a016-7596073e9292 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:32:57.876155 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfdaeae-9440-4947-a016-7596073e9292 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:32:57.877788 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfdaeae-9440-4947-a016-7596073e9292 admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:32:57.889369 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1285/2575] 10.222.0.44 () {58 vars in 1152 bytes} [Thu Jun 16 12:32:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:32:57.893523 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a8edd7-75a3-4949-9cd6-529276d2340a None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:32:57.903427 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a8edd7-75a3-4949-9cd6-529276d2340a None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:32:57.908139 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2973146-04a7-4adc-bb4e-047c6e21742b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:32:57.908811 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2973146-04a7-4adc-bb4e-047c6e21742b admin admin] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:32:57.909099 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2973146-04a7-4adc-bb4e-047c6e21742b admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:32:57.909377 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2973146-04a7-4adc-bb4e-047c6e21742b admin admin] PATH_INFO: `/v3/projects` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:32:57.910058 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2973146-04a7-4adc-bb4e-047c6e21742b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:32:57.912587 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2973146-04a7-4adc-bb4e-047c6e21742b admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:32:57.926767 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:32:57.940490 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1291/2576] 10.222.0.44 () {60 vars in 1152 bytes} [Thu Jun 16 12:32:57 2022] POST /identity/v3/projects => generated 363 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 12:32:57.944579 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfdaeae-9440-4947-a016-7596073e9292 admin admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:32:57.954680 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfdaeae-9440-4947-a016-7596073e9292 admin admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:32:57.993449 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:32:58.013181 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0547ba2f-a017-4bf4-99f3-8590682a25eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:32:58.013846 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0547ba2f-a017-4bf4-99f3-8590682a25eb admin admin] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:32:58.014130 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0547ba2f-a017-4bf4-99f3-8590682a25eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:32:58.014423 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0547ba2f-a017-4bf4-99f3-8590682a25eb admin admin] PATH_INFO: `/v3/users` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:32:58.015105 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0547ba2f-a017-4bf4-99f3-8590682a25eb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:32:58.017043 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0547ba2f-a017-4bf4-99f3-8590682a25eb admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:32:58.037364 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1286/2577] 10.222.0.44 () {60 vars in 1143 bytes} [Thu Jun 16 12:32:57 2022] POST /identity/v3/users => generated 282 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 12:32:58.041517 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2973146-04a7-4adc-bb4e-047c6e21742b admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:32:58.051685 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2973146-04a7-4adc-bb4e-047c6e21742b admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:32:58.056241 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd212744-429e-4f7b-9269-e52d8cd230a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:32:58.056932 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd212744-429e-4f7b-9269-e52d8cd230a8 admin admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:32:58.057215 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd212744-429e-4f7b-9269-e52d8cd230a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:32:58.057490 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd212744-429e-4f7b-9269-e52d8cd230a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:32:58.058210 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd212744-429e-4f7b-9269-e52d8cd230a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:32:58.059809 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd212744-429e-4f7b-9269-e52d8cd230a8 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:32:58.069936 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1292/2578] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 12:32:58 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 12:32:58.073710 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0547ba2f-a017-4bf4-99f3-8590682a25eb admin admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:32:58.083890 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0547ba2f-a017-4bf4-99f3-8590682a25eb admin admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:32:58.088519 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28144328-30c4-4ee1-a0ae-5307850ccb61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:32:58.089197 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28144328-30c4-4ee1-a0ae-5307850ccb61 admin admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:32:58.089482 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28144328-30c4-4ee1-a0ae-5307850ccb61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:32:58.089759 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28144328-30c4-4ee1-a0ae-5307850ccb61 admin admin] PATH_INFO: `/v3/roles` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:32:58.090486 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28144328-30c4-4ee1-a0ae-5307850ccb61 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:32:58.092345 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28144328-30c4-4ee1-a0ae-5307850ccb61 admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:32:58.103693 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1287/2579] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 12:32:58 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 12:32:58.107643 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd212744-429e-4f7b-9269-e52d8cd230a8 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:32:58.117559 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd212744-429e-4f7b-9269-e52d8cd230a8 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:32:58.123366 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ac9384-d43f-4146-be83-a7d1d6cb63ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:32:58.124158 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ac9384-d43f-4146-be83-a7d1d6cb63ba admin admin] REQUEST_METHOD: `PUT` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:32:58.124448 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ac9384-d43f-4146-be83-a7d1d6cb63ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:32:58.124836 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ac9384-d43f-4146-be83-a7d1d6cb63ba admin admin] PATH_INFO: `/v3/projects/0f6b1453179d4cc496fdc16b91e6907e/users/7d623925d0d146cd86db30b68b1ce223/roles/c39882b202e942479a7cdac2fc6da72c` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:32:58.141672 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ac9384-d43f-4146-be83-a7d1d6cb63ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f6b1453179d4cc496fdc16b91e6907e, user_id=7d623925d0d146cd86db30b68b1ce223, role_id=c39882b202e942479a7cdac2fc6da72c)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:32:58.144341 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ac9384-d43f-4146-be83-a7d1d6cb63ba admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:32:58.157748 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1293/2580] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 16 12:32:58 2022] PUT /identity/v3/projects/0f6b1453179d4cc496fdc16b91e6907e/users/7d623925d0d146cd86db30b68b1ce223/roles/c39882b202e942479a7cdac2fc6da72c => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:32:58.170187 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8d95c0-4e19-4a68-8380-46eaa1477a84 None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:32:58.170480 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8d95c0-4e19-4a68-8380-46eaa1477a84 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:32:58.170786 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8d95c0-4e19-4a68-8380-46eaa1477a84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:32:58.196842 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-9b8d95c0-4e19-4a68-8380-46eaa1477a84 None None] MFA Rules not processed for user `7d623925d0d146cd86db30b68b1ce223`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:32:58.198061 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-9b8d95c0-4e19-4a68-8380-46eaa1477a84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:32:58.261102 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1288/2581] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 12:32:58 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:32:58.266463 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ac9384-d43f-4146-be83-a7d1d6cb63ba admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:32:58.327725 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ac9384-d43f-4146-be83-a7d1d6cb63ba admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:32:58.333189 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc98ff7d-2d20-4914-a9df-1f4f482ab9d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:32:58.333844 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc98ff7d-2d20-4914-a9df-1f4f482ab9d7 admin admin] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:32:58.334153 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc98ff7d-2d20-4914-a9df-1f4f482ab9d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:32:58.334429 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc98ff7d-2d20-4914-a9df-1f4f482ab9d7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:32:58.335124 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc98ff7d-2d20-4914-a9df-1f4f482ab9d7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:32:58.337069 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc98ff7d-2d20-4914-a9df-1f4f482ab9d7 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:32:58.371127 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1294/2582] 10.222.0.44 () {60 vars in 1152 bytes} [Thu Jun 16 12:32:58 2022] POST /identity/v3/projects => generated 365 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 12:32:58.375056 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8d95c0-4e19-4a68-8380-46eaa1477a84 None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:32:58.386181 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8d95c0-4e19-4a68-8380-46eaa1477a84 None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:32:58.441073 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90f5bc4-a6c3-455a-bd25-6bb5bd9a9e9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:32:58.442233 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90f5bc4-a6c3-455a-bd25-6bb5bd9a9e9a admin admin] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:32:58.442511 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90f5bc4-a6c3-455a-bd25-6bb5bd9a9e9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:32:58.442784 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90f5bc4-a6c3-455a-bd25-6bb5bd9a9e9a admin admin] PATH_INFO: `/v3/users` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:32:58.443460 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90f5bc4-a6c3-455a-bd25-6bb5bd9a9e9a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:32:58.445406 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90f5bc4-a6c3-455a-bd25-6bb5bd9a9e9a admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:32:58.465854 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1289/2583] 10.222.0.44 () {60 vars in 1143 bytes} [Thu Jun 16 12:32:58 2022] POST /identity/v3/users => generated 289 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 12:32:58.469781 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc98ff7d-2d20-4914-a9df-1f4f482ab9d7 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:32:58.479858 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc98ff7d-2d20-4914-a9df-1f4f482ab9d7 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:32:58.484435 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927e5f75-2e3e-47cd-b1a8-cbbb09d66d8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:32:58.485193 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927e5f75-2e3e-47cd-b1a8-cbbb09d66d8b admin admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:32:58.485474 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927e5f75-2e3e-47cd-b1a8-cbbb09d66d8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:32:58.485748 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927e5f75-2e3e-47cd-b1a8-cbbb09d66d8b admin admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:32:58.486466 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927e5f75-2e3e-47cd-b1a8-cbbb09d66d8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:32:58.488054 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927e5f75-2e3e-47cd-b1a8-cbbb09d66d8b admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:32:58.497746 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1295/2584] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 12:32:58 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 12:32:58.501538 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90f5bc4-a6c3-455a-bd25-6bb5bd9a9e9a admin admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:32:58.511917 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90f5bc4-a6c3-455a-bd25-6bb5bd9a9e9a admin admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:32:58.516499 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c85e89-cad4-4328-aa41-6b9076e742fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:32:58.517399 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c85e89-cad4-4328-aa41-6b9076e742fe admin admin] REQUEST_METHOD: `PUT` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:32:58.517682 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c85e89-cad4-4328-aa41-6b9076e742fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:32:58.517958 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c85e89-cad4-4328-aa41-6b9076e742fe admin admin] PATH_INFO: `/v3/projects/e7a8769a8ac04197baffa725ebb46e48/users/cd0204231cb8451998a269f126c4ea57/roles/0688968254744e3f9913653cafea3091` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:32:58.533136 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c85e89-cad4-4328-aa41-6b9076e742fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=e7a8769a8ac04197baffa725ebb46e48, user_id=cd0204231cb8451998a269f126c4ea57, role_id=0688968254744e3f9913653cafea3091)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:32:58.535755 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c85e89-cad4-4328-aa41-6b9076e742fe admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:32:58.548633 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1290/2585] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 16 12:32:58 2022] PUT /identity/v3/projects/e7a8769a8ac04197baffa725ebb46e48/users/cd0204231cb8451998a269f126c4ea57/roles/0688968254744e3f9913653cafea3091 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:32:58.552688 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927e5f75-2e3e-47cd-b1a8-cbbb09d66d8b admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:32:58.562587 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927e5f75-2e3e-47cd-b1a8-cbbb09d66d8b admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:32:58.618237 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9515c618-2339-4d79-a8de-b70b9f242fd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:32:58.618921 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9515c618-2339-4d79-a8de-b70b9f242fd7 admin admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:32:58.619205 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9515c618-2339-4d79-a8de-b70b9f242fd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:32:58.619512 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9515c618-2339-4d79-a8de-b70b9f242fd7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:32:58.620254 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9515c618-2339-4d79-a8de-b70b9f242fd7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:32:58.621932 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9515c618-2339-4d79-a8de-b70b9f242fd7 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:32:58.631950 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1296/2586] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 12:32:58 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 12:32:58.636043 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c85e89-cad4-4328-aa41-6b9076e742fe admin admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:32:58.647679 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c85e89-cad4-4328-aa41-6b9076e742fe admin admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:32:58.652317 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badcf2f2-5a29-425b-b53f-6cd7f8f0b236 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:32:58.653256 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badcf2f2-5a29-425b-b53f-6cd7f8f0b236 admin admin] REQUEST_METHOD: `PUT` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:32:58.653561 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badcf2f2-5a29-425b-b53f-6cd7f8f0b236 admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:32:58.653847 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badcf2f2-5a29-425b-b53f-6cd7f8f0b236 admin admin] PATH_INFO: `/v3/projects/e7a8769a8ac04197baffa725ebb46e48/users/cd0204231cb8451998a269f126c4ea57/roles/0688968254744e3f9913653cafea3091` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:32:58.655827 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-badcf2f2-5a29-425b-b53f-6cd7f8f0b236 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e7a8769a8ac04197baffa725ebb46e48, user_id=cd0204231cb8451998a269f126c4ea57, role_id=0688968254744e3f9913653cafea3091)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:32:58.658516 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-badcf2f2-5a29-425b-b53f-6cd7f8f0b236 admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:32:58.665161 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:32:58.670014 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1291/2587] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 16 12:32:58 2022] PUT /identity/v3/projects/e7a8769a8ac04197baffa725ebb46e48/users/cd0204231cb8451998a269f126c4ea57/roles/0688968254744e3f9913653cafea3091 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:32:58.680249 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d80cbc-769f-4a5d-a24d-f37fa9faea04 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:32:58.680632 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d80cbc-769f-4a5d-a24d-f37fa9faea04 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:32:58.681009 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d80cbc-769f-4a5d-a24d-f37fa9faea04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:32:58.709658 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-a6d80cbc-769f-4a5d-a24d-f37fa9faea04 None None] MFA Rules not processed for user `cd0204231cb8451998a269f126c4ea57`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:32:58.710914 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-a6d80cbc-769f-4a5d-a24d-f37fa9faea04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:32:58.720306 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:32:58.780603 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1297/2588] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 12:32:58 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:32:58.792198 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badcf2f2-5a29-425b-b53f-6cd7f8f0b236 admin admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:32:58.793971 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-badcf2f2-5a29-425b-b53f-6cd7f8f0b236 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:32:58.850493 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badcf2f2-5a29-425b-b53f-6cd7f8f0b236 admin admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:32:58.854112 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0d09d6-70e8-4149-8f76-2d9ac731f1a5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f96fc14ed89478c8a8c2f11c87511e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '601361df39e34fcca71175aa94e425c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:32:58.854745 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0d09d6-70e8-4149-8f76-2d9ac731f1a5 service cinder] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:32:58.855026 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0d09d6-70e8-4149-8f76-2d9ac731f1a5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:32:58.855299 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0d09d6-70e8-4149-8f76-2d9ac731f1a5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:32:58.864143 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0d09d6-70e8-4149-8f76-2d9ac731f1a5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:32:58.866225 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0d09d6-70e8-4149-8f76-2d9ac731f1a5 service cinder] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:32:58.875547 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1292/2589] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 12:32:58 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 12:32:58.944805 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d80cbc-769f-4a5d-a24d-f37fa9faea04 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:32:58.954569 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d80cbc-769f-4a5d-a24d-f37fa9faea04 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:32:58.958233 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180c0bc0-c65b-4684-aa83-e5a5d813ec5a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f96fc14ed89478c8a8c2f11c87511e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '601361df39e34fcca71175aa94e425c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:32:58.958869 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180c0bc0-c65b-4684-aa83-e5a5d813ec5a service cinder] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:32:58.959645 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180c0bc0-c65b-4684-aa83-e5a5d813ec5a service cinder] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:32:58.959918 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180c0bc0-c65b-4684-aa83-e5a5d813ec5a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:32:59.016018 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180c0bc0-c65b-4684-aa83-e5a5d813ec5a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:32:59.017475 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180c0bc0-c65b-4684-aa83-e5a5d813ec5a service cinder] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:32:59.026873 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1298/2590] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 12:32:58 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 12:33:01.693923 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0d09d6-70e8-4149-8f76-2d9ac731f1a5 service cinder] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:33:01.754509 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0d09d6-70e8-4149-8f76-2d9ac731f1a5 service cinder] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:33:01.759020 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b3e49f-4d92-451d-a5a5-2a5e18c2b334 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:33:01.759870 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b3e49f-4d92-451d-a5a5-2a5e18c2b334 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:33:01.760147 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b3e49f-4d92-451d-a5a5-2a5e18c2b334 admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:33:01.760432 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b3e49f-4d92-451d-a5a5-2a5e18c2b334 admin admin] PATH_INFO: `/v3/users/7d623925d0d146cd86db30b68b1ce223` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:33:01.761616 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b3e49f-4d92-451d-a5a5-2a5e18c2b334 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7d623925d0d146cd86db30b68b1ce223)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:33:01.763517 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b3e49f-4d92-451d-a5a5-2a5e18c2b334 admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:33:01.808370 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-39b3e49f-4d92-451d-a5a5-2a5e18c2b334 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7d623925d0d146cd86db30b68b1ce223'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:33:01.819912 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-39b3e49f-4d92-451d-a5a5-2a5e18c2b334 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7d623925d0d146cd86db30b68b1ce223'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:33:01.826549 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-39b3e49f-4d92-451d-a5a5-2a5e18c2b334 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7d623925d0d146cd86db30b68b1ce223'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:33:01.827213 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-39b3e49f-4d92-451d-a5a5-2a5e18c2b334 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7d623925d0d146cd86db30b68b1ce223'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:33:01.827825 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-39b3e49f-4d92-451d-a5a5-2a5e18c2b334 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7d623925d0d146cd86db30b68b1ce223'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:33:01.839842 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1293/2591] 10.222.0.44 () {58 vars in 1223 bytes} [Thu Jun 16 12:33:01 2022] DELETE /identity/v3/users/7d623925d0d146cd86db30b68b1ce223 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:33:01.844342 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9e1bd9-1929-48e2-a9f8-6a74aadcec4a None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:33:01.844924 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9e1bd9-1929-48e2-a9f8-6a74aadcec4a None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:33:01.844924 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9e1bd9-1929-48e2-a9f8-6a74aadcec4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:33:01.861884 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-0d9e1bd9-1929-48e2-a9f8-6a74aadcec4a None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:33:01.863075 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-0d9e1bd9-1929-48e2-a9f8-6a74aadcec4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:33:01.923723 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1299/2592] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 12:33:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:33:01.930866 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b3e49f-4d92-451d-a5a5-2a5e18c2b334 admin admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:33:01.932314 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-39b3e49f-4d92-451d-a5a5-2a5e18c2b334 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:33:01.958069 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:33:01.990692 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b3e49f-4d92-451d-a5a5-2a5e18c2b334 admin admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:33:01.994325 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb193ab1-e2be-4bf6-bf2c-bda5f78cbea8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1094729b25a4be7b0b394998c9ca681', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '601361df39e34fcca71175aa94e425c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:33:01.994963 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb193ab1-e2be-4bf6-bf2c-bda5f78cbea8 service neutron] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:33:01.995244 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb193ab1-e2be-4bf6-bf2c-bda5f78cbea8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:33:01.995517 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb193ab1-e2be-4bf6-bf2c-bda5f78cbea8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:33:02.004368 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb193ab1-e2be-4bf6-bf2c-bda5f78cbea8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:33:02.005887 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb193ab1-e2be-4bf6-bf2c-bda5f78cbea8 service neutron] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:33:02.015196 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1294/2593] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 12:33:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 12:33:02.280991 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9e1bd9-1929-48e2-a9f8-6a74aadcec4a None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:33:02.283327 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-0d9e1bd9-1929-48e2-a9f8-6a74aadcec4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:33:02.309080 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9e1bd9-1929-48e2-a9f8-6a74aadcec4a None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:33:02.314340 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9294735-35fc-4c33-b1f0-bd49a730a3bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:33:02.315816 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9294735-35fc-4c33-b1f0-bd49a730a3bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:33:02.316322 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9294735-35fc-4c33-b1f0-bd49a730a3bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:33:02.316700 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9294735-35fc-4c33-b1f0-bd49a730a3bc admin admin] PATH_INFO: `/v3/projects/0f6b1453179d4cc496fdc16b91e6907e` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:33:02.318708 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9294735-35fc-4c33-b1f0-bd49a730a3bc admin admin] RBAC: Authorizing `identity:delete_project(project_id=0f6b1453179d4cc496fdc16b91e6907e)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:33:02.320828 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9294735-35fc-4c33-b1f0-bd49a730a3bc admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:33:02.375688 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:33:02.383161 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-d9294735-35fc-4c33-b1f0-bd49a730a3bc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0f6b1453179d4cc496fdc16b91e6907e', 'request_id': 'req-d9294735-35fc-4c33-b1f0-bd49a730a3bc'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:33:02.391216 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-d9294735-35fc-4c33-b1f0-bd49a730a3bc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0f6b1453179d4cc496fdc16b91e6907e', 'request_id': 'req-d9294735-35fc-4c33-b1f0-bd49a730a3bc'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:33:02.397636 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-d9294735-35fc-4c33-b1f0-bd49a730a3bc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0f6b1453179d4cc496fdc16b91e6907e', 'request_id': 'req-d9294735-35fc-4c33-b1f0-bd49a730a3bc'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:33:02.409259 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-d9294735-35fc-4c33-b1f0-bd49a730a3bc admin admin] The token cache is being invalidate because project 0f6b1453179d4cc496fdc16b91e6907e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 12:33:02.409575 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-d9294735-35fc-4c33-b1f0-bd49a730a3bc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:33:02.410366 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-d9294735-35fc-4c33-b1f0-bd49a730a3bc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:33:02.412009 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1300/2594] 10.222.0.44 () {58 vars in 1232 bytes} [Thu Jun 16 12:33:02 2022] DELETE /identity/v3/projects/0f6b1453179d4cc496fdc16b91e6907e => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:33:02.416083 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb193ab1-e2be-4bf6-bf2c-bda5f78cbea8 service neutron] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:33:02.425999 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb193ab1-e2be-4bf6-bf2c-bda5f78cbea8 service neutron] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:33:02.484086 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44ac6f4-3a61-41a3-85f8-69484d3dc7ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:33:02.485266 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44ac6f4-3a61-41a3-85f8-69484d3dc7ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:33:02.485617 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44ac6f4-3a61-41a3-85f8-69484d3dc7ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:33:02.485965 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44ac6f4-3a61-41a3-85f8-69484d3dc7ec admin admin] PATH_INFO: `/v3/users/cd0204231cb8451998a269f126c4ea57` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:33:02.487257 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44ac6f4-3a61-41a3-85f8-69484d3dc7ec admin admin] RBAC: Authorizing `identity:delete_user(user_id=cd0204231cb8451998a269f126c4ea57)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:33:02.489287 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44ac6f4-3a61-41a3-85f8-69484d3dc7ec admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:33:02.539946 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-d44ac6f4-3a61-41a3-85f8-69484d3dc7ec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd0204231cb8451998a269f126c4ea57'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:33:02.551556 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-d44ac6f4-3a61-41a3-85f8-69484d3dc7ec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd0204231cb8451998a269f126c4ea57'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:33:02.558475 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-d44ac6f4-3a61-41a3-85f8-69484d3dc7ec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd0204231cb8451998a269f126c4ea57'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:33:02.559178 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-d44ac6f4-3a61-41a3-85f8-69484d3dc7ec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd0204231cb8451998a269f126c4ea57'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:33:02.559781 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-d44ac6f4-3a61-41a3-85f8-69484d3dc7ec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd0204231cb8451998a269f126c4ea57'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:33:02.573340 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1295/2595] 10.222.0.44 () {58 vars in 1223 bytes} [Thu Jun 16 12:33:02 2022] DELETE /identity/v3/users/cd0204231cb8451998a269f126c4ea57 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:33:02.835226 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9294735-35fc-4c33-b1f0-bd49a730a3bc admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:33:02.836924 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-d9294735-35fc-4c33-b1f0-bd49a730a3bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:33:02.852177 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9294735-35fc-4c33-b1f0-bd49a730a3bc admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:33:02.909602 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128be7fe-e17f-4f33-b71b-49580b12dc0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:33:02.910382 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128be7fe-e17f-4f33-b71b-49580b12dc0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:33:02.910659 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128be7fe-e17f-4f33-b71b-49580b12dc0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:33:02.910932 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128be7fe-e17f-4f33-b71b-49580b12dc0b admin admin] PATH_INFO: `/v3/projects/e7a8769a8ac04197baffa725ebb46e48` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:33:02.912153 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128be7fe-e17f-4f33-b71b-49580b12dc0b admin admin] RBAC: Authorizing `identity:delete_project(project_id=e7a8769a8ac04197baffa725ebb46e48)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:33:02.914368 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128be7fe-e17f-4f33-b71b-49580b12dc0b admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:33:02.961377 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-128be7fe-e17f-4f33-b71b-49580b12dc0b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e7a8769a8ac04197baffa725ebb46e48', 'request_id': 'req-128be7fe-e17f-4f33-b71b-49580b12dc0b'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:33:02.968460 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-128be7fe-e17f-4f33-b71b-49580b12dc0b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e7a8769a8ac04197baffa725ebb46e48', 'request_id': 'req-128be7fe-e17f-4f33-b71b-49580b12dc0b'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:33:02.974012 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-128be7fe-e17f-4f33-b71b-49580b12dc0b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e7a8769a8ac04197baffa725ebb46e48', 'request_id': 'req-128be7fe-e17f-4f33-b71b-49580b12dc0b'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:33:02.984942 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-128be7fe-e17f-4f33-b71b-49580b12dc0b admin admin] The token cache is being invalidate because project e7a8769a8ac04197baffa725ebb46e48 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 12:33:02.985252 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-128be7fe-e17f-4f33-b71b-49580b12dc0b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:33:02.985867 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-128be7fe-e17f-4f33-b71b-49580b12dc0b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:33:02.987395 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1301/2596] 10.222.0.44 () {58 vars in 1232 bytes} [Thu Jun 16 12:33:02 2022] DELETE /identity/v3/projects/e7a8769a8ac04197baffa725ebb46e48 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:33:02.992900 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee87ab6-037d-4d4a-a665-fb3a9b54f1a6 None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:33:02.993372 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee87ab6-037d-4d4a-a665-fb3a9b54f1a6 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:33:02.993479 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee87ab6-037d-4d4a-a665-fb3a9b54f1a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:33:03.011608 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-4ee87ab6-037d-4d4a-a665-fb3a9b54f1a6 None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:33:03.012836 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-4ee87ab6-037d-4d4a-a665-fb3a9b54f1a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:33:03.051216 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:33:03.071860 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1296/2597] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 12:33:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:33:03.079674 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a49573-824e-4160-8b47-07d10ec2d4e1 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:33:03.079958 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a49573-824e-4160-8b47-07d10ec2d4e1 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:33:03.080229 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a49573-824e-4160-8b47-07d10ec2d4e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:33:03.097914 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-79a49573-824e-4160-8b47-07d10ec2d4e1 None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:33:03.099096 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-79a49573-824e-4160-8b47-07d10ec2d4e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:33:03.107374 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1302/2598] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 12:33:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:33:03.111367 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee87ab6-037d-4d4a-a665-fb3a9b54f1a6 None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:33:03.121753 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee87ab6-037d-4d4a-a665-fb3a9b54f1a6 None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:33:03.126246 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04408550-6fff-47b4-9068-cb15c897b1a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:33:03.126928 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04408550-6fff-47b4-9068-cb15c897b1a3 admin admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:33:03.127207 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04408550-6fff-47b4-9068-cb15c897b1a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:33:03.127505 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04408550-6fff-47b4-9068-cb15c897b1a3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:33:03.128234 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04408550-6fff-47b4-9068-cb15c897b1a3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:33:03.128538 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04408550-6fff-47b4-9068-cb15c897b1a3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:33:03.130154 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04408550-6fff-47b4-9068-cb15c897b1a3 admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:33:03.141464 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1297/2599] 10.222.0.44 () {58 vars in 1152 bytes} [Thu Jun 16 12:33:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 12:33:03.145589 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a49573-824e-4160-8b47-07d10ec2d4e1 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:33:03.155047 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a49573-824e-4160-8b47-07d10ec2d4e1 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:33:03.159676 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9949c0ab-ec9b-462b-8c59-a8772cccb9c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:33:03.160255 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9949c0ab-ec9b-462b-8c59-a8772cccb9c6 admin admin] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:33:03.160530 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9949c0ab-ec9b-462b-8c59-a8772cccb9c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:33:03.160824 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9949c0ab-ec9b-462b-8c59-a8772cccb9c6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:33:03.161505 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9949c0ab-ec9b-462b-8c59-a8772cccb9c6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:33:03.164350 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9949c0ab-ec9b-462b-8c59-a8772cccb9c6 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:33:03.188971 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1303/2600] 10.222.0.44 () {60 vars in 1152 bytes} [Thu Jun 16 12:33:03 2022] POST /identity/v3/projects => generated 387 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 12:33:03.193505 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04408550-6fff-47b4-9068-cb15c897b1a3 admin admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:33:03.203238 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04408550-6fff-47b4-9068-cb15c897b1a3 admin admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:33:03.258231 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d6a829-7e71-4f80-a7dd-83e263993198 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:33:03.258893 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d6a829-7e71-4f80-a7dd-83e263993198 admin admin] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:33:03.259173 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d6a829-7e71-4f80-a7dd-83e263993198 admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:33:03.259451 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d6a829-7e71-4f80-a7dd-83e263993198 admin admin] PATH_INFO: `/v3/users` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:33:03.260137 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d6a829-7e71-4f80-a7dd-83e263993198 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:33:03.262111 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d6a829-7e71-4f80-a7dd-83e263993198 admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:33:03.281578 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1298/2601] 10.222.0.44 () {60 vars in 1143 bytes} [Thu Jun 16 12:33:03 2022] POST /identity/v3/users => generated 294 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 12:33:03.285626 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9949c0ab-ec9b-462b-8c59-a8772cccb9c6 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:33:03.296371 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9949c0ab-ec9b-462b-8c59-a8772cccb9c6 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:33:03.301104 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084015e6-59fd-43fd-8c48-87d0b1c80e95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:33:03.301783 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084015e6-59fd-43fd-8c48-87d0b1c80e95 admin admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:33:03.302061 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084015e6-59fd-43fd-8c48-87d0b1c80e95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:33:03.302330 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084015e6-59fd-43fd-8c48-87d0b1c80e95 admin admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:33:03.303653 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084015e6-59fd-43fd-8c48-87d0b1c80e95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:33:03.305260 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084015e6-59fd-43fd-8c48-87d0b1c80e95 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:33:03.315384 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1304/2602] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 12:33:03 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 12:33:03.319167 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d6a829-7e71-4f80-a7dd-83e263993198 admin admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:33:03.328995 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d6a829-7e71-4f80-a7dd-83e263993198 admin admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:33:03.333584 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038c70c2-12a5-45c3-9221-9de6edec57fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:33:03.334227 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038c70c2-12a5-45c3-9221-9de6edec57fd admin admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:33:03.334508 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038c70c2-12a5-45c3-9221-9de6edec57fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:33:03.334784 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038c70c2-12a5-45c3-9221-9de6edec57fd admin admin] PATH_INFO: `/v3/roles` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:33:03.335505 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038c70c2-12a5-45c3-9221-9de6edec57fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:33:03.337153 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038c70c2-12a5-45c3-9221-9de6edec57fd admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:33:03.346838 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1299/2603] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 12:33:03 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 12:33:03.351285 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084015e6-59fd-43fd-8c48-87d0b1c80e95 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:33:03.360947 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084015e6-59fd-43fd-8c48-87d0b1c80e95 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:33:03.365955 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae984d2-33e7-45d2-80d6-6520aea2915e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:33:03.366820 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae984d2-33e7-45d2-80d6-6520aea2915e admin admin] REQUEST_METHOD: `PUT` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:33:03.367092 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae984d2-33e7-45d2-80d6-6520aea2915e admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:33:03.367380 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae984d2-33e7-45d2-80d6-6520aea2915e admin admin] PATH_INFO: `/v3/projects/538a968f7a3c4d8686b0f0fbb9d038d5/users/69cc8dd53140424ca4eeeb994a9c9a01/roles/c39882b202e942479a7cdac2fc6da72c` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:33:03.381938 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae984d2-33e7-45d2-80d6-6520aea2915e admin admin] RBAC: Authorizing `identity:create_grant(project_id=538a968f7a3c4d8686b0f0fbb9d038d5, user_id=69cc8dd53140424ca4eeeb994a9c9a01, role_id=c39882b202e942479a7cdac2fc6da72c)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:33:03.384569 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae984d2-33e7-45d2-80d6-6520aea2915e admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:33:03.387509 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=85,keystone:DELETE=11,keystone:INSERT=4 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:33:03.399022 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1305/2604] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 16 12:33:03 2022] PUT /identity/v3/projects/538a968f7a3c4d8686b0f0fbb9d038d5/users/69cc8dd53140424ca4eeeb994a9c9a01/roles/c39882b202e942479a7cdac2fc6da72c => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:33:03.410293 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231e32d7-1c1d-4b81-ba50-97bf667c8e94 None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:33:03.410535 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231e32d7-1c1d-4b81-ba50-97bf667c8e94 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:33:03.410785 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231e32d7-1c1d-4b81-ba50-97bf667c8e94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:33:03.437578 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-231e32d7-1c1d-4b81-ba50-97bf667c8e94 None None] MFA Rules not processed for user `69cc8dd53140424ca4eeeb994a9c9a01`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:33:03.438829 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-231e32d7-1c1d-4b81-ba50-97bf667c8e94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:33:03.500917 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1300/2605] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 12:33:03 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:33:03.505374 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae984d2-33e7-45d2-80d6-6520aea2915e admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:33:03.565124 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae984d2-33e7-45d2-80d6-6520aea2915e admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:33:03.569713 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ef8082-fc9f-4d8a-85e4-dd39f03b2a93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:33:03.570357 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ef8082-fc9f-4d8a-85e4-dd39f03b2a93 admin admin] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:33:03.570633 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ef8082-fc9f-4d8a-85e4-dd39f03b2a93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:33:03.570903 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ef8082-fc9f-4d8a-85e4-dd39f03b2a93 admin admin] PATH_INFO: `/v3/projects` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:33:03.571573 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ef8082-fc9f-4d8a-85e4-dd39f03b2a93 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:33:03.573573 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ef8082-fc9f-4d8a-85e4-dd39f03b2a93 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:33:03.597842 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1306/2606] 10.222.0.44 () {60 vars in 1152 bytes} [Thu Jun 16 12:33:03 2022] POST /identity/v3/projects => generated 385 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 12:33:03.602486 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231e32d7-1c1d-4b81-ba50-97bf667c8e94 None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:33:03.612820 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231e32d7-1c1d-4b81-ba50-97bf667c8e94 None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:33:03.649786 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:33:03.668804 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76100b1-0b57-4703-808f-3968248d11f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:33:03.669402 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76100b1-0b57-4703-808f-3968248d11f7 admin admin] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:33:03.669679 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76100b1-0b57-4703-808f-3968248d11f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:33:03.669950 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76100b1-0b57-4703-808f-3968248d11f7 admin admin] PATH_INFO: `/v3/users` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:33:03.670631 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76100b1-0b57-4703-808f-3968248d11f7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:33:03.672540 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76100b1-0b57-4703-808f-3968248d11f7 admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:33:03.692194 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1301/2607] 10.222.0.44 () {60 vars in 1143 bytes} [Thu Jun 16 12:33:03 2022] POST /identity/v3/users => generated 299 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 12:33:03.696117 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ef8082-fc9f-4d8a-85e4-dd39f03b2a93 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:33:03.706196 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ef8082-fc9f-4d8a-85e4-dd39f03b2a93 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:33:03.711230 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3060be14-d50e-4ed6-848a-32fb642962c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:33:03.711874 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3060be14-d50e-4ed6-848a-32fb642962c4 admin admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:33:03.712150 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3060be14-d50e-4ed6-848a-32fb642962c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:33:03.712418 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3060be14-d50e-4ed6-848a-32fb642962c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:33:03.713174 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3060be14-d50e-4ed6-848a-32fb642962c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:33:03.714744 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3060be14-d50e-4ed6-848a-32fb642962c4 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:33:03.725724 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1307/2608] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 12:33:03 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 12:33:03.729673 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76100b1-0b57-4703-808f-3968248d11f7 admin admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:33:03.739398 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76100b1-0b57-4703-808f-3968248d11f7 admin admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:33:03.743942 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f51ad1-37c5-4e2f-b884-ee9cf3c15623 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:33:03.744844 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f51ad1-37c5-4e2f-b884-ee9cf3c15623 admin admin] REQUEST_METHOD: `PUT` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:33:03.745126 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f51ad1-37c5-4e2f-b884-ee9cf3c15623 admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:33:03.745399 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f51ad1-37c5-4e2f-b884-ee9cf3c15623 admin admin] PATH_INFO: `/v3/projects/4ee27d364f844f22ab57bc0df5eff049/users/1266d2fda07f4fbe9c76fbe9422b1360/roles/0688968254744e3f9913653cafea3091` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:33:03.759699 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f51ad1-37c5-4e2f-b884-ee9cf3c15623 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ee27d364f844f22ab57bc0df5eff049, user_id=1266d2fda07f4fbe9c76fbe9422b1360, role_id=0688968254744e3f9913653cafea3091)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:33:03.762369 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f51ad1-37c5-4e2f-b884-ee9cf3c15623 admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:33:03.775790 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1302/2609] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 16 12:33:03 2022] PUT /identity/v3/projects/4ee27d364f844f22ab57bc0df5eff049/users/1266d2fda07f4fbe9c76fbe9422b1360/roles/0688968254744e3f9913653cafea3091 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:33:03.779585 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3060be14-d50e-4ed6-848a-32fb642962c4 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:33:03.789956 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3060be14-d50e-4ed6-848a-32fb642962c4 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:33:03.844993 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898e9c12-eeb8-47b7-be87-48bbe00a2e85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:33:03.845651 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898e9c12-eeb8-47b7-be87-48bbe00a2e85 admin admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:33:03.845925 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898e9c12-eeb8-47b7-be87-48bbe00a2e85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:33:03.846198 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898e9c12-eeb8-47b7-be87-48bbe00a2e85 admin admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:33:03.846905 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898e9c12-eeb8-47b7-be87-48bbe00a2e85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:33:03.848487 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898e9c12-eeb8-47b7-be87-48bbe00a2e85 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:33:03.857929 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1308/2610] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 12:33:03 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 12:33:03.862165 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f51ad1-37c5-4e2f-b884-ee9cf3c15623 admin admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:33:03.872463 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f51ad1-37c5-4e2f-b884-ee9cf3c15623 admin admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:33:03.877187 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ea179a-9fd7-441f-99f5-1a504425152d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:33:03.878057 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ea179a-9fd7-441f-99f5-1a504425152d admin admin] REQUEST_METHOD: `PUT` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:33:03.878362 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ea179a-9fd7-441f-99f5-1a504425152d admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:33:03.878634 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ea179a-9fd7-441f-99f5-1a504425152d admin admin] PATH_INFO: `/v3/projects/4ee27d364f844f22ab57bc0df5eff049/users/1266d2fda07f4fbe9c76fbe9422b1360/roles/0688968254744e3f9913653cafea3091` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:33:03.881139 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ea179a-9fd7-441f-99f5-1a504425152d admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ee27d364f844f22ab57bc0df5eff049, user_id=1266d2fda07f4fbe9c76fbe9422b1360, role_id=0688968254744e3f9913653cafea3091)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:33:03.883743 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ea179a-9fd7-441f-99f5-1a504425152d admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:33:03.893827 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1303/2611] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 16 12:33:03 2022] PUT /identity/v3/projects/4ee27d364f844f22ab57bc0df5eff049/users/1266d2fda07f4fbe9c76fbe9422b1360/roles/0688968254744e3f9913653cafea3091 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:33:03.904353 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd426905-5252-4c5a-8bc9-9b0a3f56f09d None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:33:03.904639 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd426905-5252-4c5a-8bc9-9b0a3f56f09d None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:33:03.904953 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd426905-5252-4c5a-8bc9-9b0a3f56f09d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:33:03.930723 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-dd426905-5252-4c5a-8bc9-9b0a3f56f09d None None] MFA Rules not processed for user `1266d2fda07f4fbe9c76fbe9422b1360`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:33:03.931922 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-dd426905-5252-4c5a-8bc9-9b0a3f56f09d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:33:03.980730 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:33:03.999498 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1309/2612] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 12:33:03 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:33:04.011003 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ea179a-9fd7-441f-99f5-1a504425152d admin admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:33:04.012838 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-61ea179a-9fd7-441f-99f5-1a504425152d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:33:04.070148 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ea179a-9fd7-441f-99f5-1a504425152d admin admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:33:04.073831 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25025841-aa5d-4270-af6f-2f052099b6a1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f96fc14ed89478c8a8c2f11c87511e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '601361df39e34fcca71175aa94e425c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:33:04.074465 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25025841-aa5d-4270-af6f-2f052099b6a1 service cinder] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:33:04.074750 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25025841-aa5d-4270-af6f-2f052099b6a1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:33:04.075026 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25025841-aa5d-4270-af6f-2f052099b6a1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:33:04.084636 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25025841-aa5d-4270-af6f-2f052099b6a1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:33:04.086105 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25025841-aa5d-4270-af6f-2f052099b6a1 service cinder] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:33:04.095395 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1304/2613] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 12:33:04 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 12:33:04.162412 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd426905-5252-4c5a-8bc9-9b0a3f56f09d None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:33:04.223774 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd426905-5252-4c5a-8bc9-9b0a3f56f09d None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:33:04.228431 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f88806-8a60-4da7-83d3-c746581283e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:33:04.229342 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f88806-8a60-4da7-83d3-c746581283e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:33:04.229614 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f88806-8a60-4da7-83d3-c746581283e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:33:04.229889 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f88806-8a60-4da7-83d3-c746581283e3 admin admin] PATH_INFO: `/v3/users/69cc8dd53140424ca4eeeb994a9c9a01` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:33:04.231092 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f88806-8a60-4da7-83d3-c746581283e3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=69cc8dd53140424ca4eeeb994a9c9a01)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:33:04.233051 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f88806-8a60-4da7-83d3-c746581283e3 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:33:04.278177 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-79f88806-8a60-4da7-83d3-c746581283e3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '69cc8dd53140424ca4eeeb994a9c9a01'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:33:04.278829 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-79f88806-8a60-4da7-83d3-c746581283e3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '69cc8dd53140424ca4eeeb994a9c9a01'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:33:04.285558 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-79f88806-8a60-4da7-83d3-c746581283e3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '69cc8dd53140424ca4eeeb994a9c9a01'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:33:04.286185 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-79f88806-8a60-4da7-83d3-c746581283e3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '69cc8dd53140424ca4eeeb994a9c9a01'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:33:04.292843 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-79f88806-8a60-4da7-83d3-c746581283e3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '69cc8dd53140424ca4eeeb994a9c9a01'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:33:04.310221 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1310/2614] 10.222.0.44 () {58 vars in 1223 bytes} [Thu Jun 16 12:33:04 2022] DELETE /identity/v3/users/69cc8dd53140424ca4eeeb994a9c9a01 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:33:04.315241 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f30be87-d322-4e6d-8b19-b275bf1a3140 None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:33:04.315536 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f30be87-d322-4e6d-8b19-b275bf1a3140 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:33:04.315815 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f30be87-d322-4e6d-8b19-b275bf1a3140 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:33:04.333858 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-3f30be87-d322-4e6d-8b19-b275bf1a3140 None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:33:04.335057 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-3f30be87-d322-4e6d-8b19-b275bf1a3140 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:33:04.393535 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1305/2615] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 12:33:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:33:04.403259 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f88806-8a60-4da7-83d3-c746581283e3 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:33:04.404685 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-79f88806-8a60-4da7-83d3-c746581283e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:33:04.460683 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f88806-8a60-4da7-83d3-c746581283e3 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:33:04.464363 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf267ca-4639-4ba5-968b-ff79556ee50b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1094729b25a4be7b0b394998c9ca681', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '601361df39e34fcca71175aa94e425c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:33:04.465037 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf267ca-4639-4ba5-968b-ff79556ee50b service neutron] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:33:04.465317 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf267ca-4639-4ba5-968b-ff79556ee50b service neutron] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:33:04.465597 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf267ca-4639-4ba5-968b-ff79556ee50b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:33:04.474624 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf267ca-4639-4ba5-968b-ff79556ee50b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:33:04.475992 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf267ca-4639-4ba5-968b-ff79556ee50b service neutron] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:33:04.485366 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1311/2616] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 12:33:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 12:33:04.749991 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f30be87-d322-4e6d-8b19-b275bf1a3140 None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:33:04.751540 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-3f30be87-d322-4e6d-8b19-b275bf1a3140 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:33:04.763897 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f30be87-d322-4e6d-8b19-b275bf1a3140 None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:33:04.769128 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accf33b6-7bc5-4bd2-bac9-2e41754c0b59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:33:04.769991 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accf33b6-7bc5-4bd2-bac9-2e41754c0b59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:33:04.770273 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accf33b6-7bc5-4bd2-bac9-2e41754c0b59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:33:04.770551 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accf33b6-7bc5-4bd2-bac9-2e41754c0b59 admin admin] PATH_INFO: `/v3/projects/538a968f7a3c4d8686b0f0fbb9d038d5` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:33:04.771860 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accf33b6-7bc5-4bd2-bac9-2e41754c0b59 admin admin] RBAC: Authorizing `identity:delete_project(project_id=538a968f7a3c4d8686b0f0fbb9d038d5)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:33:04.773839 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accf33b6-7bc5-4bd2-bac9-2e41754c0b59 admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:33:04.808462 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=93,keystone:INSERT=5,keystone:DELETE=2 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:33:04.823297 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-accf33b6-7bc5-4bd2-bac9-2e41754c0b59 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '538a968f7a3c4d8686b0f0fbb9d038d5', 'request_id': 'req-accf33b6-7bc5-4bd2-bac9-2e41754c0b59'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:33:04.830652 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-accf33b6-7bc5-4bd2-bac9-2e41754c0b59 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '538a968f7a3c4d8686b0f0fbb9d038d5', 'request_id': 'req-accf33b6-7bc5-4bd2-bac9-2e41754c0b59'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:33:04.836207 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-accf33b6-7bc5-4bd2-bac9-2e41754c0b59 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '538a968f7a3c4d8686b0f0fbb9d038d5', 'request_id': 'req-accf33b6-7bc5-4bd2-bac9-2e41754c0b59'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:33:04.846856 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-accf33b6-7bc5-4bd2-bac9-2e41754c0b59 admin admin] The token cache is being invalidate because project 538a968f7a3c4d8686b0f0fbb9d038d5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 12:33:04.847142 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-accf33b6-7bc5-4bd2-bac9-2e41754c0b59 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:33:04.847791 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-accf33b6-7bc5-4bd2-bac9-2e41754c0b59 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:33:04.849869 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1306/2617] 10.222.0.44 () {58 vars in 1232 bytes} [Thu Jun 16 12:33:04 2022] DELETE /identity/v3/projects/538a968f7a3c4d8686b0f0fbb9d038d5 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:33:04.853811 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf267ca-4639-4ba5-968b-ff79556ee50b service neutron] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:33:04.863409 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf267ca-4639-4ba5-968b-ff79556ee50b service neutron] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:33:04.872809 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:33:04.922308 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfef66a-c15b-49bd-a5e8-2cb7760c0582 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:33:04.923184 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfef66a-c15b-49bd-a5e8-2cb7760c0582 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:33:04.923467 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfef66a-c15b-49bd-a5e8-2cb7760c0582 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:33:04.923740 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfef66a-c15b-49bd-a5e8-2cb7760c0582 admin admin] PATH_INFO: `/v3/users/1266d2fda07f4fbe9c76fbe9422b1360` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:33:04.924967 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfef66a-c15b-49bd-a5e8-2cb7760c0582 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1266d2fda07f4fbe9c76fbe9422b1360)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:33:04.926897 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfef66a-c15b-49bd-a5e8-2cb7760c0582 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:33:04.973530 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-5cfef66a-c15b-49bd-a5e8-2cb7760c0582 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1266d2fda07f4fbe9c76fbe9422b1360'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:33:04.974217 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-5cfef66a-c15b-49bd-a5e8-2cb7760c0582 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1266d2fda07f4fbe9c76fbe9422b1360'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:33:04.981491 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-5cfef66a-c15b-49bd-a5e8-2cb7760c0582 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1266d2fda07f4fbe9c76fbe9422b1360'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:33:04.982116 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-5cfef66a-c15b-49bd-a5e8-2cb7760c0582 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1266d2fda07f4fbe9c76fbe9422b1360'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:33:04.988970 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-5cfef66a-c15b-49bd-a5e8-2cb7760c0582 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1266d2fda07f4fbe9c76fbe9422b1360'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:33:05.005626 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1312/2618] 10.222.0.44 () {58 vars in 1223 bytes} [Thu Jun 16 12:33:04 2022] DELETE /identity/v3/users/1266d2fda07f4fbe9c76fbe9422b1360 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:33:05.270222 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accf33b6-7bc5-4bd2-bac9-2e41754c0b59 admin admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:33:05.271763 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-accf33b6-7bc5-4bd2-bac9-2e41754c0b59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:33:05.286284 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accf33b6-7bc5-4bd2-bac9-2e41754c0b59 admin admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:33:05.343722 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a43a81c-8edb-432f-8e42-80bbe2b74893 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:33:05.344576 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a43a81c-8edb-432f-8e42-80bbe2b74893 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:33:05.344902 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a43a81c-8edb-432f-8e42-80bbe2b74893 admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:33:05.345181 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a43a81c-8edb-432f-8e42-80bbe2b74893 admin admin] PATH_INFO: `/v3/projects/4ee27d364f844f22ab57bc0df5eff049` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:33:05.346351 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a43a81c-8edb-432f-8e42-80bbe2b74893 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4ee27d364f844f22ab57bc0df5eff049)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:33:05.348242 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a43a81c-8edb-432f-8e42-80bbe2b74893 admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:33:05.393925 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-9a43a81c-8edb-432f-8e42-80bbe2b74893 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4ee27d364f844f22ab57bc0df5eff049', 'request_id': 'req-9a43a81c-8edb-432f-8e42-80bbe2b74893'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:33:05.401050 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-9a43a81c-8edb-432f-8e42-80bbe2b74893 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4ee27d364f844f22ab57bc0df5eff049', 'request_id': 'req-9a43a81c-8edb-432f-8e42-80bbe2b74893'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:33:05.406390 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-9a43a81c-8edb-432f-8e42-80bbe2b74893 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4ee27d364f844f22ab57bc0df5eff049', 'request_id': 'req-9a43a81c-8edb-432f-8e42-80bbe2b74893'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:33:05.417503 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-9a43a81c-8edb-432f-8e42-80bbe2b74893 admin admin] The token cache is being invalidate because project 4ee27d364f844f22ab57bc0df5eff049 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 12:33:05.417788 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-9a43a81c-8edb-432f-8e42-80bbe2b74893 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:33:05.418410 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-9a43a81c-8edb-432f-8e42-80bbe2b74893 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:33:05.419927 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1307/2619] 10.222.0.44 () {58 vars in 1232 bytes} [Thu Jun 16 12:33:05 2022] DELETE /identity/v3/projects/4ee27d364f844f22ab57bc0df5eff049 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:33:05.424743 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3f01e2-e96b-4aab-a85f-32af45dc91ce None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:33:05.425065 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3f01e2-e96b-4aab-a85f-32af45dc91ce None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:33:05.425344 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3f01e2-e96b-4aab-a85f-32af45dc91ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:33:05.442946 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-0f3f01e2-e96b-4aab-a85f-32af45dc91ce None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:33:05.444145 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-0f3f01e2-e96b-4aab-a85f-32af45dc91ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:33:05.501900 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1313/2620] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 12:33:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:33:05.509615 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7a8aeb-c884-4abf-baff-f1eba6ec1cb2 None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:33:05.509905 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7a8aeb-c884-4abf-baff-f1eba6ec1cb2 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:33:05.510183 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7a8aeb-c884-4abf-baff-f1eba6ec1cb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:33:05.528156 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-3e7a8aeb-c884-4abf-baff-f1eba6ec1cb2 None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:33:05.529322 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-3e7a8aeb-c884-4abf-baff-f1eba6ec1cb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:33:05.537856 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1308/2621] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 12:33:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 12:33:05.541958 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3f01e2-e96b-4aab-a85f-32af45dc91ce None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:33:05.551449 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3f01e2-e96b-4aab-a85f-32af45dc91ce None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:33:05.556518 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e06e6b-759f-41d1-a4d3-c184995c9747 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:33:05.557201 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e06e6b-759f-41d1-a4d3-c184995c9747 admin admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:33:05.557483 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e06e6b-759f-41d1-a4d3-c184995c9747 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:33:05.557755 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e06e6b-759f-41d1-a4d3-c184995c9747 admin admin] PATH_INFO: `/v3/domains` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:33:05.558469 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e06e6b-759f-41d1-a4d3-c184995c9747 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:33:05.558779 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e06e6b-759f-41d1-a4d3-c184995c9747 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:33:05.560372 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e06e6b-759f-41d1-a4d3-c184995c9747 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:33:05.571755 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1314/2622] 10.222.0.44 () {58 vars in 1152 bytes} [Thu Jun 16 12:33:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:33:05.575805 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7a8aeb-c884-4abf-baff-f1eba6ec1cb2 None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:33:05.584921 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7a8aeb-c884-4abf-baff-f1eba6ec1cb2 None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:33:05.589562 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ea9516-4064-458d-955a-c89a1f184a8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:33:05.590195 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ea9516-4064-458d-955a-c89a1f184a8a admin admin] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:33:05.590475 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ea9516-4064-458d-955a-c89a1f184a8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:33:05.590744 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ea9516-4064-458d-955a-c89a1f184a8a admin admin] PATH_INFO: `/v3/projects` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:33:05.591418 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ea9516-4064-458d-955a-c89a1f184a8a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:33:05.593335 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ea9516-4064-458d-955a-c89a1f184a8a admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:33:05.618684 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1309/2623] 10.222.0.44 () {60 vars in 1152 bytes} [Thu Jun 16 12:33:05 2022] POST /identity/v3/projects => generated 379 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 12:33:05.622665 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e06e6b-759f-41d1-a4d3-c184995c9747 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:33:05.632421 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e06e6b-759f-41d1-a4d3-c184995c9747 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:33:05.648813 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:33:05.689708 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff04b23a-facf-46a4-8e37-9801644e367b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:33:05.690370 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff04b23a-facf-46a4-8e37-9801644e367b admin admin] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:33:05.690650 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff04b23a-facf-46a4-8e37-9801644e367b admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:33:05.690922 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff04b23a-facf-46a4-8e37-9801644e367b admin admin] PATH_INFO: `/v3/users` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:33:05.691642 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff04b23a-facf-46a4-8e37-9801644e367b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:33:05.693588 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff04b23a-facf-46a4-8e37-9801644e367b admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:33:05.713209 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1315/2624] 10.222.0.44 () {60 vars in 1143 bytes} [Thu Jun 16 12:33:05 2022] POST /identity/v3/users => generated 290 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 12:33:05.717280 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ea9516-4064-458d-955a-c89a1f184a8a admin admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:33:05.727863 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ea9516-4064-458d-955a-c89a1f184a8a admin admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:33:05.732399 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ce7763-0f26-4d22-8566-b9bdc3d10d3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:33:05.733075 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ce7763-0f26-4d22-8566-b9bdc3d10d3a admin admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:33:05.733353 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ce7763-0f26-4d22-8566-b9bdc3d10d3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:33:05.733622 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ce7763-0f26-4d22-8566-b9bdc3d10d3a admin admin] PATH_INFO: `/v3/roles` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:33:05.734336 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ce7763-0f26-4d22-8566-b9bdc3d10d3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:33:05.735902 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ce7763-0f26-4d22-8566-b9bdc3d10d3a admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:33:05.745979 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1310/2625] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 12:33:05 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 12:33:05.749621 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff04b23a-facf-46a4-8e37-9801644e367b admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:33:05.759398 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff04b23a-facf-46a4-8e37-9801644e367b admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:33:05.763942 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca10ab4-0766-49aa-9c44-2263771132ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:33:05.764581 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca10ab4-0766-49aa-9c44-2263771132ea admin admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:33:05.764902 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca10ab4-0766-49aa-9c44-2263771132ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:33:05.765185 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca10ab4-0766-49aa-9c44-2263771132ea admin admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:33:05.765904 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca10ab4-0766-49aa-9c44-2263771132ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:33:05.767511 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca10ab4-0766-49aa-9c44-2263771132ea admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:33:05.778058 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1316/2626] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 12:33:05 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 12:33:05.781997 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ce7763-0f26-4d22-8566-b9bdc3d10d3a admin admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:33:05.792113 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ce7763-0f26-4d22-8566-b9bdc3d10d3a admin admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:33:05.796610 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e47ee3e-9f55-4dec-8bfe-e420c78aefcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:33:05.797498 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e47ee3e-9f55-4dec-8bfe-e420c78aefcf admin admin] REQUEST_METHOD: `PUT` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:33:05.797770 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e47ee3e-9f55-4dec-8bfe-e420c78aefcf admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:33:05.798034 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e47ee3e-9f55-4dec-8bfe-e420c78aefcf admin admin] PATH_INFO: `/v3/projects/2113371916c14d45a1c095486533e1b6/users/c86f0e66adf54edeababb8850fb1fd7e/roles/c39882b202e942479a7cdac2fc6da72c` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:33:05.801533 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:33:05.814760 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e47ee3e-9f55-4dec-8bfe-e420c78aefcf admin admin] RBAC: Authorizing `identity:create_grant(project_id=2113371916c14d45a1c095486533e1b6, user_id=c86f0e66adf54edeababb8850fb1fd7e, role_id=c39882b202e942479a7cdac2fc6da72c)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:33:05.817464 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e47ee3e-9f55-4dec-8bfe-e420c78aefcf admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:33:05.829826 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1311/2627] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 16 12:33:05 2022] PUT /identity/v3/projects/2113371916c14d45a1c095486533e1b6/users/c86f0e66adf54edeababb8850fb1fd7e/roles/c39882b202e942479a7cdac2fc6da72c => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 12:33:05.841217 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179f28da-e722-4b56-b9e2-af49b28ff85b None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:33:05.841501 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179f28da-e722-4b56-b9e2-af49b28ff85b None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:33:05.841775 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179f28da-e722-4b56-b9e2-af49b28ff85b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:33:05.867829 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-179f28da-e722-4b56-b9e2-af49b28ff85b None None] MFA Rules not processed for user `c86f0e66adf54edeababb8850fb1fd7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:33:05.869063 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-179f28da-e722-4b56-b9e2-af49b28ff85b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:33:05.932013 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1317/2628] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 12:33:05 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:33:05.936439 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e47ee3e-9f55-4dec-8bfe-e420c78aefcf admin admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:33:05.997095 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e47ee3e-9f55-4dec-8bfe-e420c78aefcf admin admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:33:06.001693 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34a5f47-4bd7-433e-888a-cd6a411c7203 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:33:06.002339 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34a5f47-4bd7-433e-888a-cd6a411c7203 admin admin] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:33:06.002620 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34a5f47-4bd7-433e-888a-cd6a411c7203 admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:33:06.002893 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34a5f47-4bd7-433e-888a-cd6a411c7203 admin admin] PATH_INFO: `/v3/projects` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:33:06.003579 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34a5f47-4bd7-433e-888a-cd6a411c7203 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:33:06.005596 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34a5f47-4bd7-433e-888a-cd6a411c7203 admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:33:06.030524 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1312/2629] 10.222.0.44 () {60 vars in 1152 bytes} [Thu Jun 16 12:33:05 2022] POST /identity/v3/projects => generated 379 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 12:33:06.034704 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179f28da-e722-4b56-b9e2-af49b28ff85b None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:33:06.046010 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179f28da-e722-4b56-b9e2-af49b28ff85b None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:33:06.106769 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1f7060-fd8a-49d7-beeb-a9981704ec94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:33:06.107437 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1f7060-fd8a-49d7-beeb-a9981704ec94 admin admin] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:33:06.107713 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1f7060-fd8a-49d7-beeb-a9981704ec94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:33:06.107984 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1f7060-fd8a-49d7-beeb-a9981704ec94 admin admin] PATH_INFO: `/v3/users` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:33:06.108678 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1f7060-fd8a-49d7-beeb-a9981704ec94 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:33:06.110624 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1f7060-fd8a-49d7-beeb-a9981704ec94 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:33:06.129491 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1318/2630] 10.222.0.44 () {60 vars in 1143 bytes} [Thu Jun 16 12:33:06 2022] POST /identity/v3/users => generated 290 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 12:33:06.133965 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34a5f47-4bd7-433e-888a-cd6a411c7203 admin admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:33:06.144256 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34a5f47-4bd7-433e-888a-cd6a411c7203 admin admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:33:06.149653 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa8becb-321e-46b4-b724-de0c87454625 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:33:06.150595 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa8becb-321e-46b4-b724-de0c87454625 admin admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:33:06.150859 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa8becb-321e-46b4-b724-de0c87454625 admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:33:06.151138 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa8becb-321e-46b4-b724-de0c87454625 admin admin] PATH_INFO: `/v3/roles` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:33:06.151886 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa8becb-321e-46b4-b724-de0c87454625 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:33:06.153537 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa8becb-321e-46b4-b724-de0c87454625 admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:33:06.164086 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1313/2631] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 12:33:06 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 12:33:06.168031 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1f7060-fd8a-49d7-beeb-a9981704ec94 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:33:06.178139 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1f7060-fd8a-49d7-beeb-a9981704ec94 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:33:06.183009 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda0c302-8acb-4a46-9ebf-ac961003233b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:33:06.183668 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda0c302-8acb-4a46-9ebf-ac961003233b admin admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:33:06.183968 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda0c302-8acb-4a46-9ebf-ac961003233b admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:33:06.184264 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda0c302-8acb-4a46-9ebf-ac961003233b admin admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:33:06.185018 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda0c302-8acb-4a46-9ebf-ac961003233b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:33:06.186601 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda0c302-8acb-4a46-9ebf-ac961003233b admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:33:06.197099 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1319/2632] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 12:33:06 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 12:33:06.201117 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa8becb-321e-46b4-b724-de0c87454625 admin admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:33:06.211453 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa8becb-321e-46b4-b724-de0c87454625 admin admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:33:06.215974 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcbf92c-5344-4e40-96cb-6b06ae8c4cbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:33:06.216867 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcbf92c-5344-4e40-96cb-6b06ae8c4cbb admin admin] REQUEST_METHOD: `PUT` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:33:06.217144 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcbf92c-5344-4e40-96cb-6b06ae8c4cbb admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:33:06.217413 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcbf92c-5344-4e40-96cb-6b06ae8c4cbb admin admin] PATH_INFO: `/v3/projects/d80ff3e29ee04175ad963b111110d3bd/users/5e36c417656840cb8ab09542c2cca6b3/roles/c39882b202e942479a7cdac2fc6da72c` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:33:06.231538 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcbf92c-5344-4e40-96cb-6b06ae8c4cbb admin admin] RBAC: Authorizing `identity:create_grant(project_id=d80ff3e29ee04175ad963b111110d3bd, user_id=5e36c417656840cb8ab09542c2cca6b3, role_id=c39882b202e942479a7cdac2fc6da72c)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:33:06.234272 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcbf92c-5344-4e40-96cb-6b06ae8c4cbb admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:33:06.246969 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1314/2633] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 16 12:33:06 2022] PUT /identity/v3/projects/d80ff3e29ee04175ad963b111110d3bd/users/5e36c417656840cb8ab09542c2cca6b3/roles/c39882b202e942479a7cdac2fc6da72c => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:33:06.257410 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40c8aac-9733-4474-aadc-050e2614245a None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:33:06.257757 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40c8aac-9733-4474-aadc-050e2614245a None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:33:06.258035 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40c8aac-9733-4474-aadc-050e2614245a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:33:06.270323 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:33:06.285360 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-a40c8aac-9733-4474-aadc-050e2614245a None None] MFA Rules not processed for user `5e36c417656840cb8ab09542c2cca6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:33:06.286557 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-a40c8aac-9733-4474-aadc-050e2614245a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:33:06.349429 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1320/2634] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 12:33:06 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:33:06.353879 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcbf92c-5344-4e40-96cb-6b06ae8c4cbb admin admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:33:06.416357 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcbf92c-5344-4e40-96cb-6b06ae8c4cbb admin admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:33:06.421112 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3dc58b-8e0f-43b3-873b-008c3b37af2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:33:06.421765 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3dc58b-8e0f-43b3-873b-008c3b37af2a admin admin] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:33:06.422045 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3dc58b-8e0f-43b3-873b-008c3b37af2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:33:06.422318 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3dc58b-8e0f-43b3-873b-008c3b37af2a admin admin] PATH_INFO: `/v3/projects` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:33:06.422998 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3dc58b-8e0f-43b3-873b-008c3b37af2a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:33:06.424916 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3dc58b-8e0f-43b3-873b-008c3b37af2a admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:33:06.449488 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1315/2635] 10.222.0.44 () {60 vars in 1152 bytes} [Thu Jun 16 12:33:06 2022] POST /identity/v3/projects => generated 379 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 12:33:06.453510 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40c8aac-9733-4474-aadc-050e2614245a None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:33:06.464632 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40c8aac-9733-4474-aadc-050e2614245a None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:33:06.519265 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a1ff56-dfcd-414e-8524-03b14d9a5385 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:33:06.519913 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a1ff56-dfcd-414e-8524-03b14d9a5385 admin admin] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:33:06.520189 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a1ff56-dfcd-414e-8524-03b14d9a5385 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:33:06.520465 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a1ff56-dfcd-414e-8524-03b14d9a5385 admin admin] PATH_INFO: `/v3/users` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:33:06.522121 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a1ff56-dfcd-414e-8524-03b14d9a5385 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:33:06.524096 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a1ff56-dfcd-414e-8524-03b14d9a5385 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:33:06.544457 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1321/2636] 10.222.0.44 () {60 vars in 1143 bytes} [Thu Jun 16 12:33:06 2022] POST /identity/v3/users => generated 296 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 12:33:06.548383 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3dc58b-8e0f-43b3-873b-008c3b37af2a admin admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:33:06.558982 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3dc58b-8e0f-43b3-873b-008c3b37af2a admin admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:33:06.563492 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247780c1-be9e-4b42-b431-0622a29003e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:33:06.564150 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247780c1-be9e-4b42-b431-0622a29003e7 admin admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:33:06.564415 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247780c1-be9e-4b42-b431-0622a29003e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:33:06.564685 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247780c1-be9e-4b42-b431-0622a29003e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:33:06.565435 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247780c1-be9e-4b42-b431-0622a29003e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:33:06.567040 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247780c1-be9e-4b42-b431-0622a29003e7 admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:33:06.578225 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1316/2637] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 12:33:06 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 12:33:06.582186 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a1ff56-dfcd-414e-8524-03b14d9a5385 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:33:06.592082 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a1ff56-dfcd-414e-8524-03b14d9a5385 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:33:06.596721 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3245f5a-3b0c-4426-b2af-8d52bdb92875 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:33:06.597679 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3245f5a-3b0c-4426-b2af-8d52bdb92875 admin admin] REQUEST_METHOD: `PUT` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:33:06.597961 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3245f5a-3b0c-4426-b2af-8d52bdb92875 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:33:06.598235 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3245f5a-3b0c-4426-b2af-8d52bdb92875 admin admin] PATH_INFO: `/v3/projects/8c5f6ba310b84098a4bc7373b79844ab/users/399df8e6acc049859c89b76ee4b82e9a/roles/0688968254744e3f9913653cafea3091` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:33:06.613109 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3245f5a-3b0c-4426-b2af-8d52bdb92875 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c5f6ba310b84098a4bc7373b79844ab, user_id=399df8e6acc049859c89b76ee4b82e9a, role_id=0688968254744e3f9913653cafea3091)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:33:06.616618 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3245f5a-3b0c-4426-b2af-8d52bdb92875 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:33:06.629652 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1322/2638] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 16 12:33:06 2022] PUT /identity/v3/projects/8c5f6ba310b84098a4bc7373b79844ab/users/399df8e6acc049859c89b76ee4b82e9a/roles/0688968254744e3f9913653cafea3091 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 12:33:06.634180 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247780c1-be9e-4b42-b431-0622a29003e7 admin admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:33:06.644274 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247780c1-be9e-4b42-b431-0622a29003e7 admin admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:33:06.649105 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:33:06.700866 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c27167-243d-4291-970a-1c81d3964862 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:33:06.701518 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c27167-243d-4291-970a-1c81d3964862 admin admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:33:06.701794 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c27167-243d-4291-970a-1c81d3964862 admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:33:06.702065 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c27167-243d-4291-970a-1c81d3964862 admin admin] PATH_INFO: `/v3/roles` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:33:06.702779 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c27167-243d-4291-970a-1c81d3964862 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:33:06.704353 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c27167-243d-4291-970a-1c81d3964862 admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:33:06.713747 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1317/2639] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 12:33:06 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 12:33:06.717822 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3245f5a-3b0c-4426-b2af-8d52bdb92875 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:33:06.728063 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3245f5a-3b0c-4426-b2af-8d52bdb92875 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:33:06.732636 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4d3ec0-b8b1-4bbb-a0d9-91b1f73935a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:33:06.733553 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4d3ec0-b8b1-4bbb-a0d9-91b1f73935a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:33:06.733832 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4d3ec0-b8b1-4bbb-a0d9-91b1f73935a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:33:06.734103 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4d3ec0-b8b1-4bbb-a0d9-91b1f73935a9 admin admin] PATH_INFO: `/v3/projects/8c5f6ba310b84098a4bc7373b79844ab/users/399df8e6acc049859c89b76ee4b82e9a/roles/0688968254744e3f9913653cafea3091` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:33:06.736098 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4d3ec0-b8b1-4bbb-a0d9-91b1f73935a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c5f6ba310b84098a4bc7373b79844ab, user_id=399df8e6acc049859c89b76ee4b82e9a, role_id=0688968254744e3f9913653cafea3091)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:33:06.738761 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4d3ec0-b8b1-4bbb-a0d9-91b1f73935a9 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:33:06.749619 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1323/2640] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 16 12:33:06 2022] PUT /identity/v3/projects/8c5f6ba310b84098a4bc7373b79844ab/users/399df8e6acc049859c89b76ee4b82e9a/roles/0688968254744e3f9913653cafea3091 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:33:06.759943 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc37602-cf29-4ede-9ffd-cd3e425de220 None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:33:06.760236 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc37602-cf29-4ede-9ffd-cd3e425de220 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:33:06.760545 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc37602-cf29-4ede-9ffd-cd3e425de220 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:33:06.786654 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-5dc37602-cf29-4ede-9ffd-cd3e425de220 None None] MFA Rules not processed for user `399df8e6acc049859c89b76ee4b82e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:33:06.787879 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-5dc37602-cf29-4ede-9ffd-cd3e425de220 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:33:06.855806 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1318/2641] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 12:33:06 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:33:06.867385 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4d3ec0-b8b1-4bbb-a0d9-91b1f73935a9 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:33:06.869127 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-ff4d3ec0-b8b1-4bbb-a0d9-91b1f73935a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:33:06.921050 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:33:06.925298 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4d3ec0-b8b1-4bbb-a0d9-91b1f73935a9 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:33:06.930669 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f049c537-0438-4ceb-b6c8-8c5d4f171d76 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f96fc14ed89478c8a8c2f11c87511e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '601361df39e34fcca71175aa94e425c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:33:06.931317 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f049c537-0438-4ceb-b6c8-8c5d4f171d76 service cinder] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:33:06.932033 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f049c537-0438-4ceb-b6c8-8c5d4f171d76 service cinder] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:33:06.932310 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f049c537-0438-4ceb-b6c8-8c5d4f171d76 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:33:06.941694 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f049c537-0438-4ceb-b6c8-8c5d4f171d76 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:33:06.943138 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f049c537-0438-4ceb-b6c8-8c5d4f171d76 service cinder] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:33:06.952587 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1324/2642] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 12:33:06 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 12:33:06.993280 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc37602-cf29-4ede-9ffd-cd3e425de220 None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:33:06.994690 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-5dc37602-cf29-4ede-9ffd-cd3e425de220 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:33:07.006610 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc37602-cf29-4ede-9ffd-cd3e425de220 None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:33:07.010422 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d33a1ec-3621-4297-a930-a5c42d014c0f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f96fc14ed89478c8a8c2f11c87511e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '601361df39e34fcca71175aa94e425c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:33:07.011055 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d33a1ec-3621-4297-a930-a5c42d014c0f service cinder] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:33:07.011338 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d33a1ec-3621-4297-a930-a5c42d014c0f service cinder] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:33:07.011612 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d33a1ec-3621-4297-a930-a5c42d014c0f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:33:07.067296 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d33a1ec-3621-4297-a930-a5c42d014c0f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:33:07.068735 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d33a1ec-3621-4297-a930-a5c42d014c0f service cinder] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:33:07.077522 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1319/2643] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 12:33:06 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 12:33:09.898422 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f049c537-0438-4ceb-b6c8-8c5d4f171d76 service cinder] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:33:09.959912 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f049c537-0438-4ceb-b6c8-8c5d4f171d76 service cinder] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:33:09.964399 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca55ae88-db38-468f-a529-42e2f16eed2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:33:09.965292 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca55ae88-db38-468f-a529-42e2f16eed2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:33:09.965573 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca55ae88-db38-468f-a529-42e2f16eed2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:33:09.965849 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca55ae88-db38-468f-a529-42e2f16eed2d admin admin] PATH_INFO: `/v3/users/c86f0e66adf54edeababb8850fb1fd7e` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:33:09.967051 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca55ae88-db38-468f-a529-42e2f16eed2d admin admin] RBAC: Authorizing `identity:delete_user(user_id=c86f0e66adf54edeababb8850fb1fd7e)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:33:09.968998 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca55ae88-db38-468f-a529-42e2f16eed2d admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:33:10.012268 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-ca55ae88-db38-468f-a529-42e2f16eed2d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c86f0e66adf54edeababb8850fb1fd7e'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:33:10.012940 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-ca55ae88-db38-468f-a529-42e2f16eed2d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c86f0e66adf54edeababb8850fb1fd7e'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:33:10.019557 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-ca55ae88-db38-468f-a529-42e2f16eed2d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c86f0e66adf54edeababb8850fb1fd7e'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:33:10.020183 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-ca55ae88-db38-468f-a529-42e2f16eed2d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c86f0e66adf54edeababb8850fb1fd7e'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:33:10.027903 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-ca55ae88-db38-468f-a529-42e2f16eed2d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c86f0e66adf54edeababb8850fb1fd7e'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:33:10.044654 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1325/2644] 10.222.0.44 () {58 vars in 1223 bytes} [Thu Jun 16 12:33:09 2022] DELETE /identity/v3/users/c86f0e66adf54edeababb8850fb1fd7e => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:33:10.049158 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c298d7-490b-4897-a180-ea8df99c9ceb None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:33:10.049628 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c298d7-490b-4897-a180-ea8df99c9ceb None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:33:10.049731 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c298d7-490b-4897-a180-ea8df99c9ceb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:33:10.066854 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-95c298d7-490b-4897-a180-ea8df99c9ceb None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:33:10.068478 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-95c298d7-490b-4897-a180-ea8df99c9ceb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:33:10.093237 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:33:10.127025 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1320/2645] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 12:33:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:33:10.137137 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca55ae88-db38-468f-a529-42e2f16eed2d admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:33:10.138534 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-ca55ae88-db38-468f-a529-42e2f16eed2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:33:10.196266 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca55ae88-db38-468f-a529-42e2f16eed2d admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:33:10.199846 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116ac59d-7a86-4570-acbe-cfa05974575c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1094729b25a4be7b0b394998c9ca681', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '601361df39e34fcca71175aa94e425c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:33:10.200485 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116ac59d-7a86-4570-acbe-cfa05974575c service neutron] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:33:10.200778 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116ac59d-7a86-4570-acbe-cfa05974575c service neutron] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:33:10.201062 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116ac59d-7a86-4570-acbe-cfa05974575c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:33:10.210516 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116ac59d-7a86-4570-acbe-cfa05974575c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:33:10.211924 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116ac59d-7a86-4570-acbe-cfa05974575c service neutron] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:33:10.221181 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1326/2646] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 12:33:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 12:33:10.491978 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c298d7-490b-4897-a180-ea8df99c9ceb None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:33:10.493496 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-95c298d7-490b-4897-a180-ea8df99c9ceb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:33:10.505911 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c298d7-490b-4897-a180-ea8df99c9ceb None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:33:10.510559 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f492b08-47f5-4f98-8e99-6b9acab73156 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:33:10.511419 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f492b08-47f5-4f98-8e99-6b9acab73156 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:33:10.511698 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f492b08-47f5-4f98-8e99-6b9acab73156 admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:33:10.511968 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f492b08-47f5-4f98-8e99-6b9acab73156 admin admin] PATH_INFO: `/v3/projects/2113371916c14d45a1c095486533e1b6` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:33:10.513217 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f492b08-47f5-4f98-8e99-6b9acab73156 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2113371916c14d45a1c095486533e1b6)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:33:10.515144 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f492b08-47f5-4f98-8e99-6b9acab73156 admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:33:10.560371 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-7f492b08-47f5-4f98-8e99-6b9acab73156 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2113371916c14d45a1c095486533e1b6', 'request_id': 'req-7f492b08-47f5-4f98-8e99-6b9acab73156'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:33:10.567325 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-7f492b08-47f5-4f98-8e99-6b9acab73156 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2113371916c14d45a1c095486533e1b6', 'request_id': 'req-7f492b08-47f5-4f98-8e99-6b9acab73156'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:33:10.573542 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-7f492b08-47f5-4f98-8e99-6b9acab73156 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2113371916c14d45a1c095486533e1b6', 'request_id': 'req-7f492b08-47f5-4f98-8e99-6b9acab73156'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:33:10.584680 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-7f492b08-47f5-4f98-8e99-6b9acab73156 admin admin] The token cache is being invalidate because project 2113371916c14d45a1c095486533e1b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 12:33:10.585002 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-7f492b08-47f5-4f98-8e99-6b9acab73156 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:33:10.585629 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-7f492b08-47f5-4f98-8e99-6b9acab73156 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:33:10.587166 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1321/2647] 10.222.0.44 () {58 vars in 1232 bytes} [Thu Jun 16 12:33:10 2022] DELETE /identity/v3/projects/2113371916c14d45a1c095486533e1b6 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:33:10.591073 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116ac59d-7a86-4570-acbe-cfa05974575c service neutron] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:33:10.601410 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116ac59d-7a86-4570-acbe-cfa05974575c service neutron] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:33:10.610191 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:33:10.657717 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2f4741-39fa-4e7a-8d74-80f137a99d1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:33:10.658583 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2f4741-39fa-4e7a-8d74-80f137a99d1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:33:10.658861 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2f4741-39fa-4e7a-8d74-80f137a99d1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:33:10.659131 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2f4741-39fa-4e7a-8d74-80f137a99d1c admin admin] PATH_INFO: `/v3/users/5e36c417656840cb8ab09542c2cca6b3` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:33:10.660299 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2f4741-39fa-4e7a-8d74-80f137a99d1c admin admin] RBAC: Authorizing `identity:delete_user(user_id=5e36c417656840cb8ab09542c2cca6b3)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:33:10.662788 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2f4741-39fa-4e7a-8d74-80f137a99d1c admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:33:10.707112 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-9c2f4741-39fa-4e7a-8d74-80f137a99d1c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5e36c417656840cb8ab09542c2cca6b3'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:33:10.707757 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-9c2f4741-39fa-4e7a-8d74-80f137a99d1c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5e36c417656840cb8ab09542c2cca6b3'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:33:10.714558 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-9c2f4741-39fa-4e7a-8d74-80f137a99d1c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5e36c417656840cb8ab09542c2cca6b3'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:33:10.715185 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-9c2f4741-39fa-4e7a-8d74-80f137a99d1c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5e36c417656840cb8ab09542c2cca6b3'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:33:10.722085 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-9c2f4741-39fa-4e7a-8d74-80f137a99d1c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5e36c417656840cb8ab09542c2cca6b3'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:33:10.740324 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1327/2648] 10.222.0.44 () {58 vars in 1223 bytes} [Thu Jun 16 12:33:10 2022] DELETE /identity/v3/users/5e36c417656840cb8ab09542c2cca6b3 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:33:11.003918 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f492b08-47f5-4f98-8e99-6b9acab73156 admin admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:33:11.005532 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-7f492b08-47f5-4f98-8e99-6b9acab73156 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:33:11.020062 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f492b08-47f5-4f98-8e99-6b9acab73156 admin admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:33:11.076641 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149f95a8-5472-4f44-a529-430dcc8ec71e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:33:11.077536 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149f95a8-5472-4f44-a529-430dcc8ec71e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:33:11.077810 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149f95a8-5472-4f44-a529-430dcc8ec71e admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:33:11.078080 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149f95a8-5472-4f44-a529-430dcc8ec71e admin admin] PATH_INFO: `/v3/projects/d80ff3e29ee04175ad963b111110d3bd` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:33:11.079266 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149f95a8-5472-4f44-a529-430dcc8ec71e admin admin] RBAC: Authorizing `identity:delete_project(project_id=d80ff3e29ee04175ad963b111110d3bd)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:33:11.081213 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149f95a8-5472-4f44-a529-430dcc8ec71e admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:33:11.126372 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-149f95a8-5472-4f44-a529-430dcc8ec71e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd80ff3e29ee04175ad963b111110d3bd', 'request_id': 'req-149f95a8-5472-4f44-a529-430dcc8ec71e'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:33:11.129702 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:33:11.133938 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-149f95a8-5472-4f44-a529-430dcc8ec71e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd80ff3e29ee04175ad963b111110d3bd', 'request_id': 'req-149f95a8-5472-4f44-a529-430dcc8ec71e'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:33:11.140314 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-149f95a8-5472-4f44-a529-430dcc8ec71e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd80ff3e29ee04175ad963b111110d3bd', 'request_id': 'req-149f95a8-5472-4f44-a529-430dcc8ec71e'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:33:11.152613 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-149f95a8-5472-4f44-a529-430dcc8ec71e admin admin] The token cache is being invalidate because project d80ff3e29ee04175ad963b111110d3bd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 12:33:11.152925 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-149f95a8-5472-4f44-a529-430dcc8ec71e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:33:11.153553 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-149f95a8-5472-4f44-a529-430dcc8ec71e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:33:11.155072 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1322/2649] 10.222.0.44 () {58 vars in 1232 bytes} [Thu Jun 16 12:33:11 2022] DELETE /identity/v3/projects/d80ff3e29ee04175ad963b111110d3bd => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:33:11.159076 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2f4741-39fa-4e7a-8d74-80f137a99d1c admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:33:11.160478 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-9c2f4741-39fa-4e7a-8d74-80f137a99d1c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:33:11.173612 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2f4741-39fa-4e7a-8d74-80f137a99d1c admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:33:11.230295 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b86c86-577b-450d-a471-c06ae4ae01d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:33:11.231150 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b86c86-577b-450d-a471-c06ae4ae01d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:33:11.231426 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b86c86-577b-450d-a471-c06ae4ae01d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:33:11.231695 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b86c86-577b-450d-a471-c06ae4ae01d1 admin admin] PATH_INFO: `/v3/users/399df8e6acc049859c89b76ee4b82e9a` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:33:11.232895 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b86c86-577b-450d-a471-c06ae4ae01d1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=399df8e6acc049859c89b76ee4b82e9a)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:33:11.234795 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b86c86-577b-450d-a471-c06ae4ae01d1 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:33:11.270223 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:33:11.281626 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-77b86c86-577b-450d-a471-c06ae4ae01d1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '399df8e6acc049859c89b76ee4b82e9a'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:33:11.282320 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-77b86c86-577b-450d-a471-c06ae4ae01d1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '399df8e6acc049859c89b76ee4b82e9a'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:33:11.289771 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-77b86c86-577b-450d-a471-c06ae4ae01d1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '399df8e6acc049859c89b76ee4b82e9a'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:33:11.290435 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-77b86c86-577b-450d-a471-c06ae4ae01d1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '399df8e6acc049859c89b76ee4b82e9a'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:33:11.297009 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-77b86c86-577b-450d-a471-c06ae4ae01d1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '399df8e6acc049859c89b76ee4b82e9a'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:33:11.313814 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1328/2650] 10.222.0.44 () {58 vars in 1223 bytes} [Thu Jun 16 12:33:11 2022] DELETE /identity/v3/users/399df8e6acc049859c89b76ee4b82e9a => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:33:11.576103 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149f95a8-5472-4f44-a529-430dcc8ec71e admin admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:33:11.577682 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-149f95a8-5472-4f44-a529-430dcc8ec71e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:33:11.592612 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149f95a8-5472-4f44-a529-430dcc8ec71e admin admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:33:11.651237 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac7d09d-ecb1-43f8-90bd-30f6013de3a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:33:11.652097 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac7d09d-ecb1-43f8-90bd-30f6013de3a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:33:11.652379 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac7d09d-ecb1-43f8-90bd-30f6013de3a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:33:11.652656 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac7d09d-ecb1-43f8-90bd-30f6013de3a8 admin admin] PATH_INFO: `/v3/projects/8c5f6ba310b84098a4bc7373b79844ab` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:33:11.653905 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac7d09d-ecb1-43f8-90bd-30f6013de3a8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8c5f6ba310b84098a4bc7373b79844ab)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:33:11.655818 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac7d09d-ecb1-43f8-90bd-30f6013de3a8 admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:33:11.701909 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-4ac7d09d-ecb1-43f8-90bd-30f6013de3a8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8c5f6ba310b84098a4bc7373b79844ab', 'request_id': 'req-4ac7d09d-ecb1-43f8-90bd-30f6013de3a8'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:33:11.709540 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-4ac7d09d-ecb1-43f8-90bd-30f6013de3a8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8c5f6ba310b84098a4bc7373b79844ab', 'request_id': 'req-4ac7d09d-ecb1-43f8-90bd-30f6013de3a8'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:33:11.715080 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-4ac7d09d-ecb1-43f8-90bd-30f6013de3a8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8c5f6ba310b84098a4bc7373b79844ab', 'request_id': 'req-4ac7d09d-ecb1-43f8-90bd-30f6013de3a8'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:33:11.726001 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-4ac7d09d-ecb1-43f8-90bd-30f6013de3a8 admin admin] The token cache is being invalidate because project 8c5f6ba310b84098a4bc7373b79844ab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 12:33:11.726287 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-4ac7d09d-ecb1-43f8-90bd-30f6013de3a8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:33:11.726919 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-4ac7d09d-ecb1-43f8-90bd-30f6013de3a8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:33:11.728424 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1323/2651] 10.222.0.44 () {58 vars in 1232 bytes} [Thu Jun 16 12:33:11 2022] DELETE /identity/v3/projects/8c5f6ba310b84098a4bc7373b79844ab => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:33:11.734447 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3627a00b-c4a0-4258-b2ca-b1d4fc6762c3 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:33:11.734735 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3627a00b-c4a0-4258-b2ca-b1d4fc6762c3 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:33:11.735014 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3627a00b-c4a0-4258-b2ca-b1d4fc6762c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:33:11.753156 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-3627a00b-c4a0-4258-b2ca-b1d4fc6762c3 None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:33:11.754352 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-3627a00b-c4a0-4258-b2ca-b1d4fc6762c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:33:11.812486 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1329/2652] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 12:33:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:33:11.821418 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a318b6b-8127-4317-9112-be4d988fb6ad None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:33:11.821709 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a318b6b-8127-4317-9112-be4d988fb6ad None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:33:11.821990 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a318b6b-8127-4317-9112-be4d988fb6ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:33:11.839772 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-1a318b6b-8127-4317-9112-be4d988fb6ad None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:33:11.841033 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-1a318b6b-8127-4317-9112-be4d988fb6ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:33:11.848914 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1324/2653] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 12:33:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:33:11.852864 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3627a00b-c4a0-4258-b2ca-b1d4fc6762c3 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:33:11.862387 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3627a00b-c4a0-4258-b2ca-b1d4fc6762c3 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:33:11.867408 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2e4e41-0337-4804-b1a0-4584216e7652 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:33:11.868044 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2e4e41-0337-4804-b1a0-4584216e7652 admin admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:33:11.868320 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2e4e41-0337-4804-b1a0-4584216e7652 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:33:11.868591 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2e4e41-0337-4804-b1a0-4584216e7652 admin admin] PATH_INFO: `/v3/domains` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:33:11.869340 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2e4e41-0337-4804-b1a0-4584216e7652 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:33:11.869642 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2e4e41-0337-4804-b1a0-4584216e7652 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:33:11.871231 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2e4e41-0337-4804-b1a0-4584216e7652 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:33:11.883009 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1330/2654] 10.222.0.44 () {58 vars in 1152 bytes} [Thu Jun 16 12:33:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 12:33:11.887115 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a318b6b-8127-4317-9112-be4d988fb6ad None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:33:11.896200 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a318b6b-8127-4317-9112-be4d988fb6ad None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:33:11.901124 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce9aefe-9709-49eb-996e-c9d2e622a6a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:33:11.901761 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce9aefe-9709-49eb-996e-c9d2e622a6a1 admin admin] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:33:11.902042 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce9aefe-9709-49eb-996e-c9d2e622a6a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:33:11.902330 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce9aefe-9709-49eb-996e-c9d2e622a6a1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:33:11.902991 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce9aefe-9709-49eb-996e-c9d2e622a6a1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:33:11.904941 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce9aefe-9709-49eb-996e-c9d2e622a6a1 admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:33:11.930125 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1325/2655] 10.222.0.44 () {60 vars in 1152 bytes} [Thu Jun 16 12:33:11 2022] POST /identity/v3/projects => generated 385 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 12:33:11.934210 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2e4e41-0337-4804-b1a0-4584216e7652 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:33:11.944918 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2e4e41-0337-4804-b1a0-4584216e7652 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:33:11.999570 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef02260-d7b6-4817-bf7a-2f13899ba802 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:33:12.000156 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef02260-d7b6-4817-bf7a-2f13899ba802 admin admin] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:33:12.000432 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef02260-d7b6-4817-bf7a-2f13899ba802 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:33:12.000700 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef02260-d7b6-4817-bf7a-2f13899ba802 admin admin] PATH_INFO: `/v3/users` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:33:12.001409 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef02260-d7b6-4817-bf7a-2f13899ba802 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:33:12.003347 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef02260-d7b6-4817-bf7a-2f13899ba802 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:33:12.022981 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1331/2656] 10.222.0.44 () {60 vars in 1143 bytes} [Thu Jun 16 12:33:11 2022] POST /identity/v3/users => generated 293 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 12:33:12.027571 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce9aefe-9709-49eb-996e-c9d2e622a6a1 admin admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:33:12.037553 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce9aefe-9709-49eb-996e-c9d2e622a6a1 admin admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:33:12.042052 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b4684f-076e-461e-9fbe-deaa88d3abfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:33:12.042696 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b4684f-076e-461e-9fbe-deaa88d3abfb admin admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:33:12.042974 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b4684f-076e-461e-9fbe-deaa88d3abfb admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:33:12.043245 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b4684f-076e-461e-9fbe-deaa88d3abfb admin admin] PATH_INFO: `/v3/roles` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:33:12.043963 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b4684f-076e-461e-9fbe-deaa88d3abfb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:33:12.045570 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b4684f-076e-461e-9fbe-deaa88d3abfb admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:33:12.056149 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1326/2657] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 12:33:12 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 12:33:12.059728 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef02260-d7b6-4817-bf7a-2f13899ba802 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:33:12.070166 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef02260-d7b6-4817-bf7a-2f13899ba802 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:33:12.074670 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4908ea38-47e9-40aa-802b-9b629a487f38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:33:12.075312 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4908ea38-47e9-40aa-802b-9b629a487f38 admin admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:33:12.075590 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4908ea38-47e9-40aa-802b-9b629a487f38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:33:12.075861 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4908ea38-47e9-40aa-802b-9b629a487f38 admin admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:33:12.076576 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4908ea38-47e9-40aa-802b-9b629a487f38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:33:12.078182 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4908ea38-47e9-40aa-802b-9b629a487f38 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:33:12.087816 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1332/2658] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 12:33:12 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 12:33:12.091609 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b4684f-076e-461e-9fbe-deaa88d3abfb admin admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:33:12.102281 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b4684f-076e-461e-9fbe-deaa88d3abfb admin admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:33:12.106908 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77391643-cb65-4085-94f0-d04d60053130 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:33:12.107774 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77391643-cb65-4085-94f0-d04d60053130 admin admin] REQUEST_METHOD: `PUT` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:33:12.108057 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77391643-cb65-4085-94f0-d04d60053130 admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:33:12.108333 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77391643-cb65-4085-94f0-d04d60053130 admin admin] PATH_INFO: `/v3/projects/3b9b6f841cec4ee584d1d5f5e35c0fc9/users/ebd993cb5b494285b3acfcabbcef5691/roles/c39882b202e942479a7cdac2fc6da72c` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:33:12.123107 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77391643-cb65-4085-94f0-d04d60053130 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b9b6f841cec4ee584d1d5f5e35c0fc9, user_id=ebd993cb5b494285b3acfcabbcef5691, role_id=c39882b202e942479a7cdac2fc6da72c)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:33:12.125817 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77391643-cb65-4085-94f0-d04d60053130 admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:33:12.138306 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1327/2659] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 16 12:33:12 2022] PUT /identity/v3/projects/3b9b6f841cec4ee584d1d5f5e35c0fc9/users/ebd993cb5b494285b3acfcabbcef5691/roles/c39882b202e942479a7cdac2fc6da72c => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 12:33:12.149191 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ee2132-f3b5-4f84-a970-607897f18b8a None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:33:12.149532 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ee2132-f3b5-4f84-a970-607897f18b8a None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:33:12.150084 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ee2132-f3b5-4f84-a970-607897f18b8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:33:12.176278 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-98ee2132-f3b5-4f84-a970-607897f18b8a None None] MFA Rules not processed for user `ebd993cb5b494285b3acfcabbcef5691`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:33:12.177594 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-98ee2132-f3b5-4f84-a970-607897f18b8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:33:12.183195 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:33:12.244293 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1333/2660] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 12:33:12 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:33:12.248766 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77391643-cb65-4085-94f0-d04d60053130 admin admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:33:12.258563 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=88,keystone:DELETE=9,keystone:INSERT=3 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:33:12.311811 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77391643-cb65-4085-94f0-d04d60053130 admin admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:33:12.316442 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a42059-e668-478d-9a93-fe863a00e8e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:33:12.317136 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a42059-e668-478d-9a93-fe863a00e8e1 admin admin] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:33:12.317421 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a42059-e668-478d-9a93-fe863a00e8e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:33:12.317697 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a42059-e668-478d-9a93-fe863a00e8e1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:33:12.318374 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a42059-e668-478d-9a93-fe863a00e8e1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:33:12.320263 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a42059-e668-478d-9a93-fe863a00e8e1 admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:33:12.344508 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1328/2661] 10.222.0.44 () {60 vars in 1152 bytes} [Thu Jun 16 12:33:12 2022] POST /identity/v3/projects => generated 385 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 12:33:12.348509 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ee2132-f3b5-4f84-a970-607897f18b8a None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:33:12.359619 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ee2132-f3b5-4f84-a970-607897f18b8a None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:33:12.423054 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edff274-9dbb-4e56-827b-1199884995f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:33:12.423712 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edff274-9dbb-4e56-827b-1199884995f7 admin admin] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:33:12.423988 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edff274-9dbb-4e56-827b-1199884995f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:33:12.424257 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edff274-9dbb-4e56-827b-1199884995f7 admin admin] PATH_INFO: `/v3/users` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:33:12.425582 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edff274-9dbb-4e56-827b-1199884995f7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:33:12.428041 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edff274-9dbb-4e56-827b-1199884995f7 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:33:12.447064 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1334/2662] 10.222.0.44 () {60 vars in 1143 bytes} [Thu Jun 16 12:33:12 2022] POST /identity/v3/users => generated 299 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 12:33:12.450985 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a42059-e668-478d-9a93-fe863a00e8e1 admin admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:33:12.461514 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a42059-e668-478d-9a93-fe863a00e8e1 admin admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:33:12.466016 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79949af-323d-415b-9534-55d6ba29fa40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:33:12.466659 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79949af-323d-415b-9534-55d6ba29fa40 admin admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:33:12.466939 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79949af-323d-415b-9534-55d6ba29fa40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:33:12.467211 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79949af-323d-415b-9534-55d6ba29fa40 admin admin] PATH_INFO: `/v3/roles` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:33:12.467929 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79949af-323d-415b-9534-55d6ba29fa40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:33:12.469529 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79949af-323d-415b-9534-55d6ba29fa40 admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:33:12.480201 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1329/2663] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 12:33:12 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 12:33:12.484019 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edff274-9dbb-4e56-827b-1199884995f7 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:33:12.494031 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edff274-9dbb-4e56-827b-1199884995f7 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:33:12.498687 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cb265e-da81-4d68-80ed-605031aa26fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:33:12.499555 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cb265e-da81-4d68-80ed-605031aa26fa admin admin] REQUEST_METHOD: `PUT` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:33:12.499832 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cb265e-da81-4d68-80ed-605031aa26fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:33:12.500105 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cb265e-da81-4d68-80ed-605031aa26fa admin admin] PATH_INFO: `/v3/projects/83c07f10ab4e44d386f9c2d4135857fc/users/b5e43e17389248ad86a93460b26a0a7b/roles/0688968254744e3f9913653cafea3091` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:33:12.514621 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cb265e-da81-4d68-80ed-605031aa26fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=83c07f10ab4e44d386f9c2d4135857fc, user_id=b5e43e17389248ad86a93460b26a0a7b, role_id=0688968254744e3f9913653cafea3091)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:33:12.517260 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cb265e-da81-4d68-80ed-605031aa26fa admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:33:12.530308 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1335/2664] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 16 12:33:12 2022] PUT /identity/v3/projects/83c07f10ab4e44d386f9c2d4135857fc/users/b5e43e17389248ad86a93460b26a0a7b/roles/0688968254744e3f9913653cafea3091 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:33:12.534204 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79949af-323d-415b-9534-55d6ba29fa40 admin admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:33:12.544437 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79949af-323d-415b-9534-55d6ba29fa40 admin admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:33:12.597278 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee636a9-36ab-4e5d-b626-fa7de43bb193 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:33:12.597924 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee636a9-36ab-4e5d-b626-fa7de43bb193 admin admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:33:12.598202 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee636a9-36ab-4e5d-b626-fa7de43bb193 admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:33:12.598478 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee636a9-36ab-4e5d-b626-fa7de43bb193 admin admin] PATH_INFO: `/v3/roles` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:33:12.599771 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee636a9-36ab-4e5d-b626-fa7de43bb193 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:33:12.601432 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee636a9-36ab-4e5d-b626-fa7de43bb193 admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:33:12.610662 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1330/2665] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 12:33:12 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 12:33:12.614899 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cb265e-da81-4d68-80ed-605031aa26fa admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:33:12.624873 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cb265e-da81-4d68-80ed-605031aa26fa admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:33:12.629390 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a24acf3-5e71-4249-a6ae-1978b9f03c60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:33:12.630253 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a24acf3-5e71-4249-a6ae-1978b9f03c60 admin admin] REQUEST_METHOD: `PUT` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:33:12.630596 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a24acf3-5e71-4249-a6ae-1978b9f03c60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:33:12.630868 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a24acf3-5e71-4249-a6ae-1978b9f03c60 admin admin] PATH_INFO: `/v3/projects/83c07f10ab4e44d386f9c2d4135857fc/users/b5e43e17389248ad86a93460b26a0a7b/roles/0688968254744e3f9913653cafea3091` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:33:12.632845 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a24acf3-5e71-4249-a6ae-1978b9f03c60 admin admin] RBAC: Authorizing `identity:create_grant(project_id=83c07f10ab4e44d386f9c2d4135857fc, user_id=b5e43e17389248ad86a93460b26a0a7b, role_id=0688968254744e3f9913653cafea3091)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:33:12.635445 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a24acf3-5e71-4249-a6ae-1978b9f03c60 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:33:12.645426 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1336/2666] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 16 12:33:12 2022] PUT /identity/v3/projects/83c07f10ab4e44d386f9c2d4135857fc/users/b5e43e17389248ad86a93460b26a0a7b/roles/0688968254744e3f9913653cafea3091 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:33:12.656978 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fc8e4e-29f7-4900-b95d-7fdc901b0989 None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:33:12.657267 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fc8e4e-29f7-4900-b95d-7fdc901b0989 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:33:12.657545 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fc8e4e-29f7-4900-b95d-7fdc901b0989 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:33:12.683281 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-67fc8e4e-29f7-4900-b95d-7fdc901b0989 None None] MFA Rules not processed for user `b5e43e17389248ad86a93460b26a0a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:33:12.684472 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-67fc8e4e-29f7-4900-b95d-7fdc901b0989 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:33:12.749375 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1331/2667] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 12:33:12 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:33:12.760177 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a24acf3-5e71-4249-a6ae-1978b9f03c60 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:33:12.761919 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-3a24acf3-5e71-4249-a6ae-1978b9f03c60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:33:12.818366 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a24acf3-5e71-4249-a6ae-1978b9f03c60 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:33:12.822117 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab159354-ad3d-4544-8890-4d53e060104b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f96fc14ed89478c8a8c2f11c87511e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '601361df39e34fcca71175aa94e425c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:33:12.822755 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab159354-ad3d-4544-8890-4d53e060104b service cinder] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:33:12.823037 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab159354-ad3d-4544-8890-4d53e060104b service cinder] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:33:12.823314 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab159354-ad3d-4544-8890-4d53e060104b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:33:12.835682 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:33:12.879326 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab159354-ad3d-4544-8890-4d53e060104b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:33:12.881315 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab159354-ad3d-4544-8890-4d53e060104b service cinder] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:33:12.890138 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1337/2668] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 12:33:12 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 12:33:17.012560 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fc8e4e-29f7-4900-b95d-7fdc901b0989 None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:33:17.014029 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-67fc8e4e-29f7-4900-b95d-7fdc901b0989 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:33:17.022589 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:33:17.027011 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fc8e4e-29f7-4900-b95d-7fdc901b0989 None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:33:17.031657 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaffd62e-2424-4e2c-bb7a-e6d4863f78e8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f96fc14ed89478c8a8c2f11c87511e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '601361df39e34fcca71175aa94e425c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:33:17.032471 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaffd62e-2424-4e2c-bb7a-e6d4863f78e8 service cinder] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:33:17.032793 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaffd62e-2424-4e2c-bb7a-e6d4863f78e8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:33:17.033076 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaffd62e-2424-4e2c-bb7a-e6d4863f78e8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:33:17.042960 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaffd62e-2424-4e2c-bb7a-e6d4863f78e8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:33:17.044382 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaffd62e-2424-4e2c-bb7a-e6d4863f78e8 service cinder] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:33:17.054094 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1332/2669] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 12:33:17 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 12:33:21.915208 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab159354-ad3d-4544-8890-4d53e060104b service cinder] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:33:21.976652 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab159354-ad3d-4544-8890-4d53e060104b service cinder] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:33:21.981124 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd2e2ce-f62d-4505-9218-2943aac1c0f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:33:21.981981 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd2e2ce-f62d-4505-9218-2943aac1c0f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:33:21.982255 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd2e2ce-f62d-4505-9218-2943aac1c0f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:33:21.982523 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd2e2ce-f62d-4505-9218-2943aac1c0f9 admin admin] PATH_INFO: `/v3/users/ebd993cb5b494285b3acfcabbcef5691` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:33:21.983689 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd2e2ce-f62d-4505-9218-2943aac1c0f9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ebd993cb5b494285b3acfcabbcef5691)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:33:21.985639 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd2e2ce-f62d-4505-9218-2943aac1c0f9 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:33:22.039804 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-4bd2e2ce-f62d-4505-9218-2943aac1c0f9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ebd993cb5b494285b3acfcabbcef5691'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:33:22.040469 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-4bd2e2ce-f62d-4505-9218-2943aac1c0f9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ebd993cb5b494285b3acfcabbcef5691'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:33:22.047795 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-4bd2e2ce-f62d-4505-9218-2943aac1c0f9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ebd993cb5b494285b3acfcabbcef5691'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:33:22.048428 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-4bd2e2ce-f62d-4505-9218-2943aac1c0f9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ebd993cb5b494285b3acfcabbcef5691'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:33:22.055437 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-4bd2e2ce-f62d-4505-9218-2943aac1c0f9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ebd993cb5b494285b3acfcabbcef5691'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:33:22.072818 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1338/2670] 10.222.0.44 () {58 vars in 1223 bytes} [Thu Jun 16 12:33:21 2022] DELETE /identity/v3/users/ebd993cb5b494285b3acfcabbcef5691 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:33:22.077324 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7194c7-326e-4f58-919b-3290b052c34f None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:33:22.077782 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7194c7-326e-4f58-919b-3290b052c34f None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:33:22.077893 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7194c7-326e-4f58-919b-3290b052c34f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:33:22.095625 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-4c7194c7-326e-4f58-919b-3290b052c34f None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:33:22.096861 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-4c7194c7-326e-4f58-919b-3290b052c34f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:33:22.155517 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1333/2671] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 12:33:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:33:22.165077 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd2e2ce-f62d-4505-9218-2943aac1c0f9 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:33:22.166493 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-4bd2e2ce-f62d-4505-9218-2943aac1c0f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:33:22.203263 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:33:22.226857 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd2e2ce-f62d-4505-9218-2943aac1c0f9 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:33:22.231487 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be6049f-ddb8-47ea-a9de-6b9382525930 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1094729b25a4be7b0b394998c9ca681', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '601361df39e34fcca71175aa94e425c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:33:22.234527 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be6049f-ddb8-47ea-a9de-6b9382525930 service neutron] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:33:22.234712 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be6049f-ddb8-47ea-a9de-6b9382525930 service neutron] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:33:22.234994 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be6049f-ddb8-47ea-a9de-6b9382525930 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:33:22.245302 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be6049f-ddb8-47ea-a9de-6b9382525930 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:33:22.246843 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be6049f-ddb8-47ea-a9de-6b9382525930 service neutron] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:33:22.257115 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1339/2672] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 12:33:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 12:33:22.540016 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7194c7-326e-4f58-919b-3290b052c34f None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:33:22.541487 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-4c7194c7-326e-4f58-919b-3290b052c34f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:33:22.555432 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7194c7-326e-4f58-919b-3290b052c34f None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:33:22.560208 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b1d2df-3247-4afd-9a8d-3140fa888b6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:33:22.561112 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b1d2df-3247-4afd-9a8d-3140fa888b6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:33:22.561490 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b1d2df-3247-4afd-9a8d-3140fa888b6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:33:22.561655 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b1d2df-3247-4afd-9a8d-3140fa888b6c admin admin] PATH_INFO: `/v3/projects/3b9b6f841cec4ee584d1d5f5e35c0fc9` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:33:22.562888 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b1d2df-3247-4afd-9a8d-3140fa888b6c admin admin] RBAC: Authorizing `identity:delete_project(project_id=3b9b6f841cec4ee584d1d5f5e35c0fc9)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:33:22.564818 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b1d2df-3247-4afd-9a8d-3140fa888b6c admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:33:22.611814 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-b9b1d2df-3247-4afd-9a8d-3140fa888b6c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3b9b6f841cec4ee584d1d5f5e35c0fc9', 'request_id': 'req-b9b1d2df-3247-4afd-9a8d-3140fa888b6c'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:33:22.619724 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-b9b1d2df-3247-4afd-9a8d-3140fa888b6c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3b9b6f841cec4ee584d1d5f5e35c0fc9', 'request_id': 'req-b9b1d2df-3247-4afd-9a8d-3140fa888b6c'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:33:22.625269 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-b9b1d2df-3247-4afd-9a8d-3140fa888b6c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3b9b6f841cec4ee584d1d5f5e35c0fc9', 'request_id': 'req-b9b1d2df-3247-4afd-9a8d-3140fa888b6c'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:33:22.636080 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-b9b1d2df-3247-4afd-9a8d-3140fa888b6c admin admin] The token cache is being invalidate because project 3b9b6f841cec4ee584d1d5f5e35c0fc9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 12:33:22.636366 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-b9b1d2df-3247-4afd-9a8d-3140fa888b6c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:33:22.637019 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-b9b1d2df-3247-4afd-9a8d-3140fa888b6c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:33:22.638535 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1334/2673] 10.222.0.44 () {58 vars in 1232 bytes} [Thu Jun 16 12:33:22 2022] DELETE /identity/v3/projects/3b9b6f841cec4ee584d1d5f5e35c0fc9 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:33:22.642454 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be6049f-ddb8-47ea-a9de-6b9382525930 service neutron] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:33:22.652212 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be6049f-ddb8-47ea-a9de-6b9382525930 service neutron] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:33:22.707350 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d4ca90-f45f-4b49-95a3-665fe089aaff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:33:22.708219 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d4ca90-f45f-4b49-95a3-665fe089aaff admin admin] REQUEST_METHOD: `DELETE` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:33:22.708498 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d4ca90-f45f-4b49-95a3-665fe089aaff admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:33:22.708796 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d4ca90-f45f-4b49-95a3-665fe089aaff admin admin] PATH_INFO: `/v3/users/b5e43e17389248ad86a93460b26a0a7b` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:33:22.709986 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d4ca90-f45f-4b49-95a3-665fe089aaff admin admin] RBAC: Authorizing `identity:delete_user(user_id=b5e43e17389248ad86a93460b26a0a7b)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:33:22.711933 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d4ca90-f45f-4b49-95a3-665fe089aaff admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:33:22.755064 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-51d4ca90-f45f-4b49-95a3-665fe089aaff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b5e43e17389248ad86a93460b26a0a7b'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:33:22.755705 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-51d4ca90-f45f-4b49-95a3-665fe089aaff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b5e43e17389248ad86a93460b26a0a7b'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:33:22.762918 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-51d4ca90-f45f-4b49-95a3-665fe089aaff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b5e43e17389248ad86a93460b26a0a7b'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:33:22.763543 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-51d4ca90-f45f-4b49-95a3-665fe089aaff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b5e43e17389248ad86a93460b26a0a7b'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:33:22.770561 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-51d4ca90-f45f-4b49-95a3-665fe089aaff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b5e43e17389248ad86a93460b26a0a7b'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:33:22.787905 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1340/2674] 10.222.0.44 () {58 vars in 1223 bytes} [Thu Jun 16 12:33:22 2022] DELETE /identity/v3/users/b5e43e17389248ad86a93460b26a0a7b => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:33:23.289135 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b1d2df-3247-4afd-9a8d-3140fa888b6c admin admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:33:23.290861 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-b9b1d2df-3247-4afd-9a8d-3140fa888b6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:33:23.303942 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b1d2df-3247-4afd-9a8d-3140fa888b6c admin admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:33:23.361858 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa54b1c-a3d9-41fa-8163-a05b4e4d7a0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:33:23.362721 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa54b1c-a3d9-41fa-8163-a05b4e4d7a0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:33:23.363007 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa54b1c-a3d9-41fa-8163-a05b4e4d7a0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:33:23.363282 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa54b1c-a3d9-41fa-8163-a05b4e4d7a0c admin admin] PATH_INFO: `/v3/projects/83c07f10ab4e44d386f9c2d4135857fc` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:33:23.364472 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa54b1c-a3d9-41fa-8163-a05b4e4d7a0c admin admin] RBAC: Authorizing `identity:delete_project(project_id=83c07f10ab4e44d386f9c2d4135857fc)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:33:23.366461 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa54b1c-a3d9-41fa-8163-a05b4e4d7a0c admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:33:23.384434 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:33:23.420730 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-8fa54b1c-a3d9-41fa-8163-a05b4e4d7a0c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '83c07f10ab4e44d386f9c2d4135857fc', 'request_id': 'req-8fa54b1c-a3d9-41fa-8163-a05b4e4d7a0c'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:33:23.429047 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-8fa54b1c-a3d9-41fa-8163-a05b4e4d7a0c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '83c07f10ab4e44d386f9c2d4135857fc', 'request_id': 'req-8fa54b1c-a3d9-41fa-8163-a05b4e4d7a0c'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:33:23.436243 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-8fa54b1c-a3d9-41fa-8163-a05b4e4d7a0c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '83c07f10ab4e44d386f9c2d4135857fc', 'request_id': 'req-8fa54b1c-a3d9-41fa-8163-a05b4e4d7a0c'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:33:23.446891 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-8fa54b1c-a3d9-41fa-8163-a05b4e4d7a0c admin admin] The token cache is being invalidate because project 83c07f10ab4e44d386f9c2d4135857fc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 12:33:23.447181 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-8fa54b1c-a3d9-41fa-8163-a05b4e4d7a0c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:33:23.447839 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-8fa54b1c-a3d9-41fa-8163-a05b4e4d7a0c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:33:23.449432 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1335/2675] 10.222.0.44 () {58 vars in 1232 bytes} [Thu Jun 16 12:33:23 2022] DELETE /identity/v3/projects/83c07f10ab4e44d386f9c2d4135857fc => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:33:23.449575 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d4ca90-f45f-4b49-95a3-665fe089aaff admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:33:23.451108 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-51d4ca90-f45f-4b49-95a3-665fe089aaff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:33:23.454816 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19637d8-b83a-4633-92d5-767032be3e9d None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:33:23.455100 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19637d8-b83a-4633-92d5-767032be3e9d None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:33:23.455378 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19637d8-b83a-4633-92d5-767032be3e9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:33:23.473413 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-d19637d8-b83a-4633-92d5-767032be3e9d None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:33:23.474616 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-d19637d8-b83a-4633-92d5-767032be3e9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:33:23.509065 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d4ca90-f45f-4b49-95a3-665fe089aaff admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:33:23.516726 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:33:23.535994 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1336/2676] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 12:33:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 12:33:23.543968 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e37e85-7634-4152-86d3-4940f7ad4f9c None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:33:23.544348 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e37e85-7634-4152-86d3-4940f7ad4f9c None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:33:23.544686 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e37e85-7634-4152-86d3-4940f7ad4f9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:33:23.561233 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64595e19-004d-497c-b3d1-1dd21ff53969 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1094729b25a4be7b0b394998c9ca681', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '601361df39e34fcca71175aa94e425c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:33:23.561992 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64595e19-004d-497c-b3d1-1dd21ff53969 service neutron] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:33:23.562276 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64595e19-004d-497c-b3d1-1dd21ff53969 service neutron] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:33:23.562385 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-33e37e85-7634-4152-86d3-4940f7ad4f9c None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:33:23.562673 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64595e19-004d-497c-b3d1-1dd21ff53969 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:33:23.563573 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-33e37e85-7634-4152-86d3-4940f7ad4f9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:33:23.564452 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-64595e19-004d-497c-b3d1-1dd21ff53969 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:33:23.572147 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1337/2677] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 12:33:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 12:33:23.576140 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e37e85-7634-4152-86d3-4940f7ad4f9c None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:33:23.577804 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64595e19-004d-497c-b3d1-1dd21ff53969 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:33:23.579241 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64595e19-004d-497c-b3d1-1dd21ff53969 service neutron] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:33:23.585663 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e37e85-7634-4152-86d3-4940f7ad4f9c None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:33:23.589630 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1341/2678] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 12:33:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 12:33:23.590639 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a20284-172c-4f2b-b683-1bce9786973f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:33:23.591278 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a20284-172c-4f2b-b683-1bce9786973f admin admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:33:23.591554 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a20284-172c-4f2b-b683-1bce9786973f admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:33:23.591822 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a20284-172c-4f2b-b683-1bce9786973f admin admin] PATH_INFO: `/v3/domains` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:33:23.592539 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a20284-172c-4f2b-b683-1bce9786973f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:33:23.592895 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a20284-172c-4f2b-b683-1bce9786973f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:33:23.594495 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a20284-172c-4f2b-b683-1bce9786973f admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:33:23.606220 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1338/2679] 10.222.0.44 () {58 vars in 1152 bytes} [Thu Jun 16 12:33:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 12:33:23.610586 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64595e19-004d-497c-b3d1-1dd21ff53969 service neutron] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:33:23.620043 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64595e19-004d-497c-b3d1-1dd21ff53969 service neutron] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:33:23.624573 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cf8692-e153-4e3b-8b75-9ad4bdccfd82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:33:23.625254 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cf8692-e153-4e3b-8b75-9ad4bdccfd82 admin admin] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:33:23.625535 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cf8692-e153-4e3b-8b75-9ad4bdccfd82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:33:23.625811 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cf8692-e153-4e3b-8b75-9ad4bdccfd82 admin admin] PATH_INFO: `/v3/projects` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:33:23.626499 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cf8692-e153-4e3b-8b75-9ad4bdccfd82 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:33:23.628422 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cf8692-e153-4e3b-8b75-9ad4bdccfd82 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:33:23.657426 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1342/2680] 10.222.0.44 () {60 vars in 1152 bytes} [Thu Jun 16 12:33:23 2022] POST /identity/v3/projects => generated 383 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 12:33:23.661869 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a20284-172c-4f2b-b683-1bce9786973f admin admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:33:23.673019 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a20284-172c-4f2b-b683-1bce9786973f admin admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:33:23.732597 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5533a652-3ec9-43b7-9730-ed1dc0b2fa9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:33:23.733298 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5533a652-3ec9-43b7-9730-ed1dc0b2fa9e admin admin] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:33:23.733583 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5533a652-3ec9-43b7-9730-ed1dc0b2fa9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:33:23.733858 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5533a652-3ec9-43b7-9730-ed1dc0b2fa9e admin admin] PATH_INFO: `/v3/users` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:33:23.734549 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5533a652-3ec9-43b7-9730-ed1dc0b2fa9e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:33:23.736582 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5533a652-3ec9-43b7-9730-ed1dc0b2fa9e admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:33:23.757913 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1339/2681] 10.222.0.44 () {60 vars in 1143 bytes} [Thu Jun 16 12:33:23 2022] POST /identity/v3/users => generated 292 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 12:33:23.762511 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cf8692-e153-4e3b-8b75-9ad4bdccfd82 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:33:23.773765 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cf8692-e153-4e3b-8b75-9ad4bdccfd82 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:33:23.778643 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2464270d-fe33-4c5a-a2b3-743aa2c2b258 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:33:23.779300 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2464270d-fe33-4c5a-a2b3-743aa2c2b258 admin admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:33:23.779588 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2464270d-fe33-4c5a-a2b3-743aa2c2b258 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:33:23.779862 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2464270d-fe33-4c5a-a2b3-743aa2c2b258 admin admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:33:23.780586 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2464270d-fe33-4c5a-a2b3-743aa2c2b258 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:33:23.782232 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2464270d-fe33-4c5a-a2b3-743aa2c2b258 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:33:23.793144 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1343/2682] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 12:33:23 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 12:33:23.797207 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5533a652-3ec9-43b7-9730-ed1dc0b2fa9e admin admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:33:23.810061 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5533a652-3ec9-43b7-9730-ed1dc0b2fa9e admin admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:33:23.814898 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08199804-4af6-410a-9cc6-112dd8d4537a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:33:23.815564 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08199804-4af6-410a-9cc6-112dd8d4537a admin admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:33:23.815974 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08199804-4af6-410a-9cc6-112dd8d4537a admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:33:23.816259 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08199804-4af6-410a-9cc6-112dd8d4537a admin admin] PATH_INFO: `/v3/roles` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:33:23.817023 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08199804-4af6-410a-9cc6-112dd8d4537a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:33:23.819289 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08199804-4af6-410a-9cc6-112dd8d4537a admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:33:23.830123 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1340/2683] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 12:33:23 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 12:33:23.834092 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2464270d-fe33-4c5a-a2b3-743aa2c2b258 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:33:23.844185 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2464270d-fe33-4c5a-a2b3-743aa2c2b258 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:33:23.849131 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5184ddf1-be6f-4b21-963d-cc80a6d36a1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:33:23.850037 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5184ddf1-be6f-4b21-963d-cc80a6d36a1a admin admin] REQUEST_METHOD: `PUT` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:33:23.850312 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5184ddf1-be6f-4b21-963d-cc80a6d36a1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:33:23.850584 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5184ddf1-be6f-4b21-963d-cc80a6d36a1a admin admin] PATH_INFO: `/v3/projects/a3a7c3bb219f40af88d29b504456cc9b/users/01848cdd72314254a1a56141cc0b704a/roles/c39882b202e942479a7cdac2fc6da72c` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:33:23.866809 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5184ddf1-be6f-4b21-963d-cc80a6d36a1a admin admin] RBAC: Authorizing `identity:create_grant(project_id=a3a7c3bb219f40af88d29b504456cc9b, user_id=01848cdd72314254a1a56141cc0b704a, role_id=c39882b202e942479a7cdac2fc6da72c)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:33:23.869489 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5184ddf1-be6f-4b21-963d-cc80a6d36a1a admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:33:23.882774 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1344/2684] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 16 12:33:23 2022] PUT /identity/v3/projects/a3a7c3bb219f40af88d29b504456cc9b/users/01848cdd72314254a1a56141cc0b704a/roles/c39882b202e942479a7cdac2fc6da72c => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:33:23.894183 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188b36e8-98a3-4b93-9b5a-68acea87d009 None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:33:23.894494 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188b36e8-98a3-4b93-9b5a-68acea87d009 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:33:23.894777 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188b36e8-98a3-4b93-9b5a-68acea87d009 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:33:23.901777 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:33:23.924114 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-188b36e8-98a3-4b93-9b5a-68acea87d009 None None] MFA Rules not processed for user `01848cdd72314254a1a56141cc0b704a`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:33:23.925423 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-188b36e8-98a3-4b93-9b5a-68acea87d009 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:33:23.992613 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1341/2685] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 12:33:23 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:33:23.997111 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5184ddf1-be6f-4b21-963d-cc80a6d36a1a admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:33:24.061627 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5184ddf1-be6f-4b21-963d-cc80a6d36a1a admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:33:24.066511 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d67fa8-e873-462a-9ae8-9fd6c1f185e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:33:24.067182 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d67fa8-e873-462a-9ae8-9fd6c1f185e1 admin admin] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:33:24.067647 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d67fa8-e873-462a-9ae8-9fd6c1f185e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:33:24.067935 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d67fa8-e873-462a-9ae8-9fd6c1f185e1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:33:24.068643 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d67fa8-e873-462a-9ae8-9fd6c1f185e1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:33:24.070745 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d67fa8-e873-462a-9ae8-9fd6c1f185e1 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:33:24.095971 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1345/2686] 10.222.0.44 () {60 vars in 1152 bytes} [Thu Jun 16 12:33:23 2022] POST /identity/v3/projects => generated 385 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 12:33:24.100609 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188b36e8-98a3-4b93-9b5a-68acea87d009 None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:33:24.111229 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188b36e8-98a3-4b93-9b5a-68acea87d009 None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:33:24.169958 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4470264d-042f-4c8b-9e97-3898f08b433d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:33:24.170633 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4470264d-042f-4c8b-9e97-3898f08b433d admin admin] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:33:24.170916 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4470264d-042f-4c8b-9e97-3898f08b433d admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:33:24.171193 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4470264d-042f-4c8b-9e97-3898f08b433d admin admin] PATH_INFO: `/v3/users` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:33:24.171904 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4470264d-042f-4c8b-9e97-3898f08b433d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:33:24.173882 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4470264d-042f-4c8b-9e97-3898f08b433d admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:33:24.195188 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1342/2687] 10.222.0.44 () {60 vars in 1143 bytes} [Thu Jun 16 12:33:24 2022] POST /identity/v3/users => generated 293 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 12:33:24.199509 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d67fa8-e873-462a-9ae8-9fd6c1f185e1 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:33:24.209039 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d67fa8-e873-462a-9ae8-9fd6c1f185e1 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:33:24.213687 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca83f7a-bfd3-4d69-aaa3-47c17239a8ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:33:24.214344 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca83f7a-bfd3-4d69-aaa3-47c17239a8ba admin admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:33:24.214619 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca83f7a-bfd3-4d69-aaa3-47c17239a8ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:33:24.214887 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca83f7a-bfd3-4d69-aaa3-47c17239a8ba admin admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:33:24.215604 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca83f7a-bfd3-4d69-aaa3-47c17239a8ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:33:24.217216 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca83f7a-bfd3-4d69-aaa3-47c17239a8ba admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:33:24.228335 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1346/2688] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 12:33:24 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 12:33:24.232449 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4470264d-042f-4c8b-9e97-3898f08b433d admin admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:33:24.242800 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4470264d-042f-4c8b-9e97-3898f08b433d admin admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:33:24.247417 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41be49ad-8234-4254-a801-57bcf38bfcb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:33:24.248071 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41be49ad-8234-4254-a801-57bcf38bfcb1 admin admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:33:24.248350 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41be49ad-8234-4254-a801-57bcf38bfcb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:33:24.248623 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41be49ad-8234-4254-a801-57bcf38bfcb1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:33:24.249385 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41be49ad-8234-4254-a801-57bcf38bfcb1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:33:24.250958 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41be49ad-8234-4254-a801-57bcf38bfcb1 admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:33:24.261100 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1343/2689] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 12:33:24 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 12:33:24.265335 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca83f7a-bfd3-4d69-aaa3-47c17239a8ba admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:33:24.275958 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca83f7a-bfd3-4d69-aaa3-47c17239a8ba admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:33:24.280622 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68557d6-2636-4aee-910d-d91da28a54d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:33:24.281536 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68557d6-2636-4aee-910d-d91da28a54d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:33:24.281819 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68557d6-2636-4aee-910d-d91da28a54d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:33:24.282095 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68557d6-2636-4aee-910d-d91da28a54d6 admin admin] PATH_INFO: `/v3/projects/3261dcd955974603858fff7d645fa6c8/users/83897633083e450fbc8574e5b466949d/roles/c39882b202e942479a7cdac2fc6da72c` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:33:24.297617 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68557d6-2636-4aee-910d-d91da28a54d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3261dcd955974603858fff7d645fa6c8, user_id=83897633083e450fbc8574e5b466949d, role_id=c39882b202e942479a7cdac2fc6da72c)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:33:24.300274 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68557d6-2636-4aee-910d-d91da28a54d6 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:33:24.313773 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1347/2690] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 16 12:33:24 2022] PUT /identity/v3/projects/3261dcd955974603858fff7d645fa6c8/users/83897633083e450fbc8574e5b466949d/roles/c39882b202e942479a7cdac2fc6da72c => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:33:24.325317 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a816c007-1ab1-40b9-b601-271cbbc446e2 None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:33:24.325806 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a816c007-1ab1-40b9-b601-271cbbc446e2 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:33:24.326019 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a816c007-1ab1-40b9-b601-271cbbc446e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:33:24.353627 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-a816c007-1ab1-40b9-b601-271cbbc446e2 None None] MFA Rules not processed for user `83897633083e450fbc8574e5b466949d`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:33:24.354899 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-a816c007-1ab1-40b9-b601-271cbbc446e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:33:24.429316 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1344/2691] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 12:33:24 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:33:24.430522 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68557d6-2636-4aee-910d-d91da28a54d6 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:33:24.439498 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:33:24.519918 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68557d6-2636-4aee-910d-d91da28a54d6 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:33:24.525523 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a64a2b5-06ed-41db-8571-fcc6f7e5e909 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:33:24.526529 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a64a2b5-06ed-41db-8571-fcc6f7e5e909 admin admin] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:33:24.526668 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a64a2b5-06ed-41db-8571-fcc6f7e5e909 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:33:24.526975 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a64a2b5-06ed-41db-8571-fcc6f7e5e909 admin admin] PATH_INFO: `/v3/projects` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:33:24.527736 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a64a2b5-06ed-41db-8571-fcc6f7e5e909 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:33:24.529851 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a64a2b5-06ed-41db-8571-fcc6f7e5e909 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:33:24.560808 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1348/2692] 10.222.0.44 () {60 vars in 1152 bytes} [Thu Jun 16 12:33:24 2022] POST /identity/v3/projects => generated 383 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 12:33:24.564064 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a816c007-1ab1-40b9-b601-271cbbc446e2 None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:33:24.570429 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:33:24.577454 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a816c007-1ab1-40b9-b601-271cbbc446e2 None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:33:24.647800 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82f9d97-5078-402b-92ed-22f2d0764634 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:33:24.648478 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82f9d97-5078-402b-92ed-22f2d0764634 admin admin] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:33:24.648915 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82f9d97-5078-402b-92ed-22f2d0764634 admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:33:24.656833 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82f9d97-5078-402b-92ed-22f2d0764634 admin admin] PATH_INFO: `/v3/users` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:33:24.657971 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82f9d97-5078-402b-92ed-22f2d0764634 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:33:24.660544 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82f9d97-5078-402b-92ed-22f2d0764634 admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:33:24.691012 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1345/2693] 10.222.0.44 () {60 vars in 1143 bytes} [Thu Jun 16 12:33:24 2022] POST /identity/v3/users => generated 298 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 12:33:24.695211 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a64a2b5-06ed-41db-8571-fcc6f7e5e909 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:33:24.706860 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a64a2b5-06ed-41db-8571-fcc6f7e5e909 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:33:24.713721 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc22466-bee4-4e84-9b8b-694fc1118ad2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:33:24.719036 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc22466-bee4-4e84-9b8b-694fc1118ad2 admin admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:33:24.719307 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc22466-bee4-4e84-9b8b-694fc1118ad2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:33:24.719653 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc22466-bee4-4e84-9b8b-694fc1118ad2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:33:24.720516 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc22466-bee4-4e84-9b8b-694fc1118ad2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:33:24.722158 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc22466-bee4-4e84-9b8b-694fc1118ad2 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:33:24.734068 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1349/2694] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 12:33:24 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 12:33:24.738187 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82f9d97-5078-402b-92ed-22f2d0764634 admin admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:33:24.748334 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82f9d97-5078-402b-92ed-22f2d0764634 admin admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:33:24.753126 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4129a51a-ae06-4fa5-9f6d-bff93ce2ad51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:33:24.754075 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4129a51a-ae06-4fa5-9f6d-bff93ce2ad51 admin admin] REQUEST_METHOD: `PUT` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:33:24.754339 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4129a51a-ae06-4fa5-9f6d-bff93ce2ad51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:33:24.754615 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4129a51a-ae06-4fa5-9f6d-bff93ce2ad51 admin admin] PATH_INFO: `/v3/projects/61ec33e656a243bc81ae43985cde6b9f/users/a3c0d2e94b394478a3666f96c0e7deba/roles/0688968254744e3f9913653cafea3091` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:33:24.770397 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4129a51a-ae06-4fa5-9f6d-bff93ce2ad51 admin admin] RBAC: Authorizing `identity:create_grant(project_id=61ec33e656a243bc81ae43985cde6b9f, user_id=a3c0d2e94b394478a3666f96c0e7deba, role_id=0688968254744e3f9913653cafea3091)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:33:24.773633 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4129a51a-ae06-4fa5-9f6d-bff93ce2ad51 admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:33:24.788074 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1346/2695] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 16 12:33:24 2022] PUT /identity/v3/projects/61ec33e656a243bc81ae43985cde6b9f/users/a3c0d2e94b394478a3666f96c0e7deba/roles/0688968254744e3f9913653cafea3091 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:33:24.792088 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc22466-bee4-4e84-9b8b-694fc1118ad2 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:33:24.803033 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc22466-bee4-4e84-9b8b-694fc1118ad2 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:33:24.860721 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bf518f-722b-46c6-b180-ffdeb8cbbf6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:33:24.861416 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bf518f-722b-46c6-b180-ffdeb8cbbf6b admin admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:33:24.861704 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bf518f-722b-46c6-b180-ffdeb8cbbf6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:33:24.861979 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bf518f-722b-46c6-b180-ffdeb8cbbf6b admin admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:33:24.862703 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bf518f-722b-46c6-b180-ffdeb8cbbf6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:33:24.864315 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bf518f-722b-46c6-b180-ffdeb8cbbf6b admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:33:24.877213 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1350/2696] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 12:33:24 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 12:33:24.878425 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4129a51a-ae06-4fa5-9f6d-bff93ce2ad51 admin admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:33:24.889191 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4129a51a-ae06-4fa5-9f6d-bff93ce2ad51 admin admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:33:24.893960 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467c8e6a-9ccb-4757-84a0-b4b46cd525c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:33:24.894854 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467c8e6a-9ccb-4757-84a0-b4b46cd525c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:33:24.895135 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467c8e6a-9ccb-4757-84a0-b4b46cd525c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:33:24.895407 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467c8e6a-9ccb-4757-84a0-b4b46cd525c7 admin admin] PATH_INFO: `/v3/projects/61ec33e656a243bc81ae43985cde6b9f/users/a3c0d2e94b394478a3666f96c0e7deba/roles/0688968254744e3f9913653cafea3091` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:33:24.898053 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467c8e6a-9ccb-4757-84a0-b4b46cd525c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=61ec33e656a243bc81ae43985cde6b9f, user_id=a3c0d2e94b394478a3666f96c0e7deba, role_id=0688968254744e3f9913653cafea3091)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:33:24.901001 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467c8e6a-9ccb-4757-84a0-b4b46cd525c7 admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:33:24.911695 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1347/2697] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 16 12:33:24 2022] PUT /identity/v3/projects/61ec33e656a243bc81ae43985cde6b9f/users/a3c0d2e94b394478a3666f96c0e7deba/roles/0688968254744e3f9913653cafea3091 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:33:24.921891 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5370eec4-7ec8-48ed-950b-4ec586646033 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:33:24.922266 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5370eec4-7ec8-48ed-950b-4ec586646033 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:33:24.922620 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5370eec4-7ec8-48ed-950b-4ec586646033 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:33:24.951036 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-5370eec4-7ec8-48ed-950b-4ec586646033 None None] MFA Rules not processed for user `a3c0d2e94b394478a3666f96c0e7deba`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:33:24.952100 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-5370eec4-7ec8-48ed-950b-4ec586646033 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:33:25.031391 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1351/2698] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 12:33:24 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:33:25.043735 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467c8e6a-9ccb-4757-84a0-b4b46cd525c7 admin admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:33:25.045525 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-467c8e6a-9ccb-4757-84a0-b4b46cd525c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:33:25.108530 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467c8e6a-9ccb-4757-84a0-b4b46cd525c7 admin admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:33:25.112423 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2569b520-c587-438a-913a-6b60235a98a4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f96fc14ed89478c8a8c2f11c87511e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '601361df39e34fcca71175aa94e425c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:33:25.113399 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2569b520-c587-438a-913a-6b60235a98a4 service cinder] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:33:25.113681 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2569b520-c587-438a-913a-6b60235a98a4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:33:25.113949 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2569b520-c587-438a-913a-6b60235a98a4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:33:25.177085 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2569b520-c587-438a-913a-6b60235a98a4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:33:25.179133 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2569b520-c587-438a-913a-6b60235a98a4 service cinder] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:33:25.188623 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1348/2699] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 12:33:25 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 12:33:26.652077 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5370eec4-7ec8-48ed-950b-4ec586646033 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:33:26.653677 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-5370eec4-7ec8-48ed-950b-4ec586646033 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:33:26.659159 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:33:26.718069 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2569b520-c587-438a-913a-6b60235a98a4 service cinder] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:33:26.721601 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-2569b520-c587-438a-913a-6b60235a98a4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:33:26.735504 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:33:26.796128 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5370eec4-7ec8-48ed-950b-4ec586646033 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:33:26.805449 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cc382b-48bb-4dff-bb09-781515c57616 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8bff8ccf460a403d993c39327bbcbd29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '601361df39e34fcca71175aa94e425c4', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:33:26.806272 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cc382b-48bb-4dff-bb09-781515c57616 service placement] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:33:26.806939 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cc382b-48bb-4dff-bb09-781515c57616 service placement] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:33:26.808487 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cc382b-48bb-4dff-bb09-781515c57616 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:33:26.813550 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-39cc382b-48bb-4dff-bb09-781515c57616 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:33:26.836184 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2569b520-c587-438a-913a-6b60235a98a4 service cinder] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:33:26.839254 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39cc382b-48bb-4dff-bb09-781515c57616 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:33:26.844806 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39cc382b-48bb-4dff-bb09-781515c57616 service placement] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:33:26.849569 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839e1b00-94e9-4c09-a83a-d27d72158319 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:33:26.850474 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839e1b00-94e9-4c09-a83a-d27d72158319 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:33:26.850762 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839e1b00-94e9-4c09-a83a-d27d72158319 admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:33:26.851035 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839e1b00-94e9-4c09-a83a-d27d72158319 admin admin] PATH_INFO: `/v3/users/dcb0b632b30649609216933c50f287b9` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:33:26.851833 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1352/2700] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 12:33:26 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 12:33:26.852308 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839e1b00-94e9-4c09-a83a-d27d72158319 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dcb0b632b30649609216933c50f287b9)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:33:26.854304 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839e1b00-94e9-4c09-a83a-d27d72158319 admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:33:26.863145 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cc382b-48bb-4dff-bb09-781515c57616 service placement] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:33:26.868695 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-39cc382b-48bb-4dff-bb09-781515c57616 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:33:26.890540 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cc382b-48bb-4dff-bb09-781515c57616 service placement] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:33:26.895354 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f39e82d-93e9-4177-ab47-f302409da346 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f96fc14ed89478c8a8c2f11c87511e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '601361df39e34fcca71175aa94e425c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:33:26.896515 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f39e82d-93e9-4177-ab47-f302409da346 service cinder] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:33:26.897189 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f39e82d-93e9-4177-ab47-f302409da346 service cinder] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:33:26.897607 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f39e82d-93e9-4177-ab47-f302409da346 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:33:26.921794 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-839e1b00-94e9-4c09-a83a-d27d72158319 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dcb0b632b30649609216933c50f287b9'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:33:26.941197 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-839e1b00-94e9-4c09-a83a-d27d72158319 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dcb0b632b30649609216933c50f287b9'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:33:26.950826 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-839e1b00-94e9-4c09-a83a-d27d72158319 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dcb0b632b30649609216933c50f287b9'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:33:26.951566 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-839e1b00-94e9-4c09-a83a-d27d72158319 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dcb0b632b30649609216933c50f287b9'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:33:26.952173 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-839e1b00-94e9-4c09-a83a-d27d72158319 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dcb0b632b30649609216933c50f287b9'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:33:26.975541 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1349/2701] 10.222.0.44 () {58 vars in 1223 bytes} [Thu Jun 16 12:33:26 2022] DELETE /identity/v3/users/dcb0b632b30649609216933c50f287b9 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 12:33:26.995766 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f39e82d-93e9-4177-ab47-f302409da346 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:33:26.995766 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f39e82d-93e9-4177-ab47-f302409da346 service cinder] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:33:27.006545 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1353/2702] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 12:33:26 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 12:33:27.170807 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839e1b00-94e9-4c09-a83a-d27d72158319 admin admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:33:27.172377 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-839e1b00-94e9-4c09-a83a-d27d72158319 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:33:27.249143 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839e1b00-94e9-4c09-a83a-d27d72158319 admin admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:33:27.253841 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b27f602-8ba5-467d-9d9f-4f29f3911f49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:33:27.254752 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b27f602-8ba5-467d-9d9f-4f29f3911f49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:33:27.255041 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b27f602-8ba5-467d-9d9f-4f29f3911f49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:33:27.255323 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b27f602-8ba5-467d-9d9f-4f29f3911f49 admin admin] PATH_INFO: `/v3/projects/23a1b762c28a48b8ad7364069104985d` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:33:27.256604 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b27f602-8ba5-467d-9d9f-4f29f3911f49 admin admin] RBAC: Authorizing `identity:delete_project(project_id=23a1b762c28a48b8ad7364069104985d)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:33:27.258928 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b27f602-8ba5-467d-9d9f-4f29f3911f49 admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:33:27.295993 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:33:27.311577 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-4b27f602-8ba5-467d-9d9f-4f29f3911f49 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '23a1b762c28a48b8ad7364069104985d', 'request_id': 'req-4b27f602-8ba5-467d-9d9f-4f29f3911f49'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:33:27.318558 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-4b27f602-8ba5-467d-9d9f-4f29f3911f49 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '23a1b762c28a48b8ad7364069104985d', 'request_id': 'req-4b27f602-8ba5-467d-9d9f-4f29f3911f49'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:33:27.324385 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-4b27f602-8ba5-467d-9d9f-4f29f3911f49 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '23a1b762c28a48b8ad7364069104985d', 'request_id': 'req-4b27f602-8ba5-467d-9d9f-4f29f3911f49'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:33:27.335923 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-4b27f602-8ba5-467d-9d9f-4f29f3911f49 admin admin] The token cache is being invalidate because project 23a1b762c28a48b8ad7364069104985d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 12:33:27.336215 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-4b27f602-8ba5-467d-9d9f-4f29f3911f49 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:33:27.336882 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-4b27f602-8ba5-467d-9d9f-4f29f3911f49 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:33:27.338474 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1350/2703] 10.222.0.44 () {58 vars in 1232 bytes} [Thu Jun 16 12:33:27 2022] DELETE /identity/v3/projects/23a1b762c28a48b8ad7364069104985d => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:33:27.343779 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4146d54-c125-4e32-b315-d50e6c27a371 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:33:27.344068 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4146d54-c125-4e32-b315-d50e6c27a371 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:33:27.344347 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4146d54-c125-4e32-b315-d50e6c27a371 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:33:27.362861 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-c4146d54-c125-4e32-b315-d50e6c27a371 None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:33:27.364303 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-c4146d54-c125-4e32-b315-d50e6c27a371 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:33:27.430092 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1354/2704] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 12:33:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:33:27.437751 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641b06e9-3e62-428d-99a3-f5d803b3f45b None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:33:27.438034 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641b06e9-3e62-428d-99a3-f5d803b3f45b None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:33:27.438307 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641b06e9-3e62-428d-99a3-f5d803b3f45b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:33:27.456761 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-641b06e9-3e62-428d-99a3-f5d803b3f45b None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:33:27.458024 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-641b06e9-3e62-428d-99a3-f5d803b3f45b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:33:27.469024 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1351/2705] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 12:33:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 12:33:27.471615 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4146d54-c125-4e32-b315-d50e6c27a371 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:33:27.481987 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4146d54-c125-4e32-b315-d50e6c27a371 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:33:27.486639 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56830e86-6748-499b-b729-af112beced92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:33:27.487287 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56830e86-6748-499b-b729-af112beced92 admin admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:33:27.487564 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56830e86-6748-499b-b729-af112beced92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:33:27.488007 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56830e86-6748-499b-b729-af112beced92 admin admin] PATH_INFO: `/v3/domains` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:33:27.488905 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56830e86-6748-499b-b729-af112beced92 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:33:27.489213 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56830e86-6748-499b-b729-af112beced92 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:33:27.490836 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56830e86-6748-499b-b729-af112beced92 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:33:27.506968 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1355/2706] 10.222.0.44 () {58 vars in 1152 bytes} [Thu Jun 16 12:33:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:33:27.508187 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641b06e9-3e62-428d-99a3-f5d803b3f45b None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:33:27.517640 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641b06e9-3e62-428d-99a3-f5d803b3f45b None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:33:27.522892 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a892e9d-e483-4b99-8c98-5f7dfd3485c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:33:27.523542 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a892e9d-e483-4b99-8c98-5f7dfd3485c4 admin admin] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:33:27.523822 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a892e9d-e483-4b99-8c98-5f7dfd3485c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:33:27.524446 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a892e9d-e483-4b99-8c98-5f7dfd3485c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:33:27.525228 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a892e9d-e483-4b99-8c98-5f7dfd3485c4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:33:27.527087 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a892e9d-e483-4b99-8c98-5f7dfd3485c4 admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:33:27.547271 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56830e86-6748-499b-b729-af112beced92 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:33:27.548998 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-56830e86-6748-499b-b729-af112beced92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:33:27.553273 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1352/2707] 10.222.0.44 () {60 vars in 1152 bytes} [Thu Jun 16 12:33:27 2022] POST /identity/v3/projects => generated 385 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 12:33:27.557123 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a892e9d-e483-4b99-8c98-5f7dfd3485c4 admin admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:33:27.571187 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:33:27.610500 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56830e86-6748-499b-b729-af112beced92 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:33:27.618948 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a892e9d-e483-4b99-8c98-5f7dfd3485c4 admin admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:33:27.623668 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382b977c-8d27-4bc4-8382-427a03a9dd59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:33:27.624324 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382b977c-8d27-4bc4-8382-427a03a9dd59 admin admin] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:33:27.624603 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382b977c-8d27-4bc4-8382-427a03a9dd59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:33:27.624916 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382b977c-8d27-4bc4-8382-427a03a9dd59 admin admin] PATH_INFO: `/v3/users` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:33:27.625599 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382b977c-8d27-4bc4-8382-427a03a9dd59 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:33:27.627501 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382b977c-8d27-4bc4-8382-427a03a9dd59 admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:33:27.650961 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1353/2708] 10.222.0.44 () {60 vars in 1143 bytes} [Thu Jun 16 12:33:27 2022] POST /identity/v3/users => generated 293 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 12:33:27.652128 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382b977c-8d27-4bc4-8382-427a03a9dd59 admin admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:33:27.658792 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b06cf3-9e95-4445-b49f-738d41690be3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f96fc14ed89478c8a8c2f11c87511e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '601361df39e34fcca71175aa94e425c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:33:27.659704 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b06cf3-9e95-4445-b49f-738d41690be3 service cinder] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:33:27.659869 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b06cf3-9e95-4445-b49f-738d41690be3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:33:27.660142 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b06cf3-9e95-4445-b49f-738d41690be3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:33:27.662577 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-31b06cf3-9e95-4445-b49f-738d41690be3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:33:27.662699 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382b977c-8d27-4bc4-8382-427a03a9dd59 admin admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:33:27.667502 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d80f15-4735-4176-b3c1-71e2b019edcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:33:27.668164 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d80f15-4735-4176-b3c1-71e2b019edcf admin admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:33:27.668447 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d80f15-4735-4176-b3c1-71e2b019edcf admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:33:27.668720 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d80f15-4735-4176-b3c1-71e2b019edcf admin admin] PATH_INFO: `/v3/roles` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:33:27.669553 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d80f15-4735-4176-b3c1-71e2b019edcf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:33:27.671062 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d80f15-4735-4176-b3c1-71e2b019edcf admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:33:27.680930 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1354/2709] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 12:33:27 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 12:33:27.684819 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d80f15-4735-4176-b3c1-71e2b019edcf admin admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:33:27.694147 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d80f15-4735-4176-b3c1-71e2b019edcf admin admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:33:27.698737 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724c9991-f535-400c-9f63-b43f6b499587 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:33:27.699363 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724c9991-f535-400c-9f63-b43f6b499587 admin admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:33:27.699644 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724c9991-f535-400c-9f63-b43f6b499587 admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:33:27.699921 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724c9991-f535-400c-9f63-b43f6b499587 admin admin] PATH_INFO: `/v3/roles` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:33:27.700630 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724c9991-f535-400c-9f63-b43f6b499587 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:33:27.702256 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724c9991-f535-400c-9f63-b43f6b499587 admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:33:27.713267 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1355/2710] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 12:33:27 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 12:33:27.717494 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724c9991-f535-400c-9f63-b43f6b499587 admin admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:33:27.726096 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b06cf3-9e95-4445-b49f-738d41690be3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:33:27.727586 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724c9991-f535-400c-9f63-b43f6b499587 admin admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:33:27.728028 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b06cf3-9e95-4445-b49f-738d41690be3 service cinder] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:33:27.732172 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dd5f4b-2be0-4069-85fc-49e0a6c687ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:33:27.733056 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dd5f4b-2be0-4069-85fc-49e0a6c687ca admin admin] REQUEST_METHOD: `PUT` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:33:27.733335 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dd5f4b-2be0-4069-85fc-49e0a6c687ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:33:27.733610 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dd5f4b-2be0-4069-85fc-49e0a6c687ca admin admin] PATH_INFO: `/v3/projects/8b313233497f4be19b08fe6c33aa646a/users/f396379ba6024afaaac167a179919cd8/roles/c39882b202e942479a7cdac2fc6da72c` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:33:27.737430 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1356/2711] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 12:33:27 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 12:33:27.749786 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6dd5f4b-2be0-4069-85fc-49e0a6c687ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b313233497f4be19b08fe6c33aa646a, user_id=f396379ba6024afaaac167a179919cd8, role_id=c39882b202e942479a7cdac2fc6da72c)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:33:27.752421 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6dd5f4b-2be0-4069-85fc-49e0a6c687ca admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:33:27.765043 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1356/2712] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 16 12:33:27 2022] PUT /identity/v3/projects/8b313233497f4be19b08fe6c33aa646a/users/f396379ba6024afaaac167a179919cd8/roles/c39882b202e942479a7cdac2fc6da72c => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 12:33:27.770266 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b380e18-2847-4a61-9737-6550f520e8e1 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:33:27.770549 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b380e18-2847-4a61-9737-6550f520e8e1 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:33:27.770821 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b380e18-2847-4a61-9737-6550f520e8e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:33:27.789096 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-2b380e18-2847-4a61-9737-6550f520e8e1 None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:33:27.790530 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-2b380e18-2847-4a61-9737-6550f520e8e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:33:27.855314 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1357/2713] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 12:33:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:33:27.864939 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dd5f4b-2be0-4069-85fc-49e0a6c687ca admin admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:33:27.866697 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-a6dd5f4b-2be0-4069-85fc-49e0a6c687ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:33:27.904024 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=89,keystone:DELETE=5,keystone:INSERT=6 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:33:27.933231 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dd5f4b-2be0-4069-85fc-49e0a6c687ca admin admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:33:27.937308 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1700a0b7-d9f4-4d89-949f-10524c6b910d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1094729b25a4be7b0b394998c9ca681', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '601361df39e34fcca71175aa94e425c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:33:27.938035 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1700a0b7-d9f4-4d89-949f-10524c6b910d service neutron] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:33:27.938382 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1700a0b7-d9f4-4d89-949f-10524c6b910d service neutron] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:33:27.938723 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1700a0b7-d9f4-4d89-949f-10524c6b910d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:33:27.948879 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1700a0b7-d9f4-4d89-949f-10524c6b910d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:33:27.950400 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1700a0b7-d9f4-4d89-949f-10524c6b910d service neutron] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:33:27.961212 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1357/2714] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 12:33:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 12:33:31.744832 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b380e18-2847-4a61-9737-6550f520e8e1 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:33:31.746483 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-2b380e18-2847-4a61-9737-6550f520e8e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:33:31.761388 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b380e18-2847-4a61-9737-6550f520e8e1 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:33:31.767071 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7b56cd-f654-4a41-9902-b82c921b26b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:33:31.768423 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7b56cd-f654-4a41-9902-b82c921b26b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:33:31.769150 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7b56cd-f654-4a41-9902-b82c921b26b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:33:31.769150 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7b56cd-f654-4a41-9902-b82c921b26b0 admin admin] PATH_INFO: `/v3/users/01848cdd72314254a1a56141cc0b704a` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:33:31.771480 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7b56cd-f654-4a41-9902-b82c921b26b0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=01848cdd72314254a1a56141cc0b704a)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:33:31.773369 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7b56cd-f654-4a41-9902-b82c921b26b0 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:33:31.800591 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:33:31.843838 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-ef7b56cd-f654-4a41-9902-b82c921b26b0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '01848cdd72314254a1a56141cc0b704a'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:33:31.844671 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-ef7b56cd-f654-4a41-9902-b82c921b26b0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '01848cdd72314254a1a56141cc0b704a'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:33:31.854687 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-ef7b56cd-f654-4a41-9902-b82c921b26b0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '01848cdd72314254a1a56141cc0b704a'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:33:31.855353 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-ef7b56cd-f654-4a41-9902-b82c921b26b0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '01848cdd72314254a1a56141cc0b704a'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:33:31.866597 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-ef7b56cd-f654-4a41-9902-b82c921b26b0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '01848cdd72314254a1a56141cc0b704a'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:33:31.892674 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1358/2715] 10.222.0.44 () {58 vars in 1223 bytes} [Thu Jun 16 12:33:31 2022] DELETE /identity/v3/users/01848cdd72314254a1a56141cc0b704a => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:33:31.895162 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b0696b-9536-49a6-a472-7011b9239466 None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:33:31.895633 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b0696b-9536-49a6-a472-7011b9239466 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:33:31.896519 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b0696b-9536-49a6-a472-7011b9239466 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:33:31.940291 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-88b0696b-9536-49a6-a472-7011b9239466 None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:33:31.942265 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-88b0696b-9536-49a6-a472-7011b9239466 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:33:32.014766 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1358/2716] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 12:33:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:33:32.032009 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7b56cd-f654-4a41-9902-b82c921b26b0 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:33:32.033696 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-ef7b56cd-f654-4a41-9902-b82c921b26b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:33:32.135788 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7b56cd-f654-4a41-9902-b82c921b26b0 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:33:32.153056 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc84dc3-a995-4c2a-8bba-467dfa51fa65 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1094729b25a4be7b0b394998c9ca681', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '601361df39e34fcca71175aa94e425c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:33:32.159974 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2a3a7c-9ee0-4c26-8468-ccbb73edf2d7 None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:33:32.160586 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2a3a7c-9ee0-4c26-8468-ccbb73edf2d7 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:33:32.161099 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2a3a7c-9ee0-4c26-8468-ccbb73edf2d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:33:32.163892 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc84dc3-a995-4c2a-8bba-467dfa51fa65 service neutron] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:33:32.168149 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc84dc3-a995-4c2a-8bba-467dfa51fa65 service neutron] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:33:32.168734 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc84dc3-a995-4c2a-8bba-467dfa51fa65 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:33:32.190426 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc84dc3-a995-4c2a-8bba-467dfa51fa65 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:33:32.192016 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc84dc3-a995-4c2a-8bba-467dfa51fa65 service neutron] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:33:32.199662 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-ff2a3a7c-9ee0-4c26-8468-ccbb73edf2d7 None None] MFA Rules not processed for user `f396379ba6024afaaac167a179919cd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:33:32.201155 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-ff2a3a7c-9ee0-4c26-8468-ccbb73edf2d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:33:32.208528 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1359/2717] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 12:33:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 12:33:32.302825 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1359/2718] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 12:33:32 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 12:33:32.310484 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc84dc3-a995-4c2a-8bba-467dfa51fa65 service neutron] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:33:32.312332 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-dfc84dc3-a995-4c2a-8bba-467dfa51fa65 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:33:32.424321 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc84dc3-a995-4c2a-8bba-467dfa51fa65 service neutron] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:33:32.431110 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2b50cd-4b6a-4193-bba3-a1711bfea2e2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edfb12d445e74136b90800e93941f468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '601361df39e34fcca71175aa94e425c4', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:33:32.432118 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2b50cd-4b6a-4193-bba3-a1711bfea2e2 service nova] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:33:32.432608 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2b50cd-4b6a-4193-bba3-a1711bfea2e2 service nova] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:33:32.433151 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2b50cd-4b6a-4193-bba3-a1711bfea2e2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:33:32.443408 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2b50cd-4b6a-4193-bba3-a1711bfea2e2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:33:32.445572 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2b50cd-4b6a-4193-bba3-a1711bfea2e2 service nova] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:33:32.457363 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1360/2719] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 12:33:32 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 12:33:32.563350 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2a3a7c-9ee0-4c26-8468-ccbb73edf2d7 None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:33:32.564903 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-ff2a3a7c-9ee0-4c26-8468-ccbb73edf2d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:33:32.583773 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2a3a7c-9ee0-4c26-8468-ccbb73edf2d7 None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:33:32.589290 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622d308a-5051-4f5f-a21f-ebce96361501 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:33:32.590162 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622d308a-5051-4f5f-a21f-ebce96361501 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:33:32.590434 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622d308a-5051-4f5f-a21f-ebce96361501 admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:33:32.590702 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622d308a-5051-4f5f-a21f-ebce96361501 admin admin] PATH_INFO: `/v3/projects/a3a7c3bb219f40af88d29b504456cc9b` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:33:32.592085 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622d308a-5051-4f5f-a21f-ebce96361501 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a3a7c3bb219f40af88d29b504456cc9b)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:33:32.594402 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622d308a-5051-4f5f-a21f-ebce96361501 admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:33:32.685754 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-622d308a-5051-4f5f-a21f-ebce96361501 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a3a7c3bb219f40af88d29b504456cc9b', 'request_id': 'req-622d308a-5051-4f5f-a21f-ebce96361501'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:33:32.699401 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-622d308a-5051-4f5f-a21f-ebce96361501 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a3a7c3bb219f40af88d29b504456cc9b', 'request_id': 'req-622d308a-5051-4f5f-a21f-ebce96361501'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:33:32.705838 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:33:32.708760 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-622d308a-5051-4f5f-a21f-ebce96361501 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a3a7c3bb219f40af88d29b504456cc9b', 'request_id': 'req-622d308a-5051-4f5f-a21f-ebce96361501'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:33:32.728729 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-622d308a-5051-4f5f-a21f-ebce96361501 admin admin] The token cache is being invalidate because project a3a7c3bb219f40af88d29b504456cc9b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 12:33:32.729147 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-622d308a-5051-4f5f-a21f-ebce96361501 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:33:32.734761 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-622d308a-5051-4f5f-a21f-ebce96361501 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:33:32.737223 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1360/2720] 10.222.0.44 () {58 vars in 1232 bytes} [Thu Jun 16 12:33:32 2022] DELETE /identity/v3/projects/a3a7c3bb219f40af88d29b504456cc9b => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:33:32.740737 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2b50cd-4b6a-4193-bba3-a1711bfea2e2 service nova] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:33:32.752106 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2b50cd-4b6a-4193-bba3-a1711bfea2e2 service nova] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:33:32.783855 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:33:32.841387 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b07274-55c3-4928-9737-a64f0559ccf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:33:32.842424 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b07274-55c3-4928-9737-a64f0559ccf5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:33:32.843067 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b07274-55c3-4928-9737-a64f0559ccf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:33:32.843588 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b07274-55c3-4928-9737-a64f0559ccf5 admin admin] PATH_INFO: `/v3/users/83897633083e450fbc8574e5b466949d` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:33:32.845348 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b07274-55c3-4928-9737-a64f0559ccf5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=83897633083e450fbc8574e5b466949d)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:33:32.848514 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b07274-55c3-4928-9737-a64f0559ccf5 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:33:32.915920 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-52b07274-55c3-4928-9737-a64f0559ccf5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '83897633083e450fbc8574e5b466949d'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:33:32.917208 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-52b07274-55c3-4928-9737-a64f0559ccf5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '83897633083e450fbc8574e5b466949d'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:33:32.928967 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-52b07274-55c3-4928-9737-a64f0559ccf5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '83897633083e450fbc8574e5b466949d'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:33:32.930314 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-52b07274-55c3-4928-9737-a64f0559ccf5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '83897633083e450fbc8574e5b466949d'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:33:32.940815 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-52b07274-55c3-4928-9737-a64f0559ccf5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '83897633083e450fbc8574e5b466949d'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:33:32.970765 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1361/2721] 10.222.0.44 () {58 vars in 1223 bytes} [Thu Jun 16 12:33:32 2022] DELETE /identity/v3/users/83897633083e450fbc8574e5b466949d => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:33:33.410838 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622d308a-5051-4f5f-a21f-ebce96361501 admin admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:33:33.412844 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-622d308a-5051-4f5f-a21f-ebce96361501 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:33:33.426416 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622d308a-5051-4f5f-a21f-ebce96361501 admin admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:33:33.494247 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e9c3e5-394e-4ed4-a427-1ace9877d93e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:33:33.500799 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e9c3e5-394e-4ed4-a427-1ace9877d93e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:33:33.500799 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e9c3e5-394e-4ed4-a427-1ace9877d93e admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:33:33.500799 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e9c3e5-394e-4ed4-a427-1ace9877d93e admin admin] PATH_INFO: `/v3/projects/3261dcd955974603858fff7d645fa6c8` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:33:33.500799 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e9c3e5-394e-4ed4-a427-1ace9877d93e admin admin] RBAC: Authorizing `identity:delete_project(project_id=3261dcd955974603858fff7d645fa6c8)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:33:33.500799 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e9c3e5-394e-4ed4-a427-1ace9877d93e admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:33:33.549945 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-69e9c3e5-394e-4ed4-a427-1ace9877d93e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3261dcd955974603858fff7d645fa6c8', 'request_id': 'req-69e9c3e5-394e-4ed4-a427-1ace9877d93e'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:33:33.557530 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-69e9c3e5-394e-4ed4-a427-1ace9877d93e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3261dcd955974603858fff7d645fa6c8', 'request_id': 'req-69e9c3e5-394e-4ed4-a427-1ace9877d93e'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:33:33.563346 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-69e9c3e5-394e-4ed4-a427-1ace9877d93e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3261dcd955974603858fff7d645fa6c8', 'request_id': 'req-69e9c3e5-394e-4ed4-a427-1ace9877d93e'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:33:33.575456 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-69e9c3e5-394e-4ed4-a427-1ace9877d93e admin admin] The token cache is being invalidate because project 3261dcd955974603858fff7d645fa6c8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 12:33:33.575752 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-69e9c3e5-394e-4ed4-a427-1ace9877d93e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:33:33.576420 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-69e9c3e5-394e-4ed4-a427-1ace9877d93e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:33:33.578251 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1361/2722] 10.222.0.44 () {58 vars in 1232 bytes} [Thu Jun 16 12:33:33 2022] DELETE /identity/v3/projects/3261dcd955974603858fff7d645fa6c8 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:33:33.582420 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b07274-55c3-4928-9737-a64f0559ccf5 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:33:33.585098 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-52b07274-55c3-4928-9737-a64f0559ccf5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:33:33.601473 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b07274-55c3-4928-9737-a64f0559ccf5 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:33:33.661939 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa888846-1a07-4ee0-9f4c-4231fe2798e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:33:33.662821 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa888846-1a07-4ee0-9f4c-4231fe2798e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:33:33.663102 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa888846-1a07-4ee0-9f4c-4231fe2798e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:33:33.663375 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa888846-1a07-4ee0-9f4c-4231fe2798e7 admin admin] PATH_INFO: `/v3/users/a3c0d2e94b394478a3666f96c0e7deba` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:33:33.664556 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa888846-1a07-4ee0-9f4c-4231fe2798e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a3c0d2e94b394478a3666f96c0e7deba)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:33:33.666544 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa888846-1a07-4ee0-9f4c-4231fe2798e7 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:33:33.715372 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:33:33.717568 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-aa888846-1a07-4ee0-9f4c-4231fe2798e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a3c0d2e94b394478a3666f96c0e7deba'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:33:33.718759 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-aa888846-1a07-4ee0-9f4c-4231fe2798e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a3c0d2e94b394478a3666f96c0e7deba'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:33:33.728533 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-aa888846-1a07-4ee0-9f4c-4231fe2798e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a3c0d2e94b394478a3666f96c0e7deba'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:33:33.729255 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-aa888846-1a07-4ee0-9f4c-4231fe2798e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a3c0d2e94b394478a3666f96c0e7deba'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:33:33.737223 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-aa888846-1a07-4ee0-9f4c-4231fe2798e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a3c0d2e94b394478a3666f96c0e7deba'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:33:33.757812 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1362/2723] 10.222.0.44 () {58 vars in 1223 bytes} [Thu Jun 16 12:33:33 2022] DELETE /identity/v3/users/a3c0d2e94b394478a3666f96c0e7deba => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:33:34.061311 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e9c3e5-394e-4ed4-a427-1ace9877d93e admin admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:33:34.062847 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-69e9c3e5-394e-4ed4-a427-1ace9877d93e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:33:34.082773 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e9c3e5-394e-4ed4-a427-1ace9877d93e admin admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:33:34.147721 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0eb452a-ed06-46f7-af38-d98230d8070c None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:33:34.148010 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0eb452a-ed06-46f7-af38-d98230d8070c None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:33:34.148290 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0eb452a-ed06-46f7-af38-d98230d8070c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:33:34.149939 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33163749-cd6f-43e3-a219-04bc5040d7c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:33:34.150875 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33163749-cd6f-43e3-a219-04bc5040d7c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:33:34.151226 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33163749-cd6f-43e3-a219-04bc5040d7c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:33:34.151574 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33163749-cd6f-43e3-a219-04bc5040d7c3 admin admin] PATH_INFO: `/v3/projects/61ec33e656a243bc81ae43985cde6b9f` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:33:34.152854 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33163749-cd6f-43e3-a219-04bc5040d7c3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=61ec33e656a243bc81ae43985cde6b9f)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:33:34.154810 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33163749-cd6f-43e3-a219-04bc5040d7c3 admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:33:34.168067 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-a0eb452a-ed06-46f7-af38-d98230d8070c None None] MFA Rules not processed for user `f396379ba6024afaaac167a179919cd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:33:34.169303 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-a0eb452a-ed06-46f7-af38-d98230d8070c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:33:34.182170 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:33:34.211470 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-33163749-cd6f-43e3-a219-04bc5040d7c3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '61ec33e656a243bc81ae43985cde6b9f', 'request_id': 'req-33163749-cd6f-43e3-a219-04bc5040d7c3'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:33:34.222316 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-33163749-cd6f-43e3-a219-04bc5040d7c3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '61ec33e656a243bc81ae43985cde6b9f', 'request_id': 'req-33163749-cd6f-43e3-a219-04bc5040d7c3'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:33:34.229119 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-33163749-cd6f-43e3-a219-04bc5040d7c3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '61ec33e656a243bc81ae43985cde6b9f', 'request_id': 'req-33163749-cd6f-43e3-a219-04bc5040d7c3'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:33:34.240265 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1363/2724] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 12:33:34 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 12:33:34.241556 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-33163749-cd6f-43e3-a219-04bc5040d7c3 admin admin] The token cache is being invalidate because project 61ec33e656a243bc81ae43985cde6b9f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 12:33:34.241849 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-33163749-cd6f-43e3-a219-04bc5040d7c3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:33:34.242495 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-33163749-cd6f-43e3-a219-04bc5040d7c3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:33:34.247278 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1362/2725] 10.222.0.44 () {58 vars in 1232 bytes} [Thu Jun 16 12:33:34 2022] DELETE /identity/v3/projects/61ec33e656a243bc81ae43985cde6b9f => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:33:34.249047 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba6efe3-eb07-4214-b848-7543443f39a0 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:33:34.249497 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba6efe3-eb07-4214-b848-7543443f39a0 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:33:34.249773 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba6efe3-eb07-4214-b848-7543443f39a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:33:34.268891 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-0ba6efe3-eb07-4214-b848-7543443f39a0 None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:33:34.270291 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-0ba6efe3-eb07-4214-b848-7543443f39a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:33:34.337552 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1364/2726] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 12:33:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 12:33:34.346145 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1021933-4c10-435b-b157-d0484afc3ccd None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:33:34.347491 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1021933-4c10-435b-b157-d0484afc3ccd None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:33:34.348501 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1021933-4c10-435b-b157-d0484afc3ccd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:33:34.373849 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-b1021933-4c10-435b-b157-d0484afc3ccd None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:33:34.375260 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-b1021933-4c10-435b-b157-d0484afc3ccd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:33:34.387028 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1363/2727] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 12:33:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:33:34.388234 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba6efe3-eb07-4214-b848-7543443f39a0 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:33:34.403419 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba6efe3-eb07-4214-b848-7543443f39a0 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:33:34.408646 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82231c24-eee8-4486-8b86-22c5e1962883 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:33:34.409357 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82231c24-eee8-4486-8b86-22c5e1962883 admin admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:33:34.409634 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82231c24-eee8-4486-8b86-22c5e1962883 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:33:34.409900 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82231c24-eee8-4486-8b86-22c5e1962883 admin admin] PATH_INFO: `/v3/domains` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:33:34.410623 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82231c24-eee8-4486-8b86-22c5e1962883 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:33:34.410924 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82231c24-eee8-4486-8b86-22c5e1962883 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:33:34.413144 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82231c24-eee8-4486-8b86-22c5e1962883 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:33:34.429773 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1365/2728] 10.222.0.44 () {58 vars in 1152 bytes} [Thu Jun 16 12:33:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:33:34.430845 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1021933-4c10-435b-b157-d0484afc3ccd None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:33:34.440808 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1021933-4c10-435b-b157-d0484afc3ccd None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:33:34.445756 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d75a25-59f5-406c-901b-759a88527a8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:33:34.446365 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d75a25-59f5-406c-901b-759a88527a8f admin admin] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:33:34.446646 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d75a25-59f5-406c-901b-759a88527a8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:33:34.446916 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d75a25-59f5-406c-901b-759a88527a8f admin admin] PATH_INFO: `/v3/projects` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:33:34.447599 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d75a25-59f5-406c-901b-759a88527a8f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:33:34.449653 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d75a25-59f5-406c-901b-759a88527a8f admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:33:34.481378 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1364/2729] 10.222.0.44 () {60 vars in 1152 bytes} [Thu Jun 16 12:33:34 2022] POST /identity/v3/projects => generated 373 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 12:33:34.482914 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82231c24-eee8-4486-8b86-22c5e1962883 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:33:34.494963 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82231c24-eee8-4486-8b86-22c5e1962883 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:33:34.581626 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:33:34.594677 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8846c392-e711-4bb0-86a3-64246b5920f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:33:34.595629 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8846c392-e711-4bb0-86a3-64246b5920f2 admin admin] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:33:34.596128 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8846c392-e711-4bb0-86a3-64246b5920f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:33:34.596556 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8846c392-e711-4bb0-86a3-64246b5920f2 admin admin] PATH_INFO: `/v3/users` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:33:34.597988 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8846c392-e711-4bb0-86a3-64246b5920f2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:33:34.602017 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8846c392-e711-4bb0-86a3-64246b5920f2 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:33:34.603123 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d75a25-59f5-406c-901b-759a88527a8f admin admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:33:34.604958 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-d8d75a25-59f5-406c-901b-759a88527a8f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:33:34.633932 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1366/2730] 10.222.0.44 () {60 vars in 1143 bytes} [Thu Jun 16 12:33:34 2022] POST /identity/v3/users => generated 287 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 12:33:34.638259 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8846c392-e711-4bb0-86a3-64246b5920f2 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:33:34.654314 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8846c392-e711-4bb0-86a3-64246b5920f2 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:33:34.660703 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a776832-9077-4510-b1f8-60f710604832 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:33:34.661481 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a776832-9077-4510-b1f8-60f710604832 admin admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:33:34.661730 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a776832-9077-4510-b1f8-60f710604832 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:33:34.662006 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a776832-9077-4510-b1f8-60f710604832 admin admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:33:34.662739 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a776832-9077-4510-b1f8-60f710604832 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:33:34.664423 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a776832-9077-4510-b1f8-60f710604832 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:33:34.680041 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1367/2731] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 12:33:34 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 12:33:34.681072 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a776832-9077-4510-b1f8-60f710604832 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:33:34.695043 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a776832-9077-4510-b1f8-60f710604832 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:33:34.700945 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447ba971-b9f2-49e1-9d50-4e57808dd99e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:33:34.701533 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447ba971-b9f2-49e1-9d50-4e57808dd99e admin admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:33:34.701824 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447ba971-b9f2-49e1-9d50-4e57808dd99e admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:33:34.702101 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447ba971-b9f2-49e1-9d50-4e57808dd99e admin admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:33:34.702835 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447ba971-b9f2-49e1-9d50-4e57808dd99e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:33:34.716771 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d75a25-59f5-406c-901b-759a88527a8f admin admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:33:34.717002 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447ba971-b9f2-49e1-9d50-4e57808dd99e admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:33:34.720445 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbefe380-649f-4388-b2ac-f7226ce76d23 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1094729b25a4be7b0b394998c9ca681', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '601361df39e34fcca71175aa94e425c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:33:34.721837 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbefe380-649f-4388-b2ac-f7226ce76d23 service neutron] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:33:34.722226 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbefe380-649f-4388-b2ac-f7226ce76d23 service neutron] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:33:34.722595 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbefe380-649f-4388-b2ac-f7226ce76d23 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:33:34.724864 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-bbefe380-649f-4388-b2ac-f7226ce76d23 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:33:34.726652 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1368/2732] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 12:33:34 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 12:33:34.730779 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447ba971-b9f2-49e1-9d50-4e57808dd99e admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:33:34.740715 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbefe380-649f-4388-b2ac-f7226ce76d23 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:33:34.741489 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447ba971-b9f2-49e1-9d50-4e57808dd99e admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:33:34.742687 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbefe380-649f-4388-b2ac-f7226ce76d23 service neutron] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:33:34.747753 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5438b561-eadd-426b-8bae-8e60de1fc70a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:33:34.748668 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5438b561-eadd-426b-8bae-8e60de1fc70a admin admin] REQUEST_METHOD: `PUT` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:33:34.748984 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5438b561-eadd-426b-8bae-8e60de1fc70a admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:33:34.749254 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5438b561-eadd-426b-8bae-8e60de1fc70a admin admin] PATH_INFO: `/v3/projects/b9a4492ce42d43c3bcc11c803a629ff3/users/6ea8206391c74d27a0287438f05a75fc/roles/c39882b202e942479a7cdac2fc6da72c` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:33:34.754316 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1365/2733] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 12:33:34 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 12:33:34.773299 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5438b561-eadd-426b-8bae-8e60de1fc70a admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9a4492ce42d43c3bcc11c803a629ff3, user_id=6ea8206391c74d27a0287438f05a75fc, role_id=c39882b202e942479a7cdac2fc6da72c)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:33:34.776289 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5438b561-eadd-426b-8bae-8e60de1fc70a admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:33:34.796788 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1369/2734] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 16 12:33:34 2022] PUT /identity/v3/projects/b9a4492ce42d43c3bcc11c803a629ff3/users/6ea8206391c74d27a0287438f05a75fc/roles/c39882b202e942479a7cdac2fc6da72c => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 12:33:34.870856 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529316e1-eb0f-4951-8184-c58e487de3e9 None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:33:34.871239 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529316e1-eb0f-4951-8184-c58e487de3e9 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:33:34.871626 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529316e1-eb0f-4951-8184-c58e487de3e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:33:34.907153 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-529316e1-eb0f-4951-8184-c58e487de3e9 None None] MFA Rules not processed for user `6ea8206391c74d27a0287438f05a75fc`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:33:34.909224 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-529316e1-eb0f-4951-8184-c58e487de3e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:33:35.007610 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1366/2735] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 12:33:34 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:33:35.023249 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5438b561-eadd-426b-8bae-8e60de1fc70a admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:33:35.025892 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-5438b561-eadd-426b-8bae-8e60de1fc70a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:33:35.100378 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5438b561-eadd-426b-8bae-8e60de1fc70a admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:33:35.104655 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3d7bfc-ff76-408f-878e-0462bd7ab2ca service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f96fc14ed89478c8a8c2f11c87511e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '601361df39e34fcca71175aa94e425c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:33:35.105804 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3d7bfc-ff76-408f-878e-0462bd7ab2ca service cinder] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:33:35.106117 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3d7bfc-ff76-408f-878e-0462bd7ab2ca service cinder] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:33:35.106397 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3d7bfc-ff76-408f-878e-0462bd7ab2ca service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:33:35.117126 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3d7bfc-ff76-408f-878e-0462bd7ab2ca service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:33:35.118600 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3d7bfc-ff76-408f-878e-0462bd7ab2ca service cinder] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:33:35.129535 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1370/2736] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 12:33:35 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 12:33:36.644057 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c75e2d-4e05-4096-b25a-f3f3fc831418 None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:33:36.644576 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c75e2d-4e05-4096-b25a-f3f3fc831418 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:33:36.644675 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c75e2d-4e05-4096-b25a-f3f3fc831418 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:33:36.665029 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-60c75e2d-4e05-4096-b25a-f3f3fc831418 None None] MFA Rules not processed for user `6ea8206391c74d27a0287438f05a75fc`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:33:36.666252 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-60c75e2d-4e05-4096-b25a-f3f3fc831418 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:33:36.678706 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1367/2737] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 12:33:36 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:33:45.124821 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=50,keystone:INSERT=4 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:33:46.658317 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:DELETE=7,keystone:SELECT=88,keystone:INSERT=2 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:33:47.542231 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3d7bfc-ff76-408f-878e-0462bd7ab2ca service cinder] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:33:47.543701 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-af3d7bfc-ff76-408f-878e-0462bd7ab2ca service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:33:47.628544 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3d7bfc-ff76-408f-878e-0462bd7ab2ca service cinder] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:33:47.634215 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9279ddda-7bed-47ac-a552-8e08bb91d24c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edfb12d445e74136b90800e93941f468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '601361df39e34fcca71175aa94e425c4', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:33:47.634877 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9279ddda-7bed-47ac-a552-8e08bb91d24c service nova] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:33:47.635154 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9279ddda-7bed-47ac-a552-8e08bb91d24c service nova] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:33:47.635423 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9279ddda-7bed-47ac-a552-8e08bb91d24c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:33:47.637274 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-9279ddda-7bed-47ac-a552-8e08bb91d24c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:33:47.650912 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9279ddda-7bed-47ac-a552-8e08bb91d24c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:33:47.652506 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9279ddda-7bed-47ac-a552-8e08bb91d24c service nova] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:33:47.664569 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1371/2738] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 12:33:47 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 12:33:52.439766 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b845656-3963-4e01-9f1e-0daab99aa726 None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:33:52.440222 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b845656-3963-4e01-9f1e-0daab99aa726 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:33:52.440336 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b845656-3963-4e01-9f1e-0daab99aa726 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:33:52.457574 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-9b845656-3963-4e01-9f1e-0daab99aa726 None None] MFA Rules not processed for user `222b53cae3d64412b9b0a89d162311f4`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:33:52.459302 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-9b845656-3963-4e01-9f1e-0daab99aa726 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:33:52.513951 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1368/2739] 10.222.0.44 () {58 vars in 1009 bytes} [Thu Jun 16 12:33:52 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:33:52.558693 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9279ddda-7bed-47ac-a552-8e08bb91d24c service nova] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:33:52.560106 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-9279ddda-7bed-47ac-a552-8e08bb91d24c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:33:52.628026 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9279ddda-7bed-47ac-a552-8e08bb91d24c service nova] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:33:52.633544 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586d1acc-e6c5-4774-a4b6-b962372076c0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c159f79c1921496487101aac5d530ae5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '601361df39e34fcca71175aa94e425c4', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:33:52.634182 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586d1acc-e6c5-4774-a4b6-b962372076c0 service swift] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:33:52.634464 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586d1acc-e6c5-4774-a4b6-b962372076c0 service swift] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:33:52.634734 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586d1acc-e6c5-4774-a4b6-b962372076c0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:33:52.642638 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586d1acc-e6c5-4774-a4b6-b962372076c0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:33:52.644215 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586d1acc-e6c5-4774-a4b6-b962372076c0 service swift] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:33:52.653097 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1372/2740] 10.222.0.44 () {60 vars in 1384 bytes} [Thu Jun 16 12:33:52 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 16 12:33:53.135001 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6df65f-58f7-4db2-aa26-6885ebddb5a6 None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:33:53.135287 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6df65f-58f7-4db2-aa26-6885ebddb5a6 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:33:53.135563 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6df65f-58f7-4db2-aa26-6885ebddb5a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:33:53.153928 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-0d6df65f-58f7-4db2-aa26-6885ebddb5a6 None None] MFA Rules not processed for user `222b53cae3d64412b9b0a89d162311f4`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:33:53.155146 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-0d6df65f-58f7-4db2-aa26-6885ebddb5a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:33:53.162593 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1369/2741] 10.222.0.44 () {58 vars in 967 bytes} [Thu Jun 16 12:33:53 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:33:53.174692 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586d1acc-e6c5-4774-a4b6-b962372076c0 service swift] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:33:53.186214 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586d1acc-e6c5-4774-a4b6-b962372076c0 service swift] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:33:53.190982 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead1f428-0be3-47b3-8df5-f93f5a6259c8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c159f79c1921496487101aac5d530ae5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '601361df39e34fcca71175aa94e425c4', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:33:53.191615 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead1f428-0be3-47b3-8df5-f93f5a6259c8 service swift] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:33:53.191893 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead1f428-0be3-47b3-8df5-f93f5a6259c8 service swift] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:33:53.192731 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead1f428-0be3-47b3-8df5-f93f5a6259c8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:33:53.201018 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead1f428-0be3-47b3-8df5-f93f5a6259c8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:33:53.202588 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead1f428-0be3-47b3-8df5-f93f5a6259c8 service swift] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:33:53.210615 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1373/2742] 10.222.0.44 () {60 vars in 1384 bytes} [Thu Jun 16 12:33:53 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 16 12:33:53.400404 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b80624e-20f2-4c36-beeb-21f3df43f513 None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:33:53.400699 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b80624e-20f2-4c36-beeb-21f3df43f513 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:33:53.401013 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b80624e-20f2-4c36-beeb-21f3df43f513 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:33:53.418792 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-3b80624e-20f2-4c36-beeb-21f3df43f513 None None] MFA Rules not processed for user `222b53cae3d64412b9b0a89d162311f4`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:33:53.419997 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-3b80624e-20f2-4c36-beeb-21f3df43f513 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:33:53.428140 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1370/2743] 10.222.0.44 () {58 vars in 1009 bytes} [Thu Jun 16 12:33:53 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:33:53.440195 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead1f428-0be3-47b3-8df5-f93f5a6259c8 service swift] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:33:53.451209 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead1f428-0be3-47b3-8df5-f93f5a6259c8 service swift] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:33:53.456399 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcc023c-7615-49b3-b4fa-b840aea98fd9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c159f79c1921496487101aac5d530ae5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '601361df39e34fcca71175aa94e425c4', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:33:53.457070 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcc023c-7615-49b3-b4fa-b840aea98fd9 service swift] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:33:53.457352 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcc023c-7615-49b3-b4fa-b840aea98fd9 service swift] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:33:53.457628 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcc023c-7615-49b3-b4fa-b840aea98fd9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:33:53.466294 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcc023c-7615-49b3-b4fa-b840aea98fd9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:33:53.467961 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcc023c-7615-49b3-b4fa-b840aea98fd9 service swift] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:33:53.476952 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1374/2744] 10.222.0.44 () {60 vars in 1384 bytes} [Thu Jun 16 12:33:53 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 16 12:33:53.811844 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc7cf0a-d9ee-44b8-9ebd-32ec6ddcea44 None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:33:53.812318 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc7cf0a-d9ee-44b8-9ebd-32ec6ddcea44 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:33:53.812415 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc7cf0a-d9ee-44b8-9ebd-32ec6ddcea44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:33:53.829744 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-ccc7cf0a-d9ee-44b8-9ebd-32ec6ddcea44 None None] MFA Rules not processed for user `222b53cae3d64412b9b0a89d162311f4`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:33:53.830958 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-ccc7cf0a-d9ee-44b8-9ebd-32ec6ddcea44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:33:53.838698 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1371/2745] 10.222.0.44 () {58 vars in 967 bytes} [Thu Jun 16 12:33:53 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:33:53.854412 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcc023c-7615-49b3-b4fa-b840aea98fd9 service swift] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:33:53.865376 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcc023c-7615-49b3-b4fa-b840aea98fd9 service swift] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:33:53.871740 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38945fd7-813b-435a-bd27-8ce88c03e12b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c159f79c1921496487101aac5d530ae5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '601361df39e34fcca71175aa94e425c4', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:33:53.872663 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38945fd7-813b-435a-bd27-8ce88c03e12b service swift] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:33:53.873159 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38945fd7-813b-435a-bd27-8ce88c03e12b service swift] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:33:53.873623 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38945fd7-813b-435a-bd27-8ce88c03e12b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:33:53.885730 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38945fd7-813b-435a-bd27-8ce88c03e12b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:33:53.887577 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38945fd7-813b-435a-bd27-8ce88c03e12b service swift] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:33:53.897743 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1375/2746] 10.222.0.44 () {60 vars in 1384 bytes} [Thu Jun 16 12:33:53 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 16 12:33:55.939240 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc7cf0a-d9ee-44b8-9ebd-32ec6ddcea44 None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:33:56.001067 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc7cf0a-d9ee-44b8-9ebd-32ec6ddcea44 None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:33:56.006116 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830812ef-3cdf-4bc8-8554-9675aa3c3722 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:33:56.007173 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830812ef-3cdf-4bc8-8554-9675aa3c3722 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:33:56.007447 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830812ef-3cdf-4bc8-8554-9675aa3c3722 admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:33:56.007713 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830812ef-3cdf-4bc8-8554-9675aa3c3722 admin admin] PATH_INFO: `/v3/users/6ea8206391c74d27a0287438f05a75fc` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:33:56.008929 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830812ef-3cdf-4bc8-8554-9675aa3c3722 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6ea8206391c74d27a0287438f05a75fc)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:33:56.010848 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830812ef-3cdf-4bc8-8554-9675aa3c3722 admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:33:56.056076 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-830812ef-3cdf-4bc8-8554-9675aa3c3722 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6ea8206391c74d27a0287438f05a75fc'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:33:56.068109 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-830812ef-3cdf-4bc8-8554-9675aa3c3722 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6ea8206391c74d27a0287438f05a75fc'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:33:56.074945 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-830812ef-3cdf-4bc8-8554-9675aa3c3722 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6ea8206391c74d27a0287438f05a75fc'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:33:56.075642 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-830812ef-3cdf-4bc8-8554-9675aa3c3722 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6ea8206391c74d27a0287438f05a75fc'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:33:56.076294 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-830812ef-3cdf-4bc8-8554-9675aa3c3722 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6ea8206391c74d27a0287438f05a75fc'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:33:56.089054 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1372/2747] 10.222.0.44 () {58 vars in 1223 bytes} [Thu Jun 16 12:33:55 2022] DELETE /identity/v3/users/6ea8206391c74d27a0287438f05a75fc => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:33:56.093486 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb44f93e-a64b-440b-a5b7-341e0d60d339 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:33:56.093953 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb44f93e-a64b-440b-a5b7-341e0d60d339 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:33:56.094051 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb44f93e-a64b-440b-a5b7-341e0d60d339 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:33:56.111297 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-fb44f93e-a64b-440b-a5b7-341e0d60d339 None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:33:56.112668 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-fb44f93e-a64b-440b-a5b7-341e0d60d339 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:33:56.142560 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:33:56.171215 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1376/2748] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 12:33:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:33:56.181199 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830812ef-3cdf-4bc8-8554-9675aa3c3722 admin admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:33:56.182643 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-830812ef-3cdf-4bc8-8554-9675aa3c3722 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:33:56.189194 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:33:56.240318 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830812ef-3cdf-4bc8-8554-9675aa3c3722 admin admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:33:56.243923 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9128b1f-a0b9-4956-b8c0-a94b787ad178 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1094729b25a4be7b0b394998c9ca681', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '601361df39e34fcca71175aa94e425c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:33:56.244554 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9128b1f-a0b9-4956-b8c0-a94b787ad178 service neutron] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:33:56.244857 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9128b1f-a0b9-4956-b8c0-a94b787ad178 service neutron] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:33:56.245128 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9128b1f-a0b9-4956-b8c0-a94b787ad178 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:33:56.254010 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9128b1f-a0b9-4956-b8c0-a94b787ad178 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:33:56.256061 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9128b1f-a0b9-4956-b8c0-a94b787ad178 service neutron] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:33:56.265470 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1373/2749] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 12:33:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 12:33:56.432564 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb44f93e-a64b-440b-a5b7-341e0d60d339 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:33:56.434047 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-fb44f93e-a64b-440b-a5b7-341e0d60d339 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:33:56.446360 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb44f93e-a64b-440b-a5b7-341e0d60d339 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:33:56.451046 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b1c52f-5d40-446f-8594-c6e8169b376c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:33:56.451909 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b1c52f-5d40-446f-8594-c6e8169b376c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:33:56.452194 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b1c52f-5d40-446f-8594-c6e8169b376c admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:33:56.452470 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b1c52f-5d40-446f-8594-c6e8169b376c admin admin] PATH_INFO: `/v3/projects/b9a4492ce42d43c3bcc11c803a629ff3` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:33:56.453700 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b1c52f-5d40-446f-8594-c6e8169b376c admin admin] RBAC: Authorizing `identity:delete_project(project_id=b9a4492ce42d43c3bcc11c803a629ff3)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:33:56.455622 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b1c52f-5d40-446f-8594-c6e8169b376c admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:33:56.502744 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-17b1c52f-5d40-446f-8594-c6e8169b376c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b9a4492ce42d43c3bcc11c803a629ff3', 'request_id': 'req-17b1c52f-5d40-446f-8594-c6e8169b376c'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:33:56.509932 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-17b1c52f-5d40-446f-8594-c6e8169b376c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b9a4492ce42d43c3bcc11c803a629ff3', 'request_id': 'req-17b1c52f-5d40-446f-8594-c6e8169b376c'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:33:56.515384 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-17b1c52f-5d40-446f-8594-c6e8169b376c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b9a4492ce42d43c3bcc11c803a629ff3', 'request_id': 'req-17b1c52f-5d40-446f-8594-c6e8169b376c'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:33:56.529378 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-17b1c52f-5d40-446f-8594-c6e8169b376c admin admin] The token cache is being invalidate because project b9a4492ce42d43c3bcc11c803a629ff3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 12:33:56.529378 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-17b1c52f-5d40-446f-8594-c6e8169b376c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:33:56.529378 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-17b1c52f-5d40-446f-8594-c6e8169b376c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:33:56.529378 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1377/2750] 10.222.0.44 () {58 vars in 1232 bytes} [Thu Jun 16 12:33:56 2022] DELETE /identity/v3/projects/b9a4492ce42d43c3bcc11c803a629ff3 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:33:56.534432 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42e8b9c-1aa0-459c-bbc2-84b202f25ced None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:33:56.534714 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42e8b9c-1aa0-459c-bbc2-84b202f25ced None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:33:56.534990 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42e8b9c-1aa0-459c-bbc2-84b202f25ced None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:33:56.554002 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-d42e8b9c-1aa0-459c-bbc2-84b202f25ced None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:33:56.555190 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-d42e8b9c-1aa0-459c-bbc2-84b202f25ced None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:33:56.612805 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1374/2751] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 12:33:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:33:56.620661 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8882997f-a888-41ad-b78b-f613d55b1a7a None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:33:56.620979 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8882997f-a888-41ad-b78b-f613d55b1a7a None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:33:56.621259 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8882997f-a888-41ad-b78b-f613d55b1a7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:33:56.640375 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-8882997f-a888-41ad-b78b-f613d55b1a7a None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:33:56.641619 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-8882997f-a888-41ad-b78b-f613d55b1a7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:33:56.650285 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1378/2752] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 12:33:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:33:56.654287 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42e8b9c-1aa0-459c-bbc2-84b202f25ced None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:33:56.664441 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42e8b9c-1aa0-459c-bbc2-84b202f25ced None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:33:56.669016 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9286ec8e-1064-419c-8581-538b11949701 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:33:56.669661 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9286ec8e-1064-419c-8581-538b11949701 admin admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:33:56.669942 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9286ec8e-1064-419c-8581-538b11949701 admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:33:56.670218 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9286ec8e-1064-419c-8581-538b11949701 admin admin] PATH_INFO: `/v3/domains` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:33:56.670955 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9286ec8e-1064-419c-8581-538b11949701 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:33:56.671245 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9286ec8e-1064-419c-8581-538b11949701 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:33:56.672890 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9286ec8e-1064-419c-8581-538b11949701 admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:33:56.684268 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1375/2753] 10.222.0.44 () {58 vars in 1152 bytes} [Thu Jun 16 12:33:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:33:56.688344 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8882997f-a888-41ad-b78b-f613d55b1a7a None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:33:56.697493 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8882997f-a888-41ad-b78b-f613d55b1a7a None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:33:56.702281 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daaa380a-0816-4591-a490-b8e604578a2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:33:56.702922 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaa380a-0816-4591-a490-b8e604578a2b admin admin] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:33:56.703201 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaa380a-0816-4591-a490-b8e604578a2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:33:56.703474 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaa380a-0816-4591-a490-b8e604578a2b admin admin] PATH_INFO: `/v3/projects` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:33:56.704193 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daaa380a-0816-4591-a490-b8e604578a2b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:33:56.706164 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daaa380a-0816-4591-a490-b8e604578a2b admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:33:56.731570 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1379/2754] 10.222.0.44 () {60 vars in 1152 bytes} [Thu Jun 16 12:33:56 2022] POST /identity/v3/projects => generated 389 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 12:33:56.735545 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9286ec8e-1064-419c-8581-538b11949701 admin admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:33:56.746334 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9286ec8e-1064-419c-8581-538b11949701 admin admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:33:56.811536 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa18165-efab-44c4-9291-631e697e585a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:33:56.812508 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa18165-efab-44c4-9291-631e697e585a admin admin] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:33:56.813011 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa18165-efab-44c4-9291-631e697e585a admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:33:56.813463 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa18165-efab-44c4-9291-631e697e585a admin admin] PATH_INFO: `/v3/users` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:33:56.814987 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa18165-efab-44c4-9291-631e697e585a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:33:56.817867 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa18165-efab-44c4-9291-631e697e585a admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:33:56.841504 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1376/2755] 10.222.0.44 () {60 vars in 1143 bytes} [Thu Jun 16 12:33:56 2022] POST /identity/v3/users => generated 295 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 12:33:56.845668 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daaa380a-0816-4591-a490-b8e604578a2b admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:33:56.856506 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daaa380a-0816-4591-a490-b8e604578a2b admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:33:56.861117 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5869b017-baf1-40ac-a3d9-84c022fde82e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:33:56.861771 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5869b017-baf1-40ac-a3d9-84c022fde82e admin admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:33:56.862053 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5869b017-baf1-40ac-a3d9-84c022fde82e admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:33:56.862327 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5869b017-baf1-40ac-a3d9-84c022fde82e admin admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:33:56.863101 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5869b017-baf1-40ac-a3d9-84c022fde82e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:33:56.864643 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5869b017-baf1-40ac-a3d9-84c022fde82e admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:33:56.874863 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1380/2756] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 12:33:56 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 12:33:56.879081 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa18165-efab-44c4-9291-631e697e585a admin admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:33:56.891347 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa18165-efab-44c4-9291-631e697e585a admin admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:33:56.898096 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11f572b-c3ba-4fc7-b272-3880f442836b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:33:56.899053 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11f572b-c3ba-4fc7-b272-3880f442836b admin admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:33:56.899503 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11f572b-c3ba-4fc7-b272-3880f442836b admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:33:56.899946 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11f572b-c3ba-4fc7-b272-3880f442836b admin admin] PATH_INFO: `/v3/roles` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:33:56.901695 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11f572b-c3ba-4fc7-b272-3880f442836b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:33:56.903898 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11f572b-c3ba-4fc7-b272-3880f442836b admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:33:56.916639 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1377/2757] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 12:33:56 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 12:33:56.920704 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5869b017-baf1-40ac-a3d9-84c022fde82e admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:33:56.930612 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5869b017-baf1-40ac-a3d9-84c022fde82e admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:33:56.935247 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d9559b-2061-4d3a-b1c9-e46c310ad64b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:33:56.936123 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d9559b-2061-4d3a-b1c9-e46c310ad64b admin admin] REQUEST_METHOD: `PUT` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:33:56.936403 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d9559b-2061-4d3a-b1c9-e46c310ad64b admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:33:56.936670 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d9559b-2061-4d3a-b1c9-e46c310ad64b admin admin] PATH_INFO: `/v3/projects/427478a6c43d43eb8bd4cde3fa98e74b/users/0c3605898e954aa28f83caa04d84c122/roles/c39882b202e942479a7cdac2fc6da72c` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:33:56.951201 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d9559b-2061-4d3a-b1c9-e46c310ad64b admin admin] RBAC: Authorizing `identity:create_grant(project_id=427478a6c43d43eb8bd4cde3fa98e74b, user_id=0c3605898e954aa28f83caa04d84c122, role_id=c39882b202e942479a7cdac2fc6da72c)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:33:56.953874 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d9559b-2061-4d3a-b1c9-e46c310ad64b admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:33:56.967009 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1381/2758] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 16 12:33:56 2022] PUT /identity/v3/projects/427478a6c43d43eb8bd4cde3fa98e74b/users/0c3605898e954aa28f83caa04d84c122/roles/c39882b202e942479a7cdac2fc6da72c => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:33:56.978410 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc15bfc-fa0b-4441-be4a-ea76a5aae292 None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:33:56.978880 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc15bfc-fa0b-4441-be4a-ea76a5aae292 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:33:56.979303 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc15bfc-fa0b-4441-be4a-ea76a5aae292 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:33:57.006321 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:33:57.009368 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-ecc15bfc-fa0b-4441-be4a-ea76a5aae292 None None] MFA Rules not processed for user `0c3605898e954aa28f83caa04d84c122`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:33:57.011246 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-ecc15bfc-fa0b-4441-be4a-ea76a5aae292 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:33:57.074190 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1378/2759] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 12:33:56 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:33:57.085400 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d9559b-2061-4d3a-b1c9-e46c310ad64b admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:33:57.087079 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-24d9559b-2061-4d3a-b1c9-e46c310ad64b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:33:57.142329 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d9559b-2061-4d3a-b1c9-e46c310ad64b admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:33:57.146587 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657097db-7f5b-40b1-85c0-a1f241ad6464 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f96fc14ed89478c8a8c2f11c87511e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '601361df39e34fcca71175aa94e425c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:33:57.147223 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657097db-7f5b-40b1-85c0-a1f241ad6464 service cinder] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:33:57.147498 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657097db-7f5b-40b1-85c0-a1f241ad6464 service cinder] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:33:57.147769 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657097db-7f5b-40b1-85c0-a1f241ad6464 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:33:57.156311 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657097db-7f5b-40b1-85c0-a1f241ad6464 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:33:57.157823 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657097db-7f5b-40b1-85c0-a1f241ad6464 service cinder] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:33:57.161249 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:33:57.168030 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1382/2760] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 12:33:57 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 12:34:07.071838 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=26 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:34:07.095907 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc15bfc-fa0b-4441-be4a-ea76a5aae292 None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:34:07.156825 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc15bfc-fa0b-4441-be4a-ea76a5aae292 None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:34:07.161324 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01107b4-d88e-4a00-9872-be277d48db0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:34:07.162184 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01107b4-d88e-4a00-9872-be277d48db0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:34:07.162465 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01107b4-d88e-4a00-9872-be277d48db0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:34:07.162741 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01107b4-d88e-4a00-9872-be277d48db0e admin admin] PATH_INFO: `/v3/users/0c3605898e954aa28f83caa04d84c122` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:34:07.163918 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01107b4-d88e-4a00-9872-be277d48db0e admin admin] RBAC: Authorizing `identity:delete_user(user_id=0c3605898e954aa28f83caa04d84c122)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:34:07.165918 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01107b4-d88e-4a00-9872-be277d48db0e admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:34:07.171845 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=1 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:34:07.210861 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-e01107b4-d88e-4a00-9872-be277d48db0e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0c3605898e954aa28f83caa04d84c122'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:34:07.222434 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-e01107b4-d88e-4a00-9872-be277d48db0e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0c3605898e954aa28f83caa04d84c122'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:34:07.229156 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-e01107b4-d88e-4a00-9872-be277d48db0e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0c3605898e954aa28f83caa04d84c122'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:34:07.229819 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-e01107b4-d88e-4a00-9872-be277d48db0e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0c3605898e954aa28f83caa04d84c122'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:34:07.230434 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-e01107b4-d88e-4a00-9872-be277d48db0e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0c3605898e954aa28f83caa04d84c122'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:34:07.242763 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1379/2761] 10.222.0.44 () {58 vars in 1223 bytes} [Thu Jun 16 12:34:07 2022] DELETE /identity/v3/users/0c3605898e954aa28f83caa04d84c122 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:34:07.248028 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbddf536-2e7f-4042-bf88-0f61873d6399 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:34:07.248360 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbddf536-2e7f-4042-bf88-0f61873d6399 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:34:07.248637 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbddf536-2e7f-4042-bf88-0f61873d6399 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:34:07.266507 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-bbddf536-2e7f-4042-bf88-0f61873d6399 None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:34:07.267703 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-bbddf536-2e7f-4042-bf88-0f61873d6399 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:34:07.324468 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1383/2762] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 12:34:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:34:07.333983 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01107b4-d88e-4a00-9872-be277d48db0e admin admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:34:07.335383 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-e01107b4-d88e-4a00-9872-be277d48db0e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:34:07.391819 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01107b4-d88e-4a00-9872-be277d48db0e admin admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:34:07.395454 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a413c7-00cf-4a9f-be7d-3168e5736a86 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1094729b25a4be7b0b394998c9ca681', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '601361df39e34fcca71175aa94e425c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:34:07.396090 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a413c7-00cf-4a9f-be7d-3168e5736a86 service neutron] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:34:07.396372 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a413c7-00cf-4a9f-be7d-3168e5736a86 service neutron] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:34:07.396643 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a413c7-00cf-4a9f-be7d-3168e5736a86 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:34:07.405805 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a413c7-00cf-4a9f-be7d-3168e5736a86 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:34:07.407225 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a413c7-00cf-4a9f-be7d-3168e5736a86 service neutron] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:34:07.417130 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1380/2763] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 12:34:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 12:34:07.682267 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbddf536-2e7f-4042-bf88-0f61873d6399 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:34:07.683946 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-bbddf536-2e7f-4042-bf88-0f61873d6399 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:34:07.697620 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbddf536-2e7f-4042-bf88-0f61873d6399 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:34:07.703029 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948d8792-ca17-4903-9250-cfa370849569 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:34:07.703895 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948d8792-ca17-4903-9250-cfa370849569 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:34:07.704172 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948d8792-ca17-4903-9250-cfa370849569 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:34:07.704488 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948d8792-ca17-4903-9250-cfa370849569 admin admin] PATH_INFO: `/v3/projects/427478a6c43d43eb8bd4cde3fa98e74b` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:34:07.705635 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948d8792-ca17-4903-9250-cfa370849569 admin admin] RBAC: Authorizing `identity:delete_project(project_id=427478a6c43d43eb8bd4cde3fa98e74b)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:34:07.707537 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948d8792-ca17-4903-9250-cfa370849569 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:34:07.752725 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-948d8792-ca17-4903-9250-cfa370849569 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '427478a6c43d43eb8bd4cde3fa98e74b', 'request_id': 'req-948d8792-ca17-4903-9250-cfa370849569'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:34:07.759388 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-948d8792-ca17-4903-9250-cfa370849569 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '427478a6c43d43eb8bd4cde3fa98e74b', 'request_id': 'req-948d8792-ca17-4903-9250-cfa370849569'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:34:07.764871 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-948d8792-ca17-4903-9250-cfa370849569 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '427478a6c43d43eb8bd4cde3fa98e74b', 'request_id': 'req-948d8792-ca17-4903-9250-cfa370849569'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:34:07.776237 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-948d8792-ca17-4903-9250-cfa370849569 admin admin] The token cache is being invalidate because project 427478a6c43d43eb8bd4cde3fa98e74b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 12:34:07.776517 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-948d8792-ca17-4903-9250-cfa370849569 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:34:07.777158 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-948d8792-ca17-4903-9250-cfa370849569 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:34:07.778664 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1384/2764] 10.222.0.44 () {58 vars in 1232 bytes} [Thu Jun 16 12:34:07 2022] DELETE /identity/v3/projects/427478a6c43d43eb8bd4cde3fa98e74b => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 12:34:17.412427 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=79,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:34:17.772633 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=54,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:34:27.723581 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decf0469-104e-42ef-8147-4830803f036e None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:34:27.724069 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decf0469-104e-42ef-8147-4830803f036e None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:34:27.724182 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decf0469-104e-42ef-8147-4830803f036e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:34:27.741915 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-decf0469-104e-42ef-8147-4830803f036e None None] MFA Rules not processed for user `f396379ba6024afaaac167a179919cd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:34:27.743167 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-decf0469-104e-42ef-8147-4830803f036e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:34:27.797252 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1381/2765] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 12:34:27 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:34:37.790601 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=25 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:35:14.967773 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948d8792-ca17-4903-9250-cfa370849569 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:35:14.974751 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-948d8792-ca17-4903-9250-cfa370849569 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:35:15.087716 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948d8792-ca17-4903-9250-cfa370849569 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:35:15.093070 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee9a5a7-65bd-4bee-b110-cb9639b61468 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8bff8ccf460a403d993c39327bbcbd29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '601361df39e34fcca71175aa94e425c4', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:35:15.093850 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee9a5a7-65bd-4bee-b110-cb9639b61468 service placement] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:35:15.094192 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee9a5a7-65bd-4bee-b110-cb9639b61468 service placement] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:35:15.094539 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee9a5a7-65bd-4bee-b110-cb9639b61468 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:35:15.096556 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-2ee9a5a7-65bd-4bee-b110-cb9639b61468 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:35:15.112678 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee9a5a7-65bd-4bee-b110-cb9639b61468 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:35:15.114394 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee9a5a7-65bd-4bee-b110-cb9639b61468 service placement] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:35:15.127179 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1385/2766] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 12:35:14 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 12:35:24.046695 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decf0469-104e-42ef-8147-4830803f036e None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:35:24.054969 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-decf0469-104e-42ef-8147-4830803f036e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:35:24.177997 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decf0469-104e-42ef-8147-4830803f036e None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:35:24.185209 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3387e3-97a3-42e6-b9c7-032cdf569a77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:35:24.186111 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3387e3-97a3-42e6-b9c7-032cdf569a77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:35:24.186399 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3387e3-97a3-42e6-b9c7-032cdf569a77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:35:24.186681 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3387e3-97a3-42e6-b9c7-032cdf569a77 admin admin] PATH_INFO: `/v3/users/77fd97ffc6cc45559f91dba33faaa2ec` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:35:24.187977 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3387e3-97a3-42e6-b9c7-032cdf569a77 admin admin] RBAC: Authorizing `identity:delete_user(user_id=77fd97ffc6cc45559f91dba33faaa2ec)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:35:24.189936 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3387e3-97a3-42e6-b9c7-032cdf569a77 admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:35:24.258324 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-8f3387e3-97a3-42e6-b9c7-032cdf569a77 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '77fd97ffc6cc45559f91dba33faaa2ec'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:35:24.281152 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-8f3387e3-97a3-42e6-b9c7-032cdf569a77 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '77fd97ffc6cc45559f91dba33faaa2ec'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:35:24.289395 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-8f3387e3-97a3-42e6-b9c7-032cdf569a77 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '77fd97ffc6cc45559f91dba33faaa2ec'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:35:24.290449 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-8f3387e3-97a3-42e6-b9c7-032cdf569a77 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '77fd97ffc6cc45559f91dba33faaa2ec'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:35:24.291197 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-8f3387e3-97a3-42e6-b9c7-032cdf569a77 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '77fd97ffc6cc45559f91dba33faaa2ec'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:35:24.308204 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1382/2767] 10.222.0.44 () {58 vars in 1223 bytes} [Thu Jun 16 12:35:24 2022] DELETE /identity/v3/users/77fd97ffc6cc45559f91dba33faaa2ec => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:35:24.502129 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee9a5a7-65bd-4bee-b110-cb9639b61468 service placement] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:35:24.519786 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee9a5a7-65bd-4bee-b110-cb9639b61468 service placement] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:35:24.588336 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b8eb3f-178e-4a2a-9fe3-65d059e5bbfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:35:24.589234 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b8eb3f-178e-4a2a-9fe3-65d059e5bbfd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:35:24.589509 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b8eb3f-178e-4a2a-9fe3-65d059e5bbfd admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:35:24.589780 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b8eb3f-178e-4a2a-9fe3-65d059e5bbfd admin admin] PATH_INFO: `/v3/projects/0a9ebeba3c8c4768a4416341048df6bd` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:35:24.590988 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b8eb3f-178e-4a2a-9fe3-65d059e5bbfd admin admin] RBAC: Authorizing `identity:delete_project(project_id=0a9ebeba3c8c4768a4416341048df6bd)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:35:24.592933 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b8eb3f-178e-4a2a-9fe3-65d059e5bbfd admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:35:24.642078 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-e8b8eb3f-178e-4a2a-9fe3-65d059e5bbfd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a9ebeba3c8c4768a4416341048df6bd', 'request_id': 'req-e8b8eb3f-178e-4a2a-9fe3-65d059e5bbfd'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:35:24.651346 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-e8b8eb3f-178e-4a2a-9fe3-65d059e5bbfd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a9ebeba3c8c4768a4416341048df6bd', 'request_id': 'req-e8b8eb3f-178e-4a2a-9fe3-65d059e5bbfd'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:35:24.656659 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-e8b8eb3f-178e-4a2a-9fe3-65d059e5bbfd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a9ebeba3c8c4768a4416341048df6bd', 'request_id': 'req-e8b8eb3f-178e-4a2a-9fe3-65d059e5bbfd'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:35:24.668783 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-e8b8eb3f-178e-4a2a-9fe3-65d059e5bbfd admin admin] The token cache is being invalidate because project 0a9ebeba3c8c4768a4416341048df6bd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 12:35:24.669072 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-e8b8eb3f-178e-4a2a-9fe3-65d059e5bbfd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:35:24.669750 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-e8b8eb3f-178e-4a2a-9fe3-65d059e5bbfd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:35:24.671502 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1386/2768] 10.222.0.44 () {58 vars in 1232 bytes} [Thu Jun 16 12:35:24 2022] DELETE /identity/v3/projects/0a9ebeba3c8c4768a4416341048df6bd => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:35:24.675390 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3387e3-97a3-42e6-b9c7-032cdf569a77 admin admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:35:24.677092 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-8f3387e3-97a3-42e6-b9c7-032cdf569a77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:35:24.692212 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3387e3-97a3-42e6-b9c7-032cdf569a77 admin admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:35:24.754793 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2e4a43-cdc3-4019-bbf3-2358c36a653b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:35:24.755854 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2e4a43-cdc3-4019-bbf3-2358c36a653b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:35:24.756135 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2e4a43-cdc3-4019-bbf3-2358c36a653b admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:35:24.756411 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2e4a43-cdc3-4019-bbf3-2358c36a653b admin admin] PATH_INFO: `/v3/users/aa0b42487302484688616aec57ada2be` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:35:24.757745 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2e4a43-cdc3-4019-bbf3-2358c36a653b admin admin] RBAC: Authorizing `identity:delete_user(user_id=aa0b42487302484688616aec57ada2be)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:35:24.759658 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2e4a43-cdc3-4019-bbf3-2358c36a653b admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:35:24.786814 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:35:24.816726 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-9d2e4a43-cdc3-4019-bbf3-2358c36a653b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aa0b42487302484688616aec57ada2be'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:35:24.828995 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-9d2e4a43-cdc3-4019-bbf3-2358c36a653b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aa0b42487302484688616aec57ada2be'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:35:24.835818 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-9d2e4a43-cdc3-4019-bbf3-2358c36a653b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aa0b42487302484688616aec57ada2be'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:35:24.836531 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-9d2e4a43-cdc3-4019-bbf3-2358c36a653b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aa0b42487302484688616aec57ada2be'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:35:24.837173 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-9d2e4a43-cdc3-4019-bbf3-2358c36a653b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aa0b42487302484688616aec57ada2be'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:35:24.857511 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1383/2769] 10.222.0.44 () {58 vars in 1223 bytes} [Thu Jun 16 12:35:24 2022] DELETE /identity/v3/users/aa0b42487302484688616aec57ada2be => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 12:35:25.042605 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b8eb3f-178e-4a2a-9fe3-65d059e5bbfd admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:35:25.044871 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-e8b8eb3f-178e-4a2a-9fe3-65d059e5bbfd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:35:25.063844 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b8eb3f-178e-4a2a-9fe3-65d059e5bbfd admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:35:25.081010 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:35:25.123292 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d4f6e2-a8f2-4863-ae69-c09a9223da87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:35:25.124308 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d4f6e2-a8f2-4863-ae69-c09a9223da87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:35:25.124610 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d4f6e2-a8f2-4863-ae69-c09a9223da87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:35:25.124878 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d4f6e2-a8f2-4863-ae69-c09a9223da87 admin admin] PATH_INFO: `/v3/projects/865c7f1b06fc46659df1acaed3558323` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:35:25.126095 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d4f6e2-a8f2-4863-ae69-c09a9223da87 admin admin] RBAC: Authorizing `identity:delete_project(project_id=865c7f1b06fc46659df1acaed3558323)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:35:25.127993 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d4f6e2-a8f2-4863-ae69-c09a9223da87 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:35:25.177285 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-64d4f6e2-a8f2-4863-ae69-c09a9223da87 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '865c7f1b06fc46659df1acaed3558323', 'request_id': 'req-64d4f6e2-a8f2-4863-ae69-c09a9223da87'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:35:25.185401 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-64d4f6e2-a8f2-4863-ae69-c09a9223da87 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '865c7f1b06fc46659df1acaed3558323', 'request_id': 'req-64d4f6e2-a8f2-4863-ae69-c09a9223da87'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:35:25.192093 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-64d4f6e2-a8f2-4863-ae69-c09a9223da87 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '865c7f1b06fc46659df1acaed3558323', 'request_id': 'req-64d4f6e2-a8f2-4863-ae69-c09a9223da87'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:35:25.204087 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-64d4f6e2-a8f2-4863-ae69-c09a9223da87 admin admin] The token cache is being invalidate because project 865c7f1b06fc46659df1acaed3558323 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 12:35:25.204377 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-64d4f6e2-a8f2-4863-ae69-c09a9223da87 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:35:25.205066 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-64d4f6e2-a8f2-4863-ae69-c09a9223da87 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:35:25.207556 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1387/2770] 10.222.0.44 () {58 vars in 1232 bytes} [Thu Jun 16 12:35:25 2022] DELETE /identity/v3/projects/865c7f1b06fc46659df1acaed3558323 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:35:27.192641 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696c9131-3872-44c5-ab69-0b84aff9417e None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:35:27.193168 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696c9131-3872-44c5-ab69-0b84aff9417e None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:35:27.193280 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696c9131-3872-44c5-ab69-0b84aff9417e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:35:27.212592 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-696c9131-3872-44c5-ab69-0b84aff9417e None None] MFA Rules not processed for user `f396379ba6024afaaac167a179919cd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:35:27.213829 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-696c9131-3872-44c5-ab69-0b84aff9417e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:35:27.267611 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1384/2771] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 12:35:27 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:35:35.200741 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=42,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:35:37.261130 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:DELETE=7,keystone:SELECT=45,keystone:INSERT=1 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:36:23.269691 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc814c04-93f2-4985-99b1-14fa2605647c None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:36:23.270212 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc814c04-93f2-4985-99b1-14fa2605647c None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:36:23.270325 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc814c04-93f2-4985-99b1-14fa2605647c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:36:23.288525 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-dc814c04-93f2-4985-99b1-14fa2605647c None None] MFA Rules not processed for user `f396379ba6024afaaac167a179919cd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:36:23.289769 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-dc814c04-93f2-4985-99b1-14fa2605647c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:36:23.296499 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1388/2772] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 12:36:23 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 12:36:33.282527 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=3 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:37:09.388588 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696c9131-3872-44c5-ab69-0b84aff9417e None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:37:09.390261 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-696c9131-3872-44c5-ab69-0b84aff9417e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:37:09.445026 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696c9131-3872-44c5-ab69-0b84aff9417e None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:37:09.449128 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd34b1a-faa8-4398-a7e2-574821957ce2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f96fc14ed89478c8a8c2f11c87511e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '601361df39e34fcca71175aa94e425c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:37:09.449769 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd34b1a-faa8-4398-a7e2-574821957ce2 service cinder] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:37:09.450051 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd34b1a-faa8-4398-a7e2-574821957ce2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:37:09.450331 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd34b1a-faa8-4398-a7e2-574821957ce2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:37:09.452085 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-7bd34b1a-faa8-4398-a7e2-574821957ce2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:37:09.520082 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd34b1a-faa8-4398-a7e2-574821957ce2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:37:09.521541 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd34b1a-faa8-4398-a7e2-574821957ce2 service cinder] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:37:09.532917 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1385/2773] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 12:37:09 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 12:37:11.033872 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc814c04-93f2-4985-99b1-14fa2605647c None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:37:11.035249 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-dc814c04-93f2-4985-99b1-14fa2605647c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:37:11.047437 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc814c04-93f2-4985-99b1-14fa2605647c None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:37:11.050972 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb0e463-9311-44eb-8c48-890112c53913 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f96fc14ed89478c8a8c2f11c87511e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '601361df39e34fcca71175aa94e425c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:37:11.051598 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb0e463-9311-44eb-8c48-890112c53913 service cinder] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:37:11.051872 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb0e463-9311-44eb-8c48-890112c53913 service cinder] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:37:11.052147 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb0e463-9311-44eb-8c48-890112c53913 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:37:11.053876 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-2cb0e463-9311-44eb-8c48-890112c53913 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:37:11.067057 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb0e463-9311-44eb-8c48-890112c53913 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:37:11.068423 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb0e463-9311-44eb-8c48-890112c53913 service cinder] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:37:11.079674 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1389/2774] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 12:37:11 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 12:37:19.528073 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=54 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:37:21.074986 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=6 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:37:23.119929 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd34b1a-faa8-4398-a7e2-574821957ce2 service cinder] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:37:23.122678 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-7bd34b1a-faa8-4398-a7e2-574821957ce2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:37:23.198274 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb0e463-9311-44eb-8c48-890112c53913 service cinder] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:37:23.199921 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-2cb0e463-9311-44eb-8c48-890112c53913 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:37:23.240675 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd34b1a-faa8-4398-a7e2-574821957ce2 service cinder] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:37:23.252418 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd542ee2-ce1b-4640-b51a-4de8aa57833e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8bff8ccf460a403d993c39327bbcbd29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '601361df39e34fcca71175aa94e425c4', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:37:23.253571 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd542ee2-ce1b-4640-b51a-4de8aa57833e service placement] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:37:23.253860 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd542ee2-ce1b-4640-b51a-4de8aa57833e service placement] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:37:23.254136 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd542ee2-ce1b-4640-b51a-4de8aa57833e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:37:23.260097 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-fd542ee2-ce1b-4640-b51a-4de8aa57833e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:37:23.272830 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd542ee2-ce1b-4640-b51a-4de8aa57833e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:37:23.274383 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd542ee2-ce1b-4640-b51a-4de8aa57833e service placement] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:37:23.285720 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1386/2775] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 12:37:23 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 12:37:23.296708 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb0e463-9311-44eb-8c48-890112c53913 service cinder] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:37:23.301363 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75f4d7f-5d60-4c5f-ad10-f6da25aa32f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:37:23.302243 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75f4d7f-5d60-4c5f-ad10-f6da25aa32f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:37:23.302513 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75f4d7f-5d60-4c5f-ad10-f6da25aa32f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:37:23.302786 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75f4d7f-5d60-4c5f-ad10-f6da25aa32f6 admin admin] PATH_INFO: `/v3/users/f396379ba6024afaaac167a179919cd8` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:37:23.304177 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75f4d7f-5d60-4c5f-ad10-f6da25aa32f6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f396379ba6024afaaac167a179919cd8)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:37:23.306718 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75f4d7f-5d60-4c5f-ad10-f6da25aa32f6 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:37:23.352506 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-e75f4d7f-5d60-4c5f-ad10-f6da25aa32f6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f396379ba6024afaaac167a179919cd8'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:37:23.353214 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-e75f4d7f-5d60-4c5f-ad10-f6da25aa32f6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f396379ba6024afaaac167a179919cd8'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:37:23.359937 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-e75f4d7f-5d60-4c5f-ad10-f6da25aa32f6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f396379ba6024afaaac167a179919cd8'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:37:23.360563 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-e75f4d7f-5d60-4c5f-ad10-f6da25aa32f6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f396379ba6024afaaac167a179919cd8'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:37:23.367765 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-e75f4d7f-5d60-4c5f-ad10-f6da25aa32f6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f396379ba6024afaaac167a179919cd8'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:37:23.385803 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1390/2776] 10.222.0.44 () {58 vars in 1223 bytes} [Thu Jun 16 12:37:23 2022] DELETE /identity/v3/users/f396379ba6024afaaac167a179919cd8 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 12:37:23.557285 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd542ee2-ce1b-4640-b51a-4de8aa57833e service placement] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:37:23.568178 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd542ee2-ce1b-4640-b51a-4de8aa57833e service placement] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:37:23.626294 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90064b64-cb30-46b8-b3ac-12b4edc1eda0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:37:23.627148 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90064b64-cb30-46b8-b3ac-12b4edc1eda0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:37:23.627438 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90064b64-cb30-46b8-b3ac-12b4edc1eda0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:37:23.627716 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90064b64-cb30-46b8-b3ac-12b4edc1eda0 admin admin] PATH_INFO: `/v3/projects/8b313233497f4be19b08fe6c33aa646a` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:37:23.628940 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90064b64-cb30-46b8-b3ac-12b4edc1eda0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8b313233497f4be19b08fe6c33aa646a)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:37:23.630833 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90064b64-cb30-46b8-b3ac-12b4edc1eda0 admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:37:23.676190 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-90064b64-cb30-46b8-b3ac-12b4edc1eda0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8b313233497f4be19b08fe6c33aa646a', 'request_id': 'req-90064b64-cb30-46b8-b3ac-12b4edc1eda0'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:37:23.683628 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-90064b64-cb30-46b8-b3ac-12b4edc1eda0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8b313233497f4be19b08fe6c33aa646a', 'request_id': 'req-90064b64-cb30-46b8-b3ac-12b4edc1eda0'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:37:23.689194 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-90064b64-cb30-46b8-b3ac-12b4edc1eda0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8b313233497f4be19b08fe6c33aa646a', 'request_id': 'req-90064b64-cb30-46b8-b3ac-12b4edc1eda0'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:37:23.699926 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-90064b64-cb30-46b8-b3ac-12b4edc1eda0 admin admin] The token cache is being invalidate because project 8b313233497f4be19b08fe6c33aa646a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 12:37:23.700216 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-90064b64-cb30-46b8-b3ac-12b4edc1eda0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:37:23.700902 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-90064b64-cb30-46b8-b3ac-12b4edc1eda0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:37:23.702426 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1387/2777] 10.222.0.44 () {58 vars in 1232 bytes} [Thu Jun 16 12:37:23 2022] DELETE /identity/v3/projects/8b313233497f4be19b08fe6c33aa646a => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:37:23.707329 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df0c2ab-d79c-47e9-8548-83e25c64d438 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:37:23.707615 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df0c2ab-d79c-47e9-8548-83e25c64d438 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:37:23.707909 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df0c2ab-d79c-47e9-8548-83e25c64d438 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:37:23.725363 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-7df0c2ab-d79c-47e9-8548-83e25c64d438 None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:37:23.726877 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-7df0c2ab-d79c-47e9-8548-83e25c64d438 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:37:23.785970 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1391/2778] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 12:37:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:37:23.793968 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ab1399-d456-4cb5-be73-7b99c3eec452 None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:37:23.794425 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ab1399-d456-4cb5-be73-7b99c3eec452 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:37:23.794706 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ab1399-d456-4cb5-be73-7b99c3eec452 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:37:23.813261 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-45ab1399-d456-4cb5-be73-7b99c3eec452 None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:37:23.814467 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-45ab1399-d456-4cb5-be73-7b99c3eec452 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:37:23.822781 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1388/2779] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 12:37:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:37:23.826895 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df0c2ab-d79c-47e9-8548-83e25c64d438 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:37:23.836603 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df0c2ab-d79c-47e9-8548-83e25c64d438 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:37:23.841699 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ae7cb8-7b0f-494a-8013-735129d8c81e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:37:23.842351 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ae7cb8-7b0f-494a-8013-735129d8c81e admin admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:37:23.842639 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ae7cb8-7b0f-494a-8013-735129d8c81e admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:37:23.842916 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ae7cb8-7b0f-494a-8013-735129d8c81e admin admin] PATH_INFO: `/v3/domains` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:37:23.843639 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ae7cb8-7b0f-494a-8013-735129d8c81e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:37:23.843951 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ae7cb8-7b0f-494a-8013-735129d8c81e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:37:23.845582 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ae7cb8-7b0f-494a-8013-735129d8c81e admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:37:23.857567 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1392/2780] 10.222.0.44 () {58 vars in 1152 bytes} [Thu Jun 16 12:37:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:37:23.861654 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ab1399-d456-4cb5-be73-7b99c3eec452 None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:37:23.870802 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ab1399-d456-4cb5-be73-7b99c3eec452 None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:37:23.875465 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3787937b-72d4-420e-aebe-7692c93b13b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:37:23.876106 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3787937b-72d4-420e-aebe-7692c93b13b2 admin admin] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:37:23.876388 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3787937b-72d4-420e-aebe-7692c93b13b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:37:23.876659 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3787937b-72d4-420e-aebe-7692c93b13b2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:37:23.877381 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3787937b-72d4-420e-aebe-7692c93b13b2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:37:23.879255 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3787937b-72d4-420e-aebe-7692c93b13b2 admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:37:23.888888 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:37:23.906447 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1389/2781] 10.222.0.44 () {60 vars in 1152 bytes} [Thu Jun 16 12:37:23 2022] POST /identity/v3/projects => generated 377 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 12:37:23.910254 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ae7cb8-7b0f-494a-8013-735129d8c81e admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:37:23.921160 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ae7cb8-7b0f-494a-8013-735129d8c81e admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:37:23.924828 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:37:23.979648 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50f3340-1af6-404d-a205-e9af8c642cb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:37:23.980333 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50f3340-1af6-404d-a205-e9af8c642cb9 admin admin] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:37:23.980620 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50f3340-1af6-404d-a205-e9af8c642cb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:37:23.980936 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50f3340-1af6-404d-a205-e9af8c642cb9 admin admin] PATH_INFO: `/v3/users` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:37:23.981632 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50f3340-1af6-404d-a205-e9af8c642cb9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:37:23.983587 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50f3340-1af6-404d-a205-e9af8c642cb9 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:37:24.003047 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1393/2782] 10.222.0.44 () {60 vars in 1143 bytes} [Thu Jun 16 12:37:23 2022] POST /identity/v3/users => generated 289 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 12:37:24.007142 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3787937b-72d4-420e-aebe-7692c93b13b2 admin admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:37:24.018240 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3787937b-72d4-420e-aebe-7692c93b13b2 admin admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:37:24.022926 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dde6c7-b661-4ec3-8a9f-40fc52d6a90d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:37:24.023583 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dde6c7-b661-4ec3-8a9f-40fc52d6a90d admin admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:37:24.023868 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dde6c7-b661-4ec3-8a9f-40fc52d6a90d admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:37:24.024150 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dde6c7-b661-4ec3-8a9f-40fc52d6a90d admin admin] PATH_INFO: `/v3/roles` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:37:24.024922 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13dde6c7-b661-4ec3-8a9f-40fc52d6a90d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:37:24.026516 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13dde6c7-b661-4ec3-8a9f-40fc52d6a90d admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:37:24.036386 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1390/2783] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 12:37:24 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 12:37:24.040072 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50f3340-1af6-404d-a205-e9af8c642cb9 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:37:24.050052 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50f3340-1af6-404d-a205-e9af8c642cb9 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:37:24.054679 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80df92df-f670-44db-90ec-d2f37eebf1e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:37:24.055333 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80df92df-f670-44db-90ec-d2f37eebf1e6 admin admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:37:24.055616 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80df92df-f670-44db-90ec-d2f37eebf1e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:37:24.055892 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80df92df-f670-44db-90ec-d2f37eebf1e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:37:24.057142 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80df92df-f670-44db-90ec-d2f37eebf1e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:37:24.058730 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80df92df-f670-44db-90ec-d2f37eebf1e6 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:37:24.068529 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1394/2784] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 12:37:24 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 12:37:24.073072 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dde6c7-b661-4ec3-8a9f-40fc52d6a90d admin admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:37:24.082724 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dde6c7-b661-4ec3-8a9f-40fc52d6a90d admin admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:37:24.087385 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2fb2fd-7689-4e9e-a32a-55f2320bfc61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:37:24.088251 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2fb2fd-7689-4e9e-a32a-55f2320bfc61 admin admin] REQUEST_METHOD: `PUT` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:37:24.088540 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2fb2fd-7689-4e9e-a32a-55f2320bfc61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:37:24.088849 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2fb2fd-7689-4e9e-a32a-55f2320bfc61 admin admin] PATH_INFO: `/v3/projects/068702fe1cfa42849126fcfddff7066b/users/8f87f947277744348b20f68e6d496624/roles/c39882b202e942479a7cdac2fc6da72c` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:37:24.103110 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2fb2fd-7689-4e9e-a32a-55f2320bfc61 admin admin] RBAC: Authorizing `identity:create_grant(project_id=068702fe1cfa42849126fcfddff7066b, user_id=8f87f947277744348b20f68e6d496624, role_id=c39882b202e942479a7cdac2fc6da72c)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:37:24.105778 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2fb2fd-7689-4e9e-a32a-55f2320bfc61 admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:37:24.119479 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1391/2785] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 16 12:37:24 2022] PUT /identity/v3/projects/068702fe1cfa42849126fcfddff7066b/users/8f87f947277744348b20f68e6d496624/roles/c39882b202e942479a7cdac2fc6da72c => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:37:24.129446 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d83626-bb38-4588-a0f6-4ea513e086fc None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:37:24.129739 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d83626-bb38-4588-a0f6-4ea513e086fc None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:37:24.130017 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d83626-bb38-4588-a0f6-4ea513e086fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:37:24.156991 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-77d83626-bb38-4588-a0f6-4ea513e086fc None None] MFA Rules not processed for user `8f87f947277744348b20f68e6d496624`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:37:24.158240 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-77d83626-bb38-4588-a0f6-4ea513e086fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:37:24.221078 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1395/2786] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 12:37:24 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:37:24.225618 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2fb2fd-7689-4e9e-a32a-55f2320bfc61 admin admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:37:24.286897 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2fb2fd-7689-4e9e-a32a-55f2320bfc61 admin admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:37:24.291925 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f7cfe7-625f-4a4f-8910-8499f1f5a465 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:37:24.292571 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f7cfe7-625f-4a4f-8910-8499f1f5a465 admin admin] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:37:24.292887 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f7cfe7-625f-4a4f-8910-8499f1f5a465 admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:37:24.293164 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f7cfe7-625f-4a4f-8910-8499f1f5a465 admin admin] PATH_INFO: `/v3/projects` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:37:24.293844 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f7cfe7-625f-4a4f-8910-8499f1f5a465 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:37:24.295770 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f7cfe7-625f-4a4f-8910-8499f1f5a465 admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:37:24.320296 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1392/2787] 10.222.0.44 () {60 vars in 1152 bytes} [Thu Jun 16 12:37:24 2022] POST /identity/v3/projects => generated 375 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 12:37:24.324346 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d83626-bb38-4588-a0f6-4ea513e086fc None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:37:24.334916 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d83626-bb38-4588-a0f6-4ea513e086fc None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:37:24.390049 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee82db1e-2915-49c5-b949-0e7987765093 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:37:24.390709 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee82db1e-2915-49c5-b949-0e7987765093 admin admin] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:37:24.390993 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee82db1e-2915-49c5-b949-0e7987765093 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:37:24.391269 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee82db1e-2915-49c5-b949-0e7987765093 admin admin] PATH_INFO: `/v3/users` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:37:24.391955 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee82db1e-2915-49c5-b949-0e7987765093 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:37:24.393918 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee82db1e-2915-49c5-b949-0e7987765093 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:37:24.413117 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1396/2788] 10.222.0.44 () {60 vars in 1143 bytes} [Thu Jun 16 12:37:24 2022] POST /identity/v3/users => generated 294 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 12:37:24.417632 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f7cfe7-625f-4a4f-8910-8499f1f5a465 admin admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:37:24.427922 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f7cfe7-625f-4a4f-8910-8499f1f5a465 admin admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:37:24.433108 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bb638d-4c3f-458c-ba73-00daa42194a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:37:24.433761 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bb638d-4c3f-458c-ba73-00daa42194a9 admin admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:37:24.434045 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bb638d-4c3f-458c-ba73-00daa42194a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:37:24.434321 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bb638d-4c3f-458c-ba73-00daa42194a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:37:24.435078 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bb638d-4c3f-458c-ba73-00daa42194a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:37:24.436659 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bb638d-4c3f-458c-ba73-00daa42194a9 admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:37:24.447038 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1393/2789] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 12:37:24 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 12:37:24.451172 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee82db1e-2915-49c5-b949-0e7987765093 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:37:24.457543 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:37:24.461533 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee82db1e-2915-49c5-b949-0e7987765093 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:37:24.467106 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c82a06-9963-47c1-8abd-2367a9860beb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:37:24.468070 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c82a06-9963-47c1-8abd-2367a9860beb admin admin] REQUEST_METHOD: `PUT` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:37:24.468345 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c82a06-9963-47c1-8abd-2367a9860beb admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:37:24.468611 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c82a06-9963-47c1-8abd-2367a9860beb admin admin] PATH_INFO: `/v3/projects/80431b8754034a0a8e7a69d92b2a9767/users/7c1fc8b694d4498086bb80f634577f1a/roles/0688968254744e3f9913653cafea3091` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:37:24.483507 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c82a06-9963-47c1-8abd-2367a9860beb admin admin] RBAC: Authorizing `identity:create_grant(project_id=80431b8754034a0a8e7a69d92b2a9767, user_id=7c1fc8b694d4498086bb80f634577f1a, role_id=0688968254744e3f9913653cafea3091)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:37:24.486197 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c82a06-9963-47c1-8abd-2367a9860beb admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:37:24.499066 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1397/2790] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 16 12:37:24 2022] PUT /identity/v3/projects/80431b8754034a0a8e7a69d92b2a9767/users/7c1fc8b694d4498086bb80f634577f1a/roles/0688968254744e3f9913653cafea3091 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 12:37:24.503157 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bb638d-4c3f-458c-ba73-00daa42194a9 admin admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:37:24.512876 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bb638d-4c3f-458c-ba73-00daa42194a9 admin admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:37:24.572833 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5149d03e-ef24-4b68-88c3-aff027ad3d56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:37:24.573425 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5149d03e-ef24-4b68-88c3-aff027ad3d56 admin admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:37:24.573706 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5149d03e-ef24-4b68-88c3-aff027ad3d56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:37:24.573980 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5149d03e-ef24-4b68-88c3-aff027ad3d56 admin admin] PATH_INFO: `/v3/roles` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:37:24.574703 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5149d03e-ef24-4b68-88c3-aff027ad3d56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:37:24.576288 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5149d03e-ef24-4b68-88c3-aff027ad3d56 admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:37:24.585758 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1394/2791] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 12:37:24 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 12:37:24.590668 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c82a06-9963-47c1-8abd-2367a9860beb admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:37:24.601010 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c82a06-9963-47c1-8abd-2367a9860beb admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:37:24.606210 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badd04fb-900c-424e-a7f2-3c7aa0d5945a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:37:24.607084 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badd04fb-900c-424e-a7f2-3c7aa0d5945a admin admin] REQUEST_METHOD: `PUT` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:37:24.607367 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badd04fb-900c-424e-a7f2-3c7aa0d5945a admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:37:24.607645 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badd04fb-900c-424e-a7f2-3c7aa0d5945a admin admin] PATH_INFO: `/v3/projects/80431b8754034a0a8e7a69d92b2a9767/users/7c1fc8b694d4498086bb80f634577f1a/roles/0688968254744e3f9913653cafea3091` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:37:24.609648 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-badd04fb-900c-424e-a7f2-3c7aa0d5945a admin admin] RBAC: Authorizing `identity:create_grant(project_id=80431b8754034a0a8e7a69d92b2a9767, user_id=7c1fc8b694d4498086bb80f634577f1a, role_id=0688968254744e3f9913653cafea3091)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:37:24.612288 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-badd04fb-900c-424e-a7f2-3c7aa0d5945a admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:37:24.622467 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1398/2792] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 16 12:37:24 2022] PUT /identity/v3/projects/80431b8754034a0a8e7a69d92b2a9767/users/7c1fc8b694d4498086bb80f634577f1a/roles/0688968254744e3f9913653cafea3091 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:37:24.633567 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a41f170-4504-4be2-9c01-1d5e3ce1978a None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:37:24.633857 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a41f170-4504-4be2-9c01-1d5e3ce1978a None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:37:24.634130 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a41f170-4504-4be2-9c01-1d5e3ce1978a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:37:24.660634 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-5a41f170-4504-4be2-9c01-1d5e3ce1978a None None] MFA Rules not processed for user `7c1fc8b694d4498086bb80f634577f1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:37:24.661979 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-5a41f170-4504-4be2-9c01-1d5e3ce1978a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:37:24.674890 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:37:24.729851 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1395/2793] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 12:37:24 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:37:24.740903 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badd04fb-900c-424e-a7f2-3c7aa0d5945a admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:37:24.742653 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-badd04fb-900c-424e-a7f2-3c7aa0d5945a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:37:24.800025 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badd04fb-900c-424e-a7f2-3c7aa0d5945a admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:37:24.803648 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10124e7a-6aa0-4915-88a0-f5f0c439a1d4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f96fc14ed89478c8a8c2f11c87511e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '601361df39e34fcca71175aa94e425c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:37:24.804288 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10124e7a-6aa0-4915-88a0-f5f0c439a1d4 service cinder] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:37:24.804573 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10124e7a-6aa0-4915-88a0-f5f0c439a1d4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:37:24.804887 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10124e7a-6aa0-4915-88a0-f5f0c439a1d4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:37:24.859619 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10124e7a-6aa0-4915-88a0-f5f0c439a1d4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:37:24.861029 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10124e7a-6aa0-4915-88a0-f5f0c439a1d4 service cinder] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:37:24.869922 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1399/2794] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 12:37:24 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 12:37:26.200791 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a41f170-4504-4be2-9c01-1d5e3ce1978a None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:37:26.202187 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-5a41f170-4504-4be2-9c01-1d5e3ce1978a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:37:26.214392 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a41f170-4504-4be2-9c01-1d5e3ce1978a None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:37:26.217974 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff38746b-9dd8-4db2-b237-df110dc3f9dd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f96fc14ed89478c8a8c2f11c87511e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '601361df39e34fcca71175aa94e425c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:37:26.218606 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff38746b-9dd8-4db2-b237-df110dc3f9dd service cinder] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:37:26.218888 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff38746b-9dd8-4db2-b237-df110dc3f9dd service cinder] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:37:26.219160 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff38746b-9dd8-4db2-b237-df110dc3f9dd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:37:26.228555 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff38746b-9dd8-4db2-b237-df110dc3f9dd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:37:26.230007 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff38746b-9dd8-4db2-b237-df110dc3f9dd service cinder] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:37:26.239445 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1396/2795] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 12:37:26 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 12:37:29.942784 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10124e7a-6aa0-4915-88a0-f5f0c439a1d4 service cinder] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:37:30.004535 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10124e7a-6aa0-4915-88a0-f5f0c439a1d4 service cinder] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:37:30.009009 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a895964e-4ebc-4544-90f6-cde7313efce1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:37:30.009860 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a895964e-4ebc-4544-90f6-cde7313efce1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:37:30.010134 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a895964e-4ebc-4544-90f6-cde7313efce1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:37:30.010401 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a895964e-4ebc-4544-90f6-cde7313efce1 admin admin] PATH_INFO: `/v3/users/8f87f947277744348b20f68e6d496624` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:37:30.011572 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a895964e-4ebc-4544-90f6-cde7313efce1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8f87f947277744348b20f68e6d496624)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:37:30.013521 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a895964e-4ebc-4544-90f6-cde7313efce1 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:37:30.035424 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=94,keystone:INSERT=2,keystone:DELETE=4 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:37:30.060062 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-a895964e-4ebc-4544-90f6-cde7313efce1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8f87f947277744348b20f68e6d496624'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:37:30.060704 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-a895964e-4ebc-4544-90f6-cde7313efce1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8f87f947277744348b20f68e6d496624'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:37:30.067384 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-a895964e-4ebc-4544-90f6-cde7313efce1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8f87f947277744348b20f68e6d496624'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:37:30.068009 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-a895964e-4ebc-4544-90f6-cde7313efce1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8f87f947277744348b20f68e6d496624'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:37:30.074991 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-a895964e-4ebc-4544-90f6-cde7313efce1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8f87f947277744348b20f68e6d496624'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:37:30.092295 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1400/2796] 10.222.0.44 () {58 vars in 1223 bytes} [Thu Jun 16 12:37:29 2022] DELETE /identity/v3/users/8f87f947277744348b20f68e6d496624 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:37:30.096743 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3f0489-fac0-4043-b993-32bbb83ffdc4 None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:37:30.097240 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3f0489-fac0-4043-b993-32bbb83ffdc4 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:37:30.097342 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3f0489-fac0-4043-b993-32bbb83ffdc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:37:30.116910 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-6c3f0489-fac0-4043-b993-32bbb83ffdc4 None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:37:30.118316 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-6c3f0489-fac0-4043-b993-32bbb83ffdc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:37:30.177687 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1397/2797] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 12:37:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:37:30.187197 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a895964e-4ebc-4544-90f6-cde7313efce1 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:37:30.188704 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-a895964e-4ebc-4544-90f6-cde7313efce1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:37:30.244958 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a895964e-4ebc-4544-90f6-cde7313efce1 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:37:30.248507 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28d3dc4-6aec-4709-9639-dd3cb6a5ecbf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1094729b25a4be7b0b394998c9ca681', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '601361df39e34fcca71175aa94e425c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:37:30.249170 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28d3dc4-6aec-4709-9639-dd3cb6a5ecbf service neutron] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:37:30.249448 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28d3dc4-6aec-4709-9639-dd3cb6a5ecbf service neutron] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:37:30.249717 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28d3dc4-6aec-4709-9639-dd3cb6a5ecbf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:37:30.258376 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28d3dc4-6aec-4709-9639-dd3cb6a5ecbf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:37:30.260453 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28d3dc4-6aec-4709-9639-dd3cb6a5ecbf service neutron] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:37:30.270006 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1401/2798] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 12:37:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 12:37:30.553451 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3f0489-fac0-4043-b993-32bbb83ffdc4 None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:37:30.555013 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-6c3f0489-fac0-4043-b993-32bbb83ffdc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:37:30.567681 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3f0489-fac0-4043-b993-32bbb83ffdc4 None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:37:30.572822 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec91a40b-f834-4a29-a617-f74b156f5cc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:37:30.573703 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec91a40b-f834-4a29-a617-f74b156f5cc9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:37:30.573965 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec91a40b-f834-4a29-a617-f74b156f5cc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:37:30.574259 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec91a40b-f834-4a29-a617-f74b156f5cc9 admin admin] PATH_INFO: `/v3/projects/068702fe1cfa42849126fcfddff7066b` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:37:30.575451 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec91a40b-f834-4a29-a617-f74b156f5cc9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=068702fe1cfa42849126fcfddff7066b)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:37:30.577506 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec91a40b-f834-4a29-a617-f74b156f5cc9 admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:37:30.627688 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-ec91a40b-f834-4a29-a617-f74b156f5cc9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '068702fe1cfa42849126fcfddff7066b', 'request_id': 'req-ec91a40b-f834-4a29-a617-f74b156f5cc9'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:37:30.635101 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-ec91a40b-f834-4a29-a617-f74b156f5cc9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '068702fe1cfa42849126fcfddff7066b', 'request_id': 'req-ec91a40b-f834-4a29-a617-f74b156f5cc9'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:37:30.640940 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-ec91a40b-f834-4a29-a617-f74b156f5cc9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '068702fe1cfa42849126fcfddff7066b', 'request_id': 'req-ec91a40b-f834-4a29-a617-f74b156f5cc9'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:37:30.651842 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-ec91a40b-f834-4a29-a617-f74b156f5cc9 admin admin] The token cache is being invalidate because project 068702fe1cfa42849126fcfddff7066b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 12:37:30.652127 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-ec91a40b-f834-4a29-a617-f74b156f5cc9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:37:30.652767 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-ec91a40b-f834-4a29-a617-f74b156f5cc9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:37:30.654339 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1398/2799] 10.222.0.44 () {58 vars in 1232 bytes} [Thu Jun 16 12:37:30 2022] DELETE /identity/v3/projects/068702fe1cfa42849126fcfddff7066b => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:37:30.658330 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28d3dc4-6aec-4709-9639-dd3cb6a5ecbf service neutron] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:37:30.667787 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28d3dc4-6aec-4709-9639-dd3cb6a5ecbf service neutron] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:37:30.723193 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422ace4d-8681-4c7f-af65-bcb3768a2a76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:37:30.724050 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422ace4d-8681-4c7f-af65-bcb3768a2a76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:37:30.724326 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422ace4d-8681-4c7f-af65-bcb3768a2a76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:37:30.724597 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422ace4d-8681-4c7f-af65-bcb3768a2a76 admin admin] PATH_INFO: `/v3/users/7c1fc8b694d4498086bb80f634577f1a` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:37:30.725798 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422ace4d-8681-4c7f-af65-bcb3768a2a76 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7c1fc8b694d4498086bb80f634577f1a)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:37:30.727724 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422ace4d-8681-4c7f-af65-bcb3768a2a76 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:37:30.771365 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:37:30.772878 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-422ace4d-8681-4c7f-af65-bcb3768a2a76 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c1fc8b694d4498086bb80f634577f1a'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:37:30.773741 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-422ace4d-8681-4c7f-af65-bcb3768a2a76 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c1fc8b694d4498086bb80f634577f1a'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:37:30.782411 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-422ace4d-8681-4c7f-af65-bcb3768a2a76 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c1fc8b694d4498086bb80f634577f1a'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:37:30.783039 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-422ace4d-8681-4c7f-af65-bcb3768a2a76 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c1fc8b694d4498086bb80f634577f1a'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:37:30.790244 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-422ace4d-8681-4c7f-af65-bcb3768a2a76 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c1fc8b694d4498086bb80f634577f1a'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:37:30.807511 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1402/2800] 10.222.0.44 () {58 vars in 1223 bytes} [Thu Jun 16 12:37:30 2022] DELETE /identity/v3/users/7c1fc8b694d4498086bb80f634577f1a => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:37:31.075696 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec91a40b-f834-4a29-a617-f74b156f5cc9 admin admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:37:31.077248 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-ec91a40b-f834-4a29-a617-f74b156f5cc9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:37:31.090263 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec91a40b-f834-4a29-a617-f74b156f5cc9 admin admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:37:31.109230 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:37:31.153076 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd093720-cb02-420c-9a07-1c18f092a8bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:37:31.153941 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd093720-cb02-420c-9a07-1c18f092a8bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:37:31.154223 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd093720-cb02-420c-9a07-1c18f092a8bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:37:31.154521 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd093720-cb02-420c-9a07-1c18f092a8bf admin admin] PATH_INFO: `/v3/projects/80431b8754034a0a8e7a69d92b2a9767` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:37:31.155714 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd093720-cb02-420c-9a07-1c18f092a8bf admin admin] RBAC: Authorizing `identity:delete_project(project_id=80431b8754034a0a8e7a69d92b2a9767)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:37:31.157690 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd093720-cb02-420c-9a07-1c18f092a8bf admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:37:31.202831 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-bd093720-cb02-420c-9a07-1c18f092a8bf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '80431b8754034a0a8e7a69d92b2a9767', 'request_id': 'req-bd093720-cb02-420c-9a07-1c18f092a8bf'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:37:31.210180 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-bd093720-cb02-420c-9a07-1c18f092a8bf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '80431b8754034a0a8e7a69d92b2a9767', 'request_id': 'req-bd093720-cb02-420c-9a07-1c18f092a8bf'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:37:31.215650 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-bd093720-cb02-420c-9a07-1c18f092a8bf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '80431b8754034a0a8e7a69d92b2a9767', 'request_id': 'req-bd093720-cb02-420c-9a07-1c18f092a8bf'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:37:31.226702 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-bd093720-cb02-420c-9a07-1c18f092a8bf admin admin] The token cache is being invalidate because project 80431b8754034a0a8e7a69d92b2a9767 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 12:37:31.226990 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-bd093720-cb02-420c-9a07-1c18f092a8bf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:37:31.228128 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-bd093720-cb02-420c-9a07-1c18f092a8bf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:37:31.229684 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1399/2801] 10.222.0.44 () {58 vars in 1232 bytes} [Thu Jun 16 12:37:31 2022] DELETE /identity/v3/projects/80431b8754034a0a8e7a69d92b2a9767 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:37:31.234527 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269a76be-a51e-4234-91da-fa3bea7a1a97 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:37:31.234980 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269a76be-a51e-4234-91da-fa3bea7a1a97 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:37:31.235097 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269a76be-a51e-4234-91da-fa3bea7a1a97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:37:31.253031 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-269a76be-a51e-4234-91da-fa3bea7a1a97 None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:37:31.254164 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-269a76be-a51e-4234-91da-fa3bea7a1a97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:37:31.311772 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1403/2802] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 12:37:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:37:31.319344 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced49924-d581-45e3-80d2-89614748411d None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:37:31.319635 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced49924-d581-45e3-80d2-89614748411d None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:37:31.319945 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced49924-d581-45e3-80d2-89614748411d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:37:31.338236 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-ced49924-d581-45e3-80d2-89614748411d None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:37:31.339436 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-ced49924-d581-45e3-80d2-89614748411d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:37:31.347299 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1400/2803] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 12:37:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:37:31.351298 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269a76be-a51e-4234-91da-fa3bea7a1a97 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:37:31.361451 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269a76be-a51e-4234-91da-fa3bea7a1a97 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:37:31.366034 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c736a4-8eef-4a42-84e0-bd2acf37f262 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:37:31.366676 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c736a4-8eef-4a42-84e0-bd2acf37f262 admin admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:37:31.366957 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c736a4-8eef-4a42-84e0-bd2acf37f262 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:37:31.367230 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c736a4-8eef-4a42-84e0-bd2acf37f262 admin admin] PATH_INFO: `/v3/domains` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:37:31.367952 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c736a4-8eef-4a42-84e0-bd2acf37f262 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:37:31.368256 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c736a4-8eef-4a42-84e0-bd2acf37f262 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:37:31.369885 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c736a4-8eef-4a42-84e0-bd2acf37f262 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:37:31.381169 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1404/2804] 10.222.0.44 () {58 vars in 1152 bytes} [Thu Jun 16 12:37:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:37:31.385232 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced49924-d581-45e3-80d2-89614748411d None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:37:31.394517 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced49924-d581-45e3-80d2-89614748411d None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:37:31.399137 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae23a85-0bcc-4016-b9b8-ff728cb2d24d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:37:31.400287 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae23a85-0bcc-4016-b9b8-ff728cb2d24d admin admin] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:37:31.400571 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae23a85-0bcc-4016-b9b8-ff728cb2d24d admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:37:31.400879 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae23a85-0bcc-4016-b9b8-ff728cb2d24d admin admin] PATH_INFO: `/v3/projects` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:37:31.401602 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae23a85-0bcc-4016-b9b8-ff728cb2d24d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:37:31.403522 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae23a85-0bcc-4016-b9b8-ff728cb2d24d admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:37:31.431724 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1401/2805] 10.222.0.44 () {60 vars in 1152 bytes} [Thu Jun 16 12:37:31 2022] POST /identity/v3/projects => generated 393 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 12:37:31.432853 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c736a4-8eef-4a42-84e0-bd2acf37f262 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:37:31.442805 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c736a4-8eef-4a42-84e0-bd2acf37f262 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:37:31.498489 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72150624-2cfa-4431-b648-9ce12384cff8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:37:31.499149 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72150624-2cfa-4431-b648-9ce12384cff8 admin admin] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:37:31.499431 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72150624-2cfa-4431-b648-9ce12384cff8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:37:31.499705 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72150624-2cfa-4431-b648-9ce12384cff8 admin admin] PATH_INFO: `/v3/users` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:37:31.500397 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72150624-2cfa-4431-b648-9ce12384cff8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:37:31.502349 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72150624-2cfa-4431-b648-9ce12384cff8 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:37:31.525476 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1405/2806] 10.222.0.44 () {60 vars in 1143 bytes} [Thu Jun 16 12:37:31 2022] POST /identity/v3/users => generated 297 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 12:37:31.526535 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae23a85-0bcc-4016-b9b8-ff728cb2d24d admin admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:37:31.536603 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae23a85-0bcc-4016-b9b8-ff728cb2d24d admin admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:37:31.541842 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151df734-f5b0-4e5b-adfc-53bf402b6463 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:37:31.542488 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151df734-f5b0-4e5b-adfc-53bf402b6463 admin admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:37:31.542765 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151df734-f5b0-4e5b-adfc-53bf402b6463 admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:37:31.543038 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151df734-f5b0-4e5b-adfc-53bf402b6463 admin admin] PATH_INFO: `/v3/roles` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:37:31.543758 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151df734-f5b0-4e5b-adfc-53bf402b6463 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:37:31.545575 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151df734-f5b0-4e5b-adfc-53bf402b6463 admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:37:31.556164 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1402/2807] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 12:37:31 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 12:37:31.559991 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72150624-2cfa-4431-b648-9ce12384cff8 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:37:31.570040 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72150624-2cfa-4431-b648-9ce12384cff8 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:37:31.574879 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a599173-dea9-42e5-8aa6-f74ecb2f6889 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:37:31.575522 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a599173-dea9-42e5-8aa6-f74ecb2f6889 admin admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:37:31.575798 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a599173-dea9-42e5-8aa6-f74ecb2f6889 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:37:31.576064 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a599173-dea9-42e5-8aa6-f74ecb2f6889 admin admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:37:31.576841 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a599173-dea9-42e5-8aa6-f74ecb2f6889 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:37:31.578473 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a599173-dea9-42e5-8aa6-f74ecb2f6889 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:37:31.588847 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1406/2808] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 12:37:31 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 12:37:31.592655 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151df734-f5b0-4e5b-adfc-53bf402b6463 admin admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:37:31.602400 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151df734-f5b0-4e5b-adfc-53bf402b6463 admin admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:37:31.607575 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7bece2-8e42-40bd-99e6-0647a154b2a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:37:31.608432 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7bece2-8e42-40bd-99e6-0647a154b2a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:37:31.608712 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7bece2-8e42-40bd-99e6-0647a154b2a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:37:31.609015 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7bece2-8e42-40bd-99e6-0647a154b2a9 admin admin] PATH_INFO: `/v3/projects/301f8f6e039448aaaa3f9e45147c69e6/users/b633eb7645fe425e81a3d8430310de14/roles/c39882b202e942479a7cdac2fc6da72c` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:37:31.623065 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7bece2-8e42-40bd-99e6-0647a154b2a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=301f8f6e039448aaaa3f9e45147c69e6, user_id=b633eb7645fe425e81a3d8430310de14, role_id=c39882b202e942479a7cdac2fc6da72c)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:37:31.625729 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7bece2-8e42-40bd-99e6-0647a154b2a9 admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:37:31.639403 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1403/2809] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 16 12:37:31 2022] PUT /identity/v3/projects/301f8f6e039448aaaa3f9e45147c69e6/users/b633eb7645fe425e81a3d8430310de14/roles/c39882b202e942479a7cdac2fc6da72c => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 12:37:31.651311 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c51fd7-ccbf-485c-b63a-7785293b5677 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:37:31.651597 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c51fd7-ccbf-485c-b63a-7785293b5677 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:37:31.651869 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c51fd7-ccbf-485c-b63a-7785293b5677 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:37:31.678513 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-b2c51fd7-ccbf-485c-b63a-7785293b5677 None None] MFA Rules not processed for user `b633eb7645fe425e81a3d8430310de14`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:37:31.679720 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-b2c51fd7-ccbf-485c-b63a-7785293b5677 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:37:31.695756 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:37:31.743996 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1407/2810] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 12:37:31 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:37:31.748418 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7bece2-8e42-40bd-99e6-0647a154b2a9 admin admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:37:31.796630 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:37:31.811387 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7bece2-8e42-40bd-99e6-0647a154b2a9 admin admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:37:31.816447 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e32d354-11e0-48a1-ae27-af2abfa1330f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:37:31.817128 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e32d354-11e0-48a1-ae27-af2abfa1330f admin admin] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:37:31.817412 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e32d354-11e0-48a1-ae27-af2abfa1330f admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:37:31.817684 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e32d354-11e0-48a1-ae27-af2abfa1330f admin admin] PATH_INFO: `/v3/projects` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:37:31.818404 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e32d354-11e0-48a1-ae27-af2abfa1330f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:37:31.820554 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e32d354-11e0-48a1-ae27-af2abfa1330f admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:37:31.846292 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1404/2811] 10.222.0.44 () {60 vars in 1152 bytes} [Thu Jun 16 12:37:31 2022] POST /identity/v3/projects => generated 391 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 12:37:31.850337 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c51fd7-ccbf-485c-b63a-7785293b5677 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:37:31.860808 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c51fd7-ccbf-485c-b63a-7785293b5677 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:37:31.915638 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbbb3dd-486b-45e0-898f-68056c3c14fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:37:31.916299 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbbb3dd-486b-45e0-898f-68056c3c14fa admin admin] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:37:31.916576 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbbb3dd-486b-45e0-898f-68056c3c14fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:37:31.916882 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbbb3dd-486b-45e0-898f-68056c3c14fa admin admin] PATH_INFO: `/v3/users` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:37:31.917578 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbbb3dd-486b-45e0-898f-68056c3c14fa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:37:31.919530 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbbb3dd-486b-45e0-898f-68056c3c14fa admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:37:31.939093 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1408/2812] 10.222.0.44 () {60 vars in 1143 bytes} [Thu Jun 16 12:37:31 2022] POST /identity/v3/users => generated 302 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 12:37:31.943119 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e32d354-11e0-48a1-ae27-af2abfa1330f admin admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:37:31.954111 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e32d354-11e0-48a1-ae27-af2abfa1330f admin admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:37:31.958691 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31411b20-8951-44a1-9728-691b6ef9e232 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:37:31.959344 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31411b20-8951-44a1-9728-691b6ef9e232 admin admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:37:31.959628 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31411b20-8951-44a1-9728-691b6ef9e232 admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:37:31.959905 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31411b20-8951-44a1-9728-691b6ef9e232 admin admin] PATH_INFO: `/v3/roles` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:37:31.960628 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31411b20-8951-44a1-9728-691b6ef9e232 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:37:31.962796 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31411b20-8951-44a1-9728-691b6ef9e232 admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:37:31.974089 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1405/2813] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 12:37:31 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 12:37:31.978159 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbbb3dd-486b-45e0-898f-68056c3c14fa admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:37:31.987937 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbbb3dd-486b-45e0-898f-68056c3c14fa admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:37:31.992491 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e1eb79-67aa-4537-bb8f-e09e8fb4bb19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:37:31.993385 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e1eb79-67aa-4537-bb8f-e09e8fb4bb19 admin admin] REQUEST_METHOD: `PUT` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:37:31.993661 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e1eb79-67aa-4537-bb8f-e09e8fb4bb19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:37:31.993955 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e1eb79-67aa-4537-bb8f-e09e8fb4bb19 admin admin] PATH_INFO: `/v3/projects/871510ca4efe47ea886f57a0cb2a10c5/users/6b02c7349c15488d8efb150f39498669/roles/0688968254744e3f9913653cafea3091` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:37:32.008227 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e1eb79-67aa-4537-bb8f-e09e8fb4bb19 admin admin] RBAC: Authorizing `identity:create_grant(project_id=871510ca4efe47ea886f57a0cb2a10c5, user_id=6b02c7349c15488d8efb150f39498669, role_id=0688968254744e3f9913653cafea3091)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:37:32.011481 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e1eb79-67aa-4537-bb8f-e09e8fb4bb19 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:37:32.025257 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1409/2814] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 16 12:37:31 2022] PUT /identity/v3/projects/871510ca4efe47ea886f57a0cb2a10c5/users/6b02c7349c15488d8efb150f39498669/roles/0688968254744e3f9913653cafea3091 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:37:32.029094 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31411b20-8951-44a1-9728-691b6ef9e232 admin admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:37:32.039233 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31411b20-8951-44a1-9728-691b6ef9e232 admin admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:37:32.094747 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6292ff-14f7-4d35-9d28-a33ee57f1a7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:37:32.095333 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6292ff-14f7-4d35-9d28-a33ee57f1a7f admin admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:37:32.095616 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6292ff-14f7-4d35-9d28-a33ee57f1a7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:37:32.095893 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6292ff-14f7-4d35-9d28-a33ee57f1a7f admin admin] PATH_INFO: `/v3/roles` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:37:32.096610 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6292ff-14f7-4d35-9d28-a33ee57f1a7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:37:32.098239 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6292ff-14f7-4d35-9d28-a33ee57f1a7f admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:37:32.107820 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1406/2815] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 12:37:32 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 12:37:32.111990 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e1eb79-67aa-4537-bb8f-e09e8fb4bb19 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:37:32.122712 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e1eb79-67aa-4537-bb8f-e09e8fb4bb19 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:37:32.127371 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbef8b03-df0d-4d35-ba34-608c47632df7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:37:32.128246 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbef8b03-df0d-4d35-ba34-608c47632df7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:37:32.128528 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbef8b03-df0d-4d35-ba34-608c47632df7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:37:32.128841 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbef8b03-df0d-4d35-ba34-608c47632df7 admin admin] PATH_INFO: `/v3/projects/871510ca4efe47ea886f57a0cb2a10c5/users/6b02c7349c15488d8efb150f39498669/roles/0688968254744e3f9913653cafea3091` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:37:32.130795 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbef8b03-df0d-4d35-ba34-608c47632df7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=871510ca4efe47ea886f57a0cb2a10c5, user_id=6b02c7349c15488d8efb150f39498669, role_id=0688968254744e3f9913653cafea3091)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:37:32.133462 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbef8b03-df0d-4d35-ba34-608c47632df7 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:37:32.144403 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1410/2816] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 16 12:37:32 2022] PUT /identity/v3/projects/871510ca4efe47ea886f57a0cb2a10c5/users/6b02c7349c15488d8efb150f39498669/roles/0688968254744e3f9913653cafea3091 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:37:32.154095 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f1dcfb-4d75-4bc4-841f-fe860743cb9a None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:37:32.154580 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f1dcfb-4d75-4bc4-841f-fe860743cb9a None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:37:32.154692 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f1dcfb-4d75-4bc4-841f-fe860743cb9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:37:32.181289 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-31f1dcfb-4d75-4bc4-841f-fe860743cb9a None None] MFA Rules not processed for user `6b02c7349c15488d8efb150f39498669`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:37:32.182486 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-31f1dcfb-4d75-4bc4-841f-fe860743cb9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:37:32.248075 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1407/2817] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 12:37:32 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:37:32.259245 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbef8b03-df0d-4d35-ba34-608c47632df7 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:37:32.261003 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-bbef8b03-df0d-4d35-ba34-608c47632df7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:37:32.316487 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbef8b03-df0d-4d35-ba34-608c47632df7 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:37:32.320144 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827cd8e1-7af0-495e-8b6a-9bbe9d01c7b5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f96fc14ed89478c8a8c2f11c87511e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '601361df39e34fcca71175aa94e425c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:37:32.320790 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827cd8e1-7af0-495e-8b6a-9bbe9d01c7b5 service cinder] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:37:32.321670 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827cd8e1-7af0-495e-8b6a-9bbe9d01c7b5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:37:32.321959 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827cd8e1-7af0-495e-8b6a-9bbe9d01c7b5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:37:32.330753 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827cd8e1-7af0-495e-8b6a-9bbe9d01c7b5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:37:32.332180 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827cd8e1-7af0-495e-8b6a-9bbe9d01c7b5 service cinder] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:37:32.341470 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1411/2818] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 12:37:32 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 12:37:32.385642 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f1dcfb-4d75-4bc4-841f-fe860743cb9a None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:37:32.387031 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-31f1dcfb-4d75-4bc4-841f-fe860743cb9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:37:32.399005 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f1dcfb-4d75-4bc4-841f-fe860743cb9a None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:37:32.402617 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fa925d-2e61-463d-a9cb-1a671756496f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f96fc14ed89478c8a8c2f11c87511e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '601361df39e34fcca71175aa94e425c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:37:32.403306 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fa925d-2e61-463d-a9cb-1a671756496f service cinder] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:37:32.403590 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fa925d-2e61-463d-a9cb-1a671756496f service cinder] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:37:32.403861 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fa925d-2e61-463d-a9cb-1a671756496f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:37:32.445639 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:37:32.460808 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fa925d-2e61-463d-a9cb-1a671756496f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:37:32.462740 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fa925d-2e61-463d-a9cb-1a671756496f service cinder] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:37:32.471563 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1408/2819] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 12:37:32 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 12:37:35.653931 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827cd8e1-7af0-495e-8b6a-9bbe9d01c7b5 service cinder] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:37:35.667144 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:37:35.715062 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827cd8e1-7af0-495e-8b6a-9bbe9d01c7b5 service cinder] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:37:35.719474 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bafab33-f7a8-4325-87e1-196425929530 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:37:35.720329 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bafab33-f7a8-4325-87e1-196425929530 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:37:35.720601 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bafab33-f7a8-4325-87e1-196425929530 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:37:35.720897 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bafab33-f7a8-4325-87e1-196425929530 admin admin] PATH_INFO: `/v3/users/b633eb7645fe425e81a3d8430310de14` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:37:35.722065 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bafab33-f7a8-4325-87e1-196425929530 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b633eb7645fe425e81a3d8430310de14)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:37:35.723971 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bafab33-f7a8-4325-87e1-196425929530 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:37:35.770291 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-2bafab33-f7a8-4325-87e1-196425929530 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b633eb7645fe425e81a3d8430310de14'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:37:35.770902 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-2bafab33-f7a8-4325-87e1-196425929530 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b633eb7645fe425e81a3d8430310de14'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:37:35.777644 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-2bafab33-f7a8-4325-87e1-196425929530 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b633eb7645fe425e81a3d8430310de14'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:37:35.778262 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-2bafab33-f7a8-4325-87e1-196425929530 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b633eb7645fe425e81a3d8430310de14'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:37:35.785190 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-2bafab33-f7a8-4325-87e1-196425929530 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b633eb7645fe425e81a3d8430310de14'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:37:35.802215 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1412/2820] 10.222.0.44 () {58 vars in 1223 bytes} [Thu Jun 16 12:37:35 2022] DELETE /identity/v3/users/b633eb7645fe425e81a3d8430310de14 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:37:35.807225 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05c9d33-9f17-473e-91d8-aa24ae9ebe81 None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:37:35.807699 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05c9d33-9f17-473e-91d8-aa24ae9ebe81 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:37:35.807808 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05c9d33-9f17-473e-91d8-aa24ae9ebe81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:37:35.825214 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-d05c9d33-9f17-473e-91d8-aa24ae9ebe81 None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:37:35.826425 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-d05c9d33-9f17-473e-91d8-aa24ae9ebe81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:37:35.883872 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1409/2821] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 12:37:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:37:35.893566 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bafab33-f7a8-4325-87e1-196425929530 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:37:35.894944 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-2bafab33-f7a8-4325-87e1-196425929530 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:37:35.953592 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bafab33-f7a8-4325-87e1-196425929530 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:37:35.957206 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0221abd-450b-4ca3-adfa-392eddc7d194 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1094729b25a4be7b0b394998c9ca681', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '601361df39e34fcca71175aa94e425c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:37:35.957840 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0221abd-450b-4ca3-adfa-392eddc7d194 service neutron] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:37:35.958117 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0221abd-450b-4ca3-adfa-392eddc7d194 service neutron] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:37:35.958389 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0221abd-450b-4ca3-adfa-392eddc7d194 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:37:35.967673 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0221abd-450b-4ca3-adfa-392eddc7d194 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:37:35.969138 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0221abd-450b-4ca3-adfa-392eddc7d194 service neutron] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:37:35.979095 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1413/2822] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 12:37:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 12:37:36.240061 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05c9d33-9f17-473e-91d8-aa24ae9ebe81 None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:37:36.241545 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-d05c9d33-9f17-473e-91d8-aa24ae9ebe81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:37:36.255455 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05c9d33-9f17-473e-91d8-aa24ae9ebe81 None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:37:36.260656 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02513871-b989-4124-917d-f5a67b719dc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:37:36.261565 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02513871-b989-4124-917d-f5a67b719dc4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:37:36.261853 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02513871-b989-4124-917d-f5a67b719dc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:37:36.262115 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02513871-b989-4124-917d-f5a67b719dc4 admin admin] PATH_INFO: `/v3/projects/301f8f6e039448aaaa3f9e45147c69e6` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:37:36.263443 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02513871-b989-4124-917d-f5a67b719dc4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=301f8f6e039448aaaa3f9e45147c69e6)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:37:36.265559 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02513871-b989-4124-917d-f5a67b719dc4 admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:37:36.311191 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-02513871-b989-4124-917d-f5a67b719dc4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '301f8f6e039448aaaa3f9e45147c69e6', 'request_id': 'req-02513871-b989-4124-917d-f5a67b719dc4'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:37:36.317610 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-02513871-b989-4124-917d-f5a67b719dc4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '301f8f6e039448aaaa3f9e45147c69e6', 'request_id': 'req-02513871-b989-4124-917d-f5a67b719dc4'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:37:36.323514 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-02513871-b989-4124-917d-f5a67b719dc4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '301f8f6e039448aaaa3f9e45147c69e6', 'request_id': 'req-02513871-b989-4124-917d-f5a67b719dc4'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:37:36.334089 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-02513871-b989-4124-917d-f5a67b719dc4 admin admin] The token cache is being invalidate because project 301f8f6e039448aaaa3f9e45147c69e6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 12:37:36.334376 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-02513871-b989-4124-917d-f5a67b719dc4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:37:36.334997 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-02513871-b989-4124-917d-f5a67b719dc4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:37:36.337179 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1410/2823] 10.222.0.44 () {58 vars in 1232 bytes} [Thu Jun 16 12:37:36 2022] DELETE /identity/v3/projects/301f8f6e039448aaaa3f9e45147c69e6 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:37:36.341062 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0221abd-450b-4ca3-adfa-392eddc7d194 service neutron] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:37:36.350606 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0221abd-450b-4ca3-adfa-392eddc7d194 service neutron] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:37:36.381941 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:37:36.408266 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eceec4f5-d8a7-4f1a-85d9-a517e6bbb73d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:37:36.409159 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eceec4f5-d8a7-4f1a-85d9-a517e6bbb73d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:37:36.409436 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eceec4f5-d8a7-4f1a-85d9-a517e6bbb73d admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:37:36.409702 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eceec4f5-d8a7-4f1a-85d9-a517e6bbb73d admin admin] PATH_INFO: `/v3/users/6b02c7349c15488d8efb150f39498669` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:37:36.410874 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eceec4f5-d8a7-4f1a-85d9-a517e6bbb73d admin admin] RBAC: Authorizing `identity:delete_user(user_id=6b02c7349c15488d8efb150f39498669)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:37:36.412805 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eceec4f5-d8a7-4f1a-85d9-a517e6bbb73d admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:37:36.455931 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-eceec4f5-d8a7-4f1a-85d9-a517e6bbb73d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6b02c7349c15488d8efb150f39498669'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:37:36.456564 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-eceec4f5-d8a7-4f1a-85d9-a517e6bbb73d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6b02c7349c15488d8efb150f39498669'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:37:36.463941 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-eceec4f5-d8a7-4f1a-85d9-a517e6bbb73d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6b02c7349c15488d8efb150f39498669'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:37:36.464586 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-eceec4f5-d8a7-4f1a-85d9-a517e6bbb73d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6b02c7349c15488d8efb150f39498669'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:37:36.471012 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-eceec4f5-d8a7-4f1a-85d9-a517e6bbb73d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6b02c7349c15488d8efb150f39498669'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:37:36.488992 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1414/2824] 10.222.0.44 () {58 vars in 1223 bytes} [Thu Jun 16 12:37:36 2022] DELETE /identity/v3/users/6b02c7349c15488d8efb150f39498669 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:37:36.747780 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02513871-b989-4124-917d-f5a67b719dc4 admin admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:37:36.749277 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-02513871-b989-4124-917d-f5a67b719dc4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:37:36.763879 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02513871-b989-4124-917d-f5a67b719dc4 admin admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:37:36.827330 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9126f37-2a0a-40c3-befe-49916e1aa561 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:37:36.828206 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9126f37-2a0a-40c3-befe-49916e1aa561 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:37:36.828486 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9126f37-2a0a-40c3-befe-49916e1aa561 admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:37:36.828806 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9126f37-2a0a-40c3-befe-49916e1aa561 admin admin] PATH_INFO: `/v3/projects/871510ca4efe47ea886f57a0cb2a10c5` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:37:36.830001 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9126f37-2a0a-40c3-befe-49916e1aa561 admin admin] RBAC: Authorizing `identity:delete_project(project_id=871510ca4efe47ea886f57a0cb2a10c5)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:37:36.831950 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9126f37-2a0a-40c3-befe-49916e1aa561 admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:37:36.839843 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:37:36.881509 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-a9126f37-2a0a-40c3-befe-49916e1aa561 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '871510ca4efe47ea886f57a0cb2a10c5', 'request_id': 'req-a9126f37-2a0a-40c3-befe-49916e1aa561'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:37:36.889358 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-a9126f37-2a0a-40c3-befe-49916e1aa561 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '871510ca4efe47ea886f57a0cb2a10c5', 'request_id': 'req-a9126f37-2a0a-40c3-befe-49916e1aa561'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:37:36.894981 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-a9126f37-2a0a-40c3-befe-49916e1aa561 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '871510ca4efe47ea886f57a0cb2a10c5', 'request_id': 'req-a9126f37-2a0a-40c3-befe-49916e1aa561'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:37:36.905588 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-a9126f37-2a0a-40c3-befe-49916e1aa561 admin admin] The token cache is being invalidate because project 871510ca4efe47ea886f57a0cb2a10c5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 12:37:36.905869 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-a9126f37-2a0a-40c3-befe-49916e1aa561 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:37:36.906485 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-a9126f37-2a0a-40c3-befe-49916e1aa561 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:37:36.908065 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1411/2825] 10.222.0.44 () {58 vars in 1232 bytes} [Thu Jun 16 12:37:36 2022] DELETE /identity/v3/projects/871510ca4efe47ea886f57a0cb2a10c5 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 12:37:36.913038 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33c7d9e-568a-4b71-8f51-9bbc198d17fb None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:37:36.913522 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33c7d9e-568a-4b71-8f51-9bbc198d17fb None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:37:36.913642 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33c7d9e-568a-4b71-8f51-9bbc198d17fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:37:36.931740 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-c33c7d9e-568a-4b71-8f51-9bbc198d17fb None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:37:36.932969 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-c33c7d9e-568a-4b71-8f51-9bbc198d17fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:37:36.991193 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1415/2826] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 12:37:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:37:36.999190 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa72ba6-6be7-4090-9206-e89d67a73945 None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:37:36.999474 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa72ba6-6be7-4090-9206-e89d67a73945 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:37:36.999744 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa72ba6-6be7-4090-9206-e89d67a73945 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:37:37.018338 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-ffa72ba6-6be7-4090-9206-e89d67a73945 None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:37:37.019549 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-ffa72ba6-6be7-4090-9206-e89d67a73945 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:37:37.027888 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1412/2827] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 12:37:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:37:37.032056 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33c7d9e-568a-4b71-8f51-9bbc198d17fb None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:37:37.041692 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33c7d9e-568a-4b71-8f51-9bbc198d17fb None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:37:37.046514 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd886cd-5a17-4f73-8ba4-ae5c4e404e71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:37:37.047166 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd886cd-5a17-4f73-8ba4-ae5c4e404e71 admin admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:37:37.047447 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd886cd-5a17-4f73-8ba4-ae5c4e404e71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:37:37.047721 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd886cd-5a17-4f73-8ba4-ae5c4e404e71 admin admin] PATH_INFO: `/v3/domains` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:37:37.048446 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd886cd-5a17-4f73-8ba4-ae5c4e404e71 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:37:37.048802 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd886cd-5a17-4f73-8ba4-ae5c4e404e71 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:37:37.050382 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd886cd-5a17-4f73-8ba4-ae5c4e404e71 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:37:37.061769 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1416/2828] 10.222.0.44 () {58 vars in 1152 bytes} [Thu Jun 16 12:37:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:37:37.065811 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa72ba6-6be7-4090-9206-e89d67a73945 None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:37:37.075511 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa72ba6-6be7-4090-9206-e89d67a73945 None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:37:37.080179 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d4d3f4-b275-4ee2-8302-a2e685466074 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:37:37.080859 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d4d3f4-b275-4ee2-8302-a2e685466074 admin admin] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:37:37.081148 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d4d3f4-b275-4ee2-8302-a2e685466074 admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:37:37.081425 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d4d3f4-b275-4ee2-8302-a2e685466074 admin admin] PATH_INFO: `/v3/projects` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:37:37.082174 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d4d3f4-b275-4ee2-8302-a2e685466074 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:37:37.084013 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d4d3f4-b275-4ee2-8302-a2e685466074 admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:37:37.109539 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1413/2829] 10.222.0.44 () {60 vars in 1152 bytes} [Thu Jun 16 12:37:37 2022] POST /identity/v3/projects => generated 401 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 12:37:37.113403 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd886cd-5a17-4f73-8ba4-ae5c4e404e71 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:37:37.123882 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd886cd-5a17-4f73-8ba4-ae5c4e404e71 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:37:37.163111 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:37:37.181997 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f591d30-48c3-4980-a565-a6ee91f8b462 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:37:37.182662 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f591d30-48c3-4980-a565-a6ee91f8b462 admin admin] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:37:37.182942 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f591d30-48c3-4980-a565-a6ee91f8b462 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:37:37.183216 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f591d30-48c3-4980-a565-a6ee91f8b462 admin admin] PATH_INFO: `/v3/users` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:37:37.183902 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f591d30-48c3-4980-a565-a6ee91f8b462 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:37:37.185892 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f591d30-48c3-4980-a565-a6ee91f8b462 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:37:37.204983 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1417/2830] 10.222.0.44 () {60 vars in 1143 bytes} [Thu Jun 16 12:37:37 2022] POST /identity/v3/users => generated 301 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 12:37:37.209174 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d4d3f4-b275-4ee2-8302-a2e685466074 admin admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:37:37.219308 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d4d3f4-b275-4ee2-8302-a2e685466074 admin admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:37:37.223946 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce5ba96-5bb7-4739-9794-6449fb80f685 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:37:37.224597 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce5ba96-5bb7-4739-9794-6449fb80f685 admin admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:37:37.224924 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce5ba96-5bb7-4739-9794-6449fb80f685 admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:37:37.225206 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce5ba96-5bb7-4739-9794-6449fb80f685 admin admin] PATH_INFO: `/v3/roles` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:37:37.225933 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce5ba96-5bb7-4739-9794-6449fb80f685 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:37:37.228073 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce5ba96-5bb7-4739-9794-6449fb80f685 admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:37:37.238489 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1414/2831] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 12:37:37 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 12:37:37.242114 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f591d30-48c3-4980-a565-a6ee91f8b462 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:37:37.255813 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f591d30-48c3-4980-a565-a6ee91f8b462 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:37:37.261946 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466da588-9b0a-4a5a-8210-86884e85d18e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:37:37.262599 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466da588-9b0a-4a5a-8210-86884e85d18e admin admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:37:37.262882 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466da588-9b0a-4a5a-8210-86884e85d18e admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:37:37.263157 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466da588-9b0a-4a5a-8210-86884e85d18e admin admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:37:37.264142 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466da588-9b0a-4a5a-8210-86884e85d18e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:37:37.265763 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466da588-9b0a-4a5a-8210-86884e85d18e admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:37:37.275892 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1418/2832] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 12:37:37 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 12:37:37.279778 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce5ba96-5bb7-4739-9794-6449fb80f685 admin admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:37:37.290419 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce5ba96-5bb7-4739-9794-6449fb80f685 admin admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:37:37.295125 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdce273-42e1-492d-92fe-82dd11f2344c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:37:37.296026 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdce273-42e1-492d-92fe-82dd11f2344c admin admin] REQUEST_METHOD: `PUT` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:37:37.296309 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdce273-42e1-492d-92fe-82dd11f2344c admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:37:37.296584 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdce273-42e1-492d-92fe-82dd11f2344c admin admin] PATH_INFO: `/v3/projects/32ab861c01f44736ab3d74e28d86e8ac/users/2fa673fd3c51401fbb6728a88499254a/roles/c39882b202e942479a7cdac2fc6da72c` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:37:37.312484 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdce273-42e1-492d-92fe-82dd11f2344c admin admin] RBAC: Authorizing `identity:create_grant(project_id=32ab861c01f44736ab3d74e28d86e8ac, user_id=2fa673fd3c51401fbb6728a88499254a, role_id=c39882b202e942479a7cdac2fc6da72c)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:37:37.315153 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdce273-42e1-492d-92fe-82dd11f2344c admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:37:37.327613 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1415/2833] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 16 12:37:37 2022] PUT /identity/v3/projects/32ab861c01f44736ab3d74e28d86e8ac/users/2fa673fd3c51401fbb6728a88499254a/roles/c39882b202e942479a7cdac2fc6da72c => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:37:37.338999 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d959e3b3-f4b0-4395-b883-75672b6080fd None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:37:37.339304 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d959e3b3-f4b0-4395-b883-75672b6080fd None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:37:37.339653 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d959e3b3-f4b0-4395-b883-75672b6080fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:37:37.365945 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-d959e3b3-f4b0-4395-b883-75672b6080fd None None] MFA Rules not processed for user `2fa673fd3c51401fbb6728a88499254a`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:37:37.367148 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-d959e3b3-f4b0-4395-b883-75672b6080fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:37:37.429101 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1419/2834] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 12:37:37 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:37:37.433476 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdce273-42e1-492d-92fe-82dd11f2344c admin admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:37:37.492948 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdce273-42e1-492d-92fe-82dd11f2344c admin admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:37:37.497520 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508ac895-a0b9-4a84-b814-72c82b5ed795 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:37:37.498165 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508ac895-a0b9-4a84-b814-72c82b5ed795 admin admin] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:37:37.498440 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508ac895-a0b9-4a84-b814-72c82b5ed795 admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:37:37.498707 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508ac895-a0b9-4a84-b814-72c82b5ed795 admin admin] PATH_INFO: `/v3/projects` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:37:37.499394 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508ac895-a0b9-4a84-b814-72c82b5ed795 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:37:37.501332 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508ac895-a0b9-4a84-b814-72c82b5ed795 admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:37:37.525999 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1416/2835] 10.222.0.44 () {60 vars in 1152 bytes} [Thu Jun 16 12:37:37 2022] POST /identity/v3/projects => generated 401 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 12:37:37.529974 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d959e3b3-f4b0-4395-b883-75672b6080fd None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:37:37.541267 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d959e3b3-f4b0-4395-b883-75672b6080fd None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:37:37.596217 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92fe689-1cb3-4b58-bcdd-efece806c1f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:37:37.596846 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92fe689-1cb3-4b58-bcdd-efece806c1f5 admin admin] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:37:37.597131 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92fe689-1cb3-4b58-bcdd-efece806c1f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:37:37.597407 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92fe689-1cb3-4b58-bcdd-efece806c1f5 admin admin] PATH_INFO: `/v3/users` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:37:37.598108 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92fe689-1cb3-4b58-bcdd-efece806c1f5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:37:37.600019 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92fe689-1cb3-4b58-bcdd-efece806c1f5 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:37:37.619700 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1420/2836] 10.222.0.44 () {60 vars in 1143 bytes} [Thu Jun 16 12:37:37 2022] POST /identity/v3/users => generated 307 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 12:37:37.623322 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508ac895-a0b9-4a84-b814-72c82b5ed795 admin admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:37:37.633318 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508ac895-a0b9-4a84-b814-72c82b5ed795 admin admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:37:37.637825 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a172f1ab-9b99-4bd7-87a0-9f6b0be71f18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:37:37.638471 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a172f1ab-9b99-4bd7-87a0-9f6b0be71f18 admin admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:37:37.639014 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a172f1ab-9b99-4bd7-87a0-9f6b0be71f18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:37:37.639282 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a172f1ab-9b99-4bd7-87a0-9f6b0be71f18 admin admin] PATH_INFO: `/v3/roles` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:37:37.639999 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a172f1ab-9b99-4bd7-87a0-9f6b0be71f18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:37:37.641600 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a172f1ab-9b99-4bd7-87a0-9f6b0be71f18 admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:37:37.652288 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1417/2837] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 12:37:37 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 12:37:37.656067 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92fe689-1cb3-4b58-bcdd-efece806c1f5 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:37:37.666509 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92fe689-1cb3-4b58-bcdd-efece806c1f5 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:37:37.671091 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d769ee-08a1-46cc-8325-87dccfcbf0c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:37:37.671951 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d769ee-08a1-46cc-8325-87dccfcbf0c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:37:37.672231 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d769ee-08a1-46cc-8325-87dccfcbf0c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:37:37.672506 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d769ee-08a1-46cc-8325-87dccfcbf0c3 admin admin] PATH_INFO: `/v3/projects/d3a913ea67e347f0af9cf2723bafa733/users/e9e0e1408ac74dcbad6d9755f870055f/roles/0688968254744e3f9913653cafea3091` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:37:37.686960 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d769ee-08a1-46cc-8325-87dccfcbf0c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d3a913ea67e347f0af9cf2723bafa733, user_id=e9e0e1408ac74dcbad6d9755f870055f, role_id=0688968254744e3f9913653cafea3091)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:37:37.689633 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d769ee-08a1-46cc-8325-87dccfcbf0c3 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:37:37.702075 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1421/2838] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 16 12:37:37 2022] PUT /identity/v3/projects/d3a913ea67e347f0af9cf2723bafa733/users/e9e0e1408ac74dcbad6d9755f870055f/roles/0688968254744e3f9913653cafea3091 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 12:37:37.706028 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a172f1ab-9b99-4bd7-87a0-9f6b0be71f18 admin admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:37:37.716196 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a172f1ab-9b99-4bd7-87a0-9f6b0be71f18 admin admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:37:37.720699 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:37:37.773239 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1658992d-4066-48e6-929e-6d41fef3eca5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:37:37.774435 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1658992d-4066-48e6-929e-6d41fef3eca5 admin admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:37:37.774716 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1658992d-4066-48e6-929e-6d41fef3eca5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:37:37.774989 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1658992d-4066-48e6-929e-6d41fef3eca5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:37:37.775697 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1658992d-4066-48e6-929e-6d41fef3eca5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:37:37.777304 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1658992d-4066-48e6-929e-6d41fef3eca5 admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:37:37.786677 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1418/2839] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 12:37:37 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 12:37:37.790810 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d769ee-08a1-46cc-8325-87dccfcbf0c3 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:37:37.800771 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d769ee-08a1-46cc-8325-87dccfcbf0c3 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:37:37.805280 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cda510-9e48-43d6-84ac-1efbfb54ab0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:37:37.806137 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cda510-9e48-43d6-84ac-1efbfb54ab0c admin admin] REQUEST_METHOD: `PUT` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:37:37.806413 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cda510-9e48-43d6-84ac-1efbfb54ab0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:37:37.806683 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cda510-9e48-43d6-84ac-1efbfb54ab0c admin admin] PATH_INFO: `/v3/projects/d3a913ea67e347f0af9cf2723bafa733/users/e9e0e1408ac74dcbad6d9755f870055f/roles/0688968254744e3f9913653cafea3091` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:37:37.808598 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cda510-9e48-43d6-84ac-1efbfb54ab0c admin admin] RBAC: Authorizing `identity:create_grant(project_id=d3a913ea67e347f0af9cf2723bafa733, user_id=e9e0e1408ac74dcbad6d9755f870055f, role_id=0688968254744e3f9913653cafea3091)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:37:37.811266 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cda510-9e48-43d6-84ac-1efbfb54ab0c admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:37:37.822091 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1422/2840] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 16 12:37:37 2022] PUT /identity/v3/projects/d3a913ea67e347f0af9cf2723bafa733/users/e9e0e1408ac74dcbad6d9755f870055f/roles/0688968254744e3f9913653cafea3091 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:37:37.832281 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2306e0d-ec94-4f70-ab17-854a353da303 None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:37:37.832809 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2306e0d-ec94-4f70-ab17-854a353da303 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:37:37.832945 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2306e0d-ec94-4f70-ab17-854a353da303 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:37:37.859036 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-a2306e0d-ec94-4f70-ab17-854a353da303 None None] MFA Rules not processed for user `e9e0e1408ac74dcbad6d9755f870055f`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:37:37.860172 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-a2306e0d-ec94-4f70-ab17-854a353da303 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:37:37.926065 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1419/2841] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 12:37:37 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:37:37.936532 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cda510-9e48-43d6-84ac-1efbfb54ab0c admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:37:37.938288 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-a5cda510-9e48-43d6-84ac-1efbfb54ab0c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:37:37.943581 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:37:37.996769 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cda510-9e48-43d6-84ac-1efbfb54ab0c admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:37:38.000577 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42ba76c-47f1-466b-bb9c-bf1e79323fb8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f96fc14ed89478c8a8c2f11c87511e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '601361df39e34fcca71175aa94e425c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:37:38.001241 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42ba76c-47f1-466b-bb9c-bf1e79323fb8 service cinder] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:37:38.001520 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42ba76c-47f1-466b-bb9c-bf1e79323fb8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:37:38.001790 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42ba76c-47f1-466b-bb9c-bf1e79323fb8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:37:38.011214 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42ba76c-47f1-466b-bb9c-bf1e79323fb8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:37:38.012630 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42ba76c-47f1-466b-bb9c-bf1e79323fb8 service cinder] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:37:38.022224 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1423/2842] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 12:37:37 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 12:37:38.092070 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2306e0d-ec94-4f70-ab17-854a353da303 None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:37:38.101656 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2306e0d-ec94-4f70-ab17-854a353da303 None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:37:38.105412 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aff85a2-5e2e-4a2f-b586-66e0d73a92b8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f96fc14ed89478c8a8c2f11c87511e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '601361df39e34fcca71175aa94e425c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:37:38.106053 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aff85a2-5e2e-4a2f-b586-66e0d73a92b8 service cinder] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:37:38.106334 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aff85a2-5e2e-4a2f-b586-66e0d73a92b8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:37:38.106607 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aff85a2-5e2e-4a2f-b586-66e0d73a92b8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:37:38.161953 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aff85a2-5e2e-4a2f-b586-66e0d73a92b8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:37:38.163302 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aff85a2-5e2e-4a2f-b586-66e0d73a92b8 service cinder] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:37:38.172380 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1420/2843] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 12:37:38 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 12:37:42.171485 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42ba76c-47f1-466b-bb9c-bf1e79323fb8 service cinder] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:37:42.231317 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42ba76c-47f1-466b-bb9c-bf1e79323fb8 service cinder] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:37:42.235785 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49294ade-558b-4074-9019-952c8917dd28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:37:42.236644 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49294ade-558b-4074-9019-952c8917dd28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:37:42.236941 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49294ade-558b-4074-9019-952c8917dd28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:37:42.237207 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49294ade-558b-4074-9019-952c8917dd28 admin admin] PATH_INFO: `/v3/users/2fa673fd3c51401fbb6728a88499254a` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:37:42.238375 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49294ade-558b-4074-9019-952c8917dd28 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2fa673fd3c51401fbb6728a88499254a)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:37:42.240276 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49294ade-558b-4074-9019-952c8917dd28 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:37:42.285686 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-49294ade-558b-4074-9019-952c8917dd28 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2fa673fd3c51401fbb6728a88499254a'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:37:42.286321 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-49294ade-558b-4074-9019-952c8917dd28 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2fa673fd3c51401fbb6728a88499254a'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:37:42.292978 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-49294ade-558b-4074-9019-952c8917dd28 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2fa673fd3c51401fbb6728a88499254a'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:37:42.293647 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-49294ade-558b-4074-9019-952c8917dd28 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2fa673fd3c51401fbb6728a88499254a'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:37:42.300974 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-49294ade-558b-4074-9019-952c8917dd28 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2fa673fd3c51401fbb6728a88499254a'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:37:42.317451 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1424/2844] 10.222.0.44 () {58 vars in 1223 bytes} [Thu Jun 16 12:37:42 2022] DELETE /identity/v3/users/2fa673fd3c51401fbb6728a88499254a => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:37:42.322523 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2052e6-4357-42f0-8112-1c981d4aa845 None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:37:42.323009 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2052e6-4357-42f0-8112-1c981d4aa845 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:37:42.323106 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2052e6-4357-42f0-8112-1c981d4aa845 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:37:42.340853 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-ba2052e6-4357-42f0-8112-1c981d4aa845 None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:37:42.342046 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-ba2052e6-4357-42f0-8112-1c981d4aa845 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:37:42.361313 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:37:42.400141 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1421/2845] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 12:37:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:37:42.409782 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49294ade-558b-4074-9019-952c8917dd28 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:37:42.411162 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-49294ade-558b-4074-9019-952c8917dd28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:37:42.438145 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:37:42.469197 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49294ade-558b-4074-9019-952c8917dd28 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:37:42.472816 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7020850-07ff-4cca-b7f4-25b253c86c56 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1094729b25a4be7b0b394998c9ca681', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '601361df39e34fcca71175aa94e425c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:37:42.473458 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7020850-07ff-4cca-b7f4-25b253c86c56 service neutron] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:37:42.473739 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7020850-07ff-4cca-b7f4-25b253c86c56 service neutron] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:37:42.474014 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7020850-07ff-4cca-b7f4-25b253c86c56 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:37:42.482936 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7020850-07ff-4cca-b7f4-25b253c86c56 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:37:42.484311 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7020850-07ff-4cca-b7f4-25b253c86c56 service neutron] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:37:42.493593 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1425/2846] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 12:37:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 12:37:42.767354 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2052e6-4357-42f0-8112-1c981d4aa845 None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:37:42.769242 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-ba2052e6-4357-42f0-8112-1c981d4aa845 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:37:42.781930 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2052e6-4357-42f0-8112-1c981d4aa845 None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:37:42.786826 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e3db81-0cb5-4bf0-a548-a7f4739a09f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:37:42.787720 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e3db81-0cb5-4bf0-a548-a7f4739a09f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:37:42.788003 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e3db81-0cb5-4bf0-a548-a7f4739a09f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:37:42.788279 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e3db81-0cb5-4bf0-a548-a7f4739a09f1 admin admin] PATH_INFO: `/v3/projects/32ab861c01f44736ab3d74e28d86e8ac` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:37:42.789521 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e3db81-0cb5-4bf0-a548-a7f4739a09f1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=32ab861c01f44736ab3d74e28d86e8ac)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:37:42.791425 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e3db81-0cb5-4bf0-a548-a7f4739a09f1 admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:37:42.838727 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-e4e3db81-0cb5-4bf0-a548-a7f4739a09f1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '32ab861c01f44736ab3d74e28d86e8ac', 'request_id': 'req-e4e3db81-0cb5-4bf0-a548-a7f4739a09f1'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:37:42.845734 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-e4e3db81-0cb5-4bf0-a548-a7f4739a09f1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '32ab861c01f44736ab3d74e28d86e8ac', 'request_id': 'req-e4e3db81-0cb5-4bf0-a548-a7f4739a09f1'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:37:42.851216 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-e4e3db81-0cb5-4bf0-a548-a7f4739a09f1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '32ab861c01f44736ab3d74e28d86e8ac', 'request_id': 'req-e4e3db81-0cb5-4bf0-a548-a7f4739a09f1'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:37:42.862082 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-e4e3db81-0cb5-4bf0-a548-a7f4739a09f1 admin admin] The token cache is being invalidate because project 32ab861c01f44736ab3d74e28d86e8ac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 12:37:42.862396 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-e4e3db81-0cb5-4bf0-a548-a7f4739a09f1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:37:42.863023 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-e4e3db81-0cb5-4bf0-a548-a7f4739a09f1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:37:42.864571 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1422/2847] 10.222.0.44 () {58 vars in 1232 bytes} [Thu Jun 16 12:37:42 2022] DELETE /identity/v3/projects/32ab861c01f44736ab3d74e28d86e8ac => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:37:42.869125 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7020850-07ff-4cca-b7f4-25b253c86c56 service neutron] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:37:42.878559 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7020850-07ff-4cca-b7f4-25b253c86c56 service neutron] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:37:42.934120 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d208042d-f6e4-4744-a9e7-1e5ac48f646e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:37:42.934993 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d208042d-f6e4-4744-a9e7-1e5ac48f646e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:37:42.935274 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d208042d-f6e4-4744-a9e7-1e5ac48f646e admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:37:42.935550 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d208042d-f6e4-4744-a9e7-1e5ac48f646e admin admin] PATH_INFO: `/v3/users/e9e0e1408ac74dcbad6d9755f870055f` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:37:42.936791 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d208042d-f6e4-4744-a9e7-1e5ac48f646e admin admin] RBAC: Authorizing `identity:delete_user(user_id=e9e0e1408ac74dcbad6d9755f870055f)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:37:42.938725 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d208042d-f6e4-4744-a9e7-1e5ac48f646e admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:37:42.983880 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-d208042d-f6e4-4744-a9e7-1e5ac48f646e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e9e0e1408ac74dcbad6d9755f870055f'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:37:42.984532 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-d208042d-f6e4-4744-a9e7-1e5ac48f646e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e9e0e1408ac74dcbad6d9755f870055f'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:37:42.991360 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-d208042d-f6e4-4744-a9e7-1e5ac48f646e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e9e0e1408ac74dcbad6d9755f870055f'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:37:42.991991 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-d208042d-f6e4-4744-a9e7-1e5ac48f646e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e9e0e1408ac74dcbad6d9755f870055f'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:37:42.999372 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-d208042d-f6e4-4744-a9e7-1e5ac48f646e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e9e0e1408ac74dcbad6d9755f870055f'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:37:43.016640 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1426/2848] 10.222.0.44 () {58 vars in 1223 bytes} [Thu Jun 16 12:37:42 2022] DELETE /identity/v3/users/e9e0e1408ac74dcbad6d9755f870055f => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:37:43.285602 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e3db81-0cb5-4bf0-a548-a7f4739a09f1 admin admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:37:43.287019 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-e4e3db81-0cb5-4bf0-a548-a7f4739a09f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:37:43.303761 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e3db81-0cb5-4bf0-a548-a7f4739a09f1 admin admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:37:43.362055 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9847371-a27e-4f83-960a-453c69283c65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:37:43.362919 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9847371-a27e-4f83-960a-453c69283c65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:37:43.363200 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9847371-a27e-4f83-960a-453c69283c65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:37:43.363475 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9847371-a27e-4f83-960a-453c69283c65 admin admin] PATH_INFO: `/v3/projects/d3a913ea67e347f0af9cf2723bafa733` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:37:43.364667 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9847371-a27e-4f83-960a-453c69283c65 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d3a913ea67e347f0af9cf2723bafa733)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:37:43.366609 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9847371-a27e-4f83-960a-453c69283c65 admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:37:43.419120 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-d9847371-a27e-4f83-960a-453c69283c65 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd3a913ea67e347f0af9cf2723bafa733', 'request_id': 'req-d9847371-a27e-4f83-960a-453c69283c65'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:37:43.421859 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:37:43.426931 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-d9847371-a27e-4f83-960a-453c69283c65 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd3a913ea67e347f0af9cf2723bafa733', 'request_id': 'req-d9847371-a27e-4f83-960a-453c69283c65'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:37:43.433025 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-d9847371-a27e-4f83-960a-453c69283c65 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd3a913ea67e347f0af9cf2723bafa733', 'request_id': 'req-d9847371-a27e-4f83-960a-453c69283c65'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:37:43.444074 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-d9847371-a27e-4f83-960a-453c69283c65 admin admin] The token cache is being invalidate because project d3a913ea67e347f0af9cf2723bafa733 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 12:37:43.444359 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-d9847371-a27e-4f83-960a-453c69283c65 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:37:43.445036 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-d9847371-a27e-4f83-960a-453c69283c65 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:37:43.446573 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1423/2849] 10.222.0.44 () {58 vars in 1232 bytes} [Thu Jun 16 12:37:43 2022] DELETE /identity/v3/projects/d3a913ea67e347f0af9cf2723bafa733 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:37:43.451477 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0e613d-b900-4c80-a95e-0106eefb46bb None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:37:43.451983 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0e613d-b900-4c80-a95e-0106eefb46bb None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:37:43.452096 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0e613d-b900-4c80-a95e-0106eefb46bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:37:43.471334 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-8e0e613d-b900-4c80-a95e-0106eefb46bb None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:37:43.472534 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-8e0e613d-b900-4c80-a95e-0106eefb46bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:37:43.514292 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:37:43.534257 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1427/2850] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 12:37:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:37:43.542948 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fcc3cd-57e4-4bc4-a385-3c5d9bd62dce None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:37:43.543239 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fcc3cd-57e4-4bc4-a385-3c5d9bd62dce None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:37:43.543518 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fcc3cd-57e4-4bc4-a385-3c5d9bd62dce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:37:43.563082 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-11fcc3cd-57e4-4bc4-a385-3c5d9bd62dce None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:37:43.564333 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-11fcc3cd-57e4-4bc4-a385-3c5d9bd62dce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:37:43.572258 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1424/2851] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 12:37:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:37:43.576599 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0e613d-b900-4c80-a95e-0106eefb46bb None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:37:43.586936 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0e613d-b900-4c80-a95e-0106eefb46bb None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:37:43.591425 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc460070-65d8-464a-a3ff-c1a72c4fce09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:37:43.592071 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc460070-65d8-464a-a3ff-c1a72c4fce09 admin admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:37:43.592346 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc460070-65d8-464a-a3ff-c1a72c4fce09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:37:43.592618 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc460070-65d8-464a-a3ff-c1a72c4fce09 admin admin] PATH_INFO: `/v3/domains` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:37:43.593364 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc460070-65d8-464a-a3ff-c1a72c4fce09 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:37:43.593784 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc460070-65d8-464a-a3ff-c1a72c4fce09 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:37:43.595548 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc460070-65d8-464a-a3ff-c1a72c4fce09 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:37:43.607559 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1428/2852] 10.222.0.44 () {58 vars in 1152 bytes} [Thu Jun 16 12:37:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:37:43.611801 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fcc3cd-57e4-4bc4-a385-3c5d9bd62dce None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:37:43.621471 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fcc3cd-57e4-4bc4-a385-3c5d9bd62dce None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:37:43.626128 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c461a9b-3f1f-4ee8-9c57-a56383ddab50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:37:43.626774 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c461a9b-3f1f-4ee8-9c57-a56383ddab50 admin admin] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:37:43.627061 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c461a9b-3f1f-4ee8-9c57-a56383ddab50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:37:43.627337 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c461a9b-3f1f-4ee8-9c57-a56383ddab50 admin admin] PATH_INFO: `/v3/projects` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:37:43.628023 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c461a9b-3f1f-4ee8-9c57-a56383ddab50 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:37:43.629963 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c461a9b-3f1f-4ee8-9c57-a56383ddab50 admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:37:43.656634 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1425/2853] 10.222.0.44 () {60 vars in 1152 bytes} [Thu Jun 16 12:37:43 2022] POST /identity/v3/projects => generated 383 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 12:37:43.660635 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc460070-65d8-464a-a3ff-c1a72c4fce09 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:37:43.675170 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc460070-65d8-464a-a3ff-c1a72c4fce09 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:37:43.732456 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cea252-7205-4100-8196-7d5481778d2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:37:43.733156 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cea252-7205-4100-8196-7d5481778d2e admin admin] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:37:43.733441 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cea252-7205-4100-8196-7d5481778d2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:37:43.733717 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cea252-7205-4100-8196-7d5481778d2e admin admin] PATH_INFO: `/v3/users` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:37:43.734403 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39cea252-7205-4100-8196-7d5481778d2e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:37:43.736336 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39cea252-7205-4100-8196-7d5481778d2e admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:37:43.756128 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1429/2854] 10.222.0.44 () {60 vars in 1143 bytes} [Thu Jun 16 12:37:43 2022] POST /identity/v3/users => generated 292 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 12:37:43.761186 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c461a9b-3f1f-4ee8-9c57-a56383ddab50 admin admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:37:43.772113 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c461a9b-3f1f-4ee8-9c57-a56383ddab50 admin admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:37:43.777460 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc4190f-5fb2-4407-8301-6421e598af46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:37:43.778117 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc4190f-5fb2-4407-8301-6421e598af46 admin admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:37:43.778402 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc4190f-5fb2-4407-8301-6421e598af46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:37:43.778677 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc4190f-5fb2-4407-8301-6421e598af46 admin admin] PATH_INFO: `/v3/roles` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:37:43.779406 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc4190f-5fb2-4407-8301-6421e598af46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:37:43.781032 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc4190f-5fb2-4407-8301-6421e598af46 admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:37:43.791605 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1426/2855] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 12:37:43 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 12:37:43.795876 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cea252-7205-4100-8196-7d5481778d2e admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:37:43.809415 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cea252-7205-4100-8196-7d5481778d2e admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:37:43.814033 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c712e3ae-d298-4a6f-b4f8-4c8150e4e5e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:37:43.814679 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c712e3ae-d298-4a6f-b4f8-4c8150e4e5e9 admin admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:37:43.815074 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c712e3ae-d298-4a6f-b4f8-4c8150e4e5e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:37:43.815260 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c712e3ae-d298-4a6f-b4f8-4c8150e4e5e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:37:43.815973 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c712e3ae-d298-4a6f-b4f8-4c8150e4e5e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:37:43.817593 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c712e3ae-d298-4a6f-b4f8-4c8150e4e5e9 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:37:43.831917 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1430/2856] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 12:37:43 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 12:37:43.836935 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc4190f-5fb2-4407-8301-6421e598af46 admin admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:37:43.846832 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc4190f-5fb2-4407-8301-6421e598af46 admin admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:37:43.851360 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abc0112-dcaa-4a34-9892-49882f871685 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:37:43.852486 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abc0112-dcaa-4a34-9892-49882f871685 admin admin] REQUEST_METHOD: `PUT` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:37:43.852775 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abc0112-dcaa-4a34-9892-49882f871685 admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:37:43.853062 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abc0112-dcaa-4a34-9892-49882f871685 admin admin] PATH_INFO: `/v3/projects/faaa8df6b88d476e981d988a97bad8e9/users/894c8e55bad84e3286eeea21cfa315da/roles/c39882b202e942479a7cdac2fc6da72c` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:37:43.867730 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abc0112-dcaa-4a34-9892-49882f871685 admin admin] RBAC: Authorizing `identity:create_grant(project_id=faaa8df6b88d476e981d988a97bad8e9, user_id=894c8e55bad84e3286eeea21cfa315da, role_id=c39882b202e942479a7cdac2fc6da72c)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:37:43.870377 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abc0112-dcaa-4a34-9892-49882f871685 admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:37:43.883615 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1427/2857] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 16 12:37:43 2022] PUT /identity/v3/projects/faaa8df6b88d476e981d988a97bad8e9/users/894c8e55bad84e3286eeea21cfa315da/roles/c39882b202e942479a7cdac2fc6da72c => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:37:43.894993 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5534a33d-8b52-4f3a-84c8-18c1db4fe04f None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:37:43.895282 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5534a33d-8b52-4f3a-84c8-18c1db4fe04f None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:37:43.895562 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5534a33d-8b52-4f3a-84c8-18c1db4fe04f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:37:43.925612 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-5534a33d-8b52-4f3a-84c8-18c1db4fe04f None None] MFA Rules not processed for user `894c8e55bad84e3286eeea21cfa315da`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:37:43.926827 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-5534a33d-8b52-4f3a-84c8-18c1db4fe04f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:37:43.991186 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1431/2858] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 12:37:43 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:37:43.995625 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abc0112-dcaa-4a34-9892-49882f871685 admin admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:37:44.056369 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abc0112-dcaa-4a34-9892-49882f871685 admin admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:37:44.061011 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e1d20a-ee0a-4ff0-81dd-b11633c6b472 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:37:44.061660 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e1d20a-ee0a-4ff0-81dd-b11633c6b472 admin admin] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:37:44.061943 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e1d20a-ee0a-4ff0-81dd-b11633c6b472 admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:37:44.062218 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e1d20a-ee0a-4ff0-81dd-b11633c6b472 admin admin] PATH_INFO: `/v3/projects` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:37:44.062921 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e1d20a-ee0a-4ff0-81dd-b11633c6b472 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:37:44.064843 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e1d20a-ee0a-4ff0-81dd-b11633c6b472 admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:37:44.093530 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1428/2859] 10.222.0.44 () {60 vars in 1152 bytes} [Thu Jun 16 12:37:43 2022] POST /identity/v3/projects => generated 381 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 12:37:44.097522 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5534a33d-8b52-4f3a-84c8-18c1db4fe04f None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:37:44.108180 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5534a33d-8b52-4f3a-84c8-18c1db4fe04f None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:37:44.147901 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:37:44.165151 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ea4ed0-36fa-49c4-a81c-83fcc40ecd80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:37:44.165820 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ea4ed0-36fa-49c4-a81c-83fcc40ecd80 admin admin] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:37:44.166100 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ea4ed0-36fa-49c4-a81c-83fcc40ecd80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:37:44.166374 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ea4ed0-36fa-49c4-a81c-83fcc40ecd80 admin admin] PATH_INFO: `/v3/users` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:37:44.167068 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ea4ed0-36fa-49c4-a81c-83fcc40ecd80 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:37:44.169062 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ea4ed0-36fa-49c4-a81c-83fcc40ecd80 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:37:44.187967 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1432/2860] 10.222.0.44 () {60 vars in 1143 bytes} [Thu Jun 16 12:37:44 2022] POST /identity/v3/users => generated 297 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 12:37:44.192050 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e1d20a-ee0a-4ff0-81dd-b11633c6b472 admin admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:37:44.203232 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e1d20a-ee0a-4ff0-81dd-b11633c6b472 admin admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:37:44.207847 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cb300e-3700-4abf-936d-4f054945326f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:37:44.208495 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cb300e-3700-4abf-936d-4f054945326f admin admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:37:44.208805 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cb300e-3700-4abf-936d-4f054945326f admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:37:44.209081 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cb300e-3700-4abf-936d-4f054945326f admin admin] PATH_INFO: `/v3/roles` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:37:44.209801 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cb300e-3700-4abf-936d-4f054945326f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:37:44.211378 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cb300e-3700-4abf-936d-4f054945326f admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:37:44.221586 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1429/2861] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 12:37:44 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 12:37:44.225503 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ea4ed0-36fa-49c4-a81c-83fcc40ecd80 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:37:44.235482 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ea4ed0-36fa-49c4-a81c-83fcc40ecd80 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:37:44.240074 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118fc9dc-878b-4b81-addb-11b43b801be9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:37:44.240982 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118fc9dc-878b-4b81-addb-11b43b801be9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:37:44.241261 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118fc9dc-878b-4b81-addb-11b43b801be9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:37:44.241539 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118fc9dc-878b-4b81-addb-11b43b801be9 admin admin] PATH_INFO: `/v3/projects/42cb95fa57c74e5fa9a25336f46cd8c9/users/1656db0b30844247a96b9bb2553ea089/roles/0688968254744e3f9913653cafea3091` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:37:44.256396 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118fc9dc-878b-4b81-addb-11b43b801be9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=42cb95fa57c74e5fa9a25336f46cd8c9, user_id=1656db0b30844247a96b9bb2553ea089, role_id=0688968254744e3f9913653cafea3091)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:37:44.259710 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118fc9dc-878b-4b81-addb-11b43b801be9 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:37:44.272419 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1433/2862] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 16 12:37:44 2022] PUT /identity/v3/projects/42cb95fa57c74e5fa9a25336f46cd8c9/users/1656db0b30844247a96b9bb2553ea089/roles/0688968254744e3f9913653cafea3091 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:37:44.276339 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cb300e-3700-4abf-936d-4f054945326f admin admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:37:44.286210 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cb300e-3700-4abf-936d-4f054945326f admin admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:37:44.332088 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:DELETE=3,keystone:SELECT=94,keystone:INSERT=3 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:37:44.343591 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c20d92e-899f-4676-985c-d47dc3574360 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:37:44.344272 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c20d92e-899f-4676-985c-d47dc3574360 admin admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:37:44.344556 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c20d92e-899f-4676-985c-d47dc3574360 admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:37:44.344861 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c20d92e-899f-4676-985c-d47dc3574360 admin admin] PATH_INFO: `/v3/roles` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:37:44.345589 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c20d92e-899f-4676-985c-d47dc3574360 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:37:44.347178 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c20d92e-899f-4676-985c-d47dc3574360 admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:37:44.356893 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1430/2863] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 12:37:44 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 12:37:44.361078 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118fc9dc-878b-4b81-addb-11b43b801be9 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:37:44.371707 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118fc9dc-878b-4b81-addb-11b43b801be9 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:37:44.376292 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9920610-d189-4b43-9ba8-bc08a40e5da1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:37:44.377201 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9920610-d189-4b43-9ba8-bc08a40e5da1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:37:44.377482 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9920610-d189-4b43-9ba8-bc08a40e5da1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:37:44.377757 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9920610-d189-4b43-9ba8-bc08a40e5da1 admin admin] PATH_INFO: `/v3/projects/42cb95fa57c74e5fa9a25336f46cd8c9/users/1656db0b30844247a96b9bb2553ea089/roles/0688968254744e3f9913653cafea3091` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:37:44.379727 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9920610-d189-4b43-9ba8-bc08a40e5da1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=42cb95fa57c74e5fa9a25336f46cd8c9, user_id=1656db0b30844247a96b9bb2553ea089, role_id=0688968254744e3f9913653cafea3091)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:37:44.382422 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9920610-d189-4b43-9ba8-bc08a40e5da1 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:37:44.393195 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1434/2864] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 16 12:37:44 2022] PUT /identity/v3/projects/42cb95fa57c74e5fa9a25336f46cd8c9/users/1656db0b30844247a96b9bb2553ea089/roles/0688968254744e3f9913653cafea3091 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 12:37:44.402840 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23929d3-233c-4a84-af44-89bca2d90ee0 None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:37:44.403305 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23929d3-233c-4a84-af44-89bca2d90ee0 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:37:44.403435 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23929d3-233c-4a84-af44-89bca2d90ee0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:37:44.430958 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-a23929d3-233c-4a84-af44-89bca2d90ee0 None None] MFA Rules not processed for user `1656db0b30844247a96b9bb2553ea089`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:37:44.432177 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-a23929d3-233c-4a84-af44-89bca2d90ee0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:37:44.498455 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1431/2865] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 12:37:44 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:37:44.509654 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9920610-d189-4b43-9ba8-bc08a40e5da1 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:37:44.511359 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-f9920610-d189-4b43-9ba8-bc08a40e5da1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:37:44.569754 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9920610-d189-4b43-9ba8-bc08a40e5da1 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:37:44.573406 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee79a521-e937-47d5-993c-ef30fb160b08 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f96fc14ed89478c8a8c2f11c87511e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '601361df39e34fcca71175aa94e425c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:37:44.574038 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee79a521-e937-47d5-993c-ef30fb160b08 service cinder] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:37:44.574314 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee79a521-e937-47d5-993c-ef30fb160b08 service cinder] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:37:44.574584 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee79a521-e937-47d5-993c-ef30fb160b08 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:37:44.583258 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee79a521-e937-47d5-993c-ef30fb160b08 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:37:44.584621 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee79a521-e937-47d5-993c-ef30fb160b08 service cinder] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:37:44.593923 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1435/2866] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 12:37:44 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 12:37:44.677667 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23929d3-233c-4a84-af44-89bca2d90ee0 None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:37:44.687956 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23929d3-233c-4a84-af44-89bca2d90ee0 None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:37:44.691580 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ada5d62-f325-4e69-b22b-5d882b3673bb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f96fc14ed89478c8a8c2f11c87511e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '601361df39e34fcca71175aa94e425c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:37:44.692215 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ada5d62-f325-4e69-b22b-5d882b3673bb service cinder] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:37:44.692499 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ada5d62-f325-4e69-b22b-5d882b3673bb service cinder] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:37:44.692801 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ada5d62-f325-4e69-b22b-5d882b3673bb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:37:44.748417 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ada5d62-f325-4e69-b22b-5d882b3673bb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:37:44.749891 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ada5d62-f325-4e69-b22b-5d882b3673bb service cinder] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:37:44.758712 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1432/2867] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 12:37:44 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 12:37:45.012086 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee79a521-e937-47d5-993c-ef30fb160b08 service cinder] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:37:45.073128 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee79a521-e937-47d5-993c-ef30fb160b08 service cinder] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:37:45.077769 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd24b03c-a159-407e-9032-ad89ac85fd77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:37:45.078665 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd24b03c-a159-407e-9032-ad89ac85fd77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:37:45.078945 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd24b03c-a159-407e-9032-ad89ac85fd77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:37:45.079219 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd24b03c-a159-407e-9032-ad89ac85fd77 admin admin] PATH_INFO: `/v3/users/894c8e55bad84e3286eeea21cfa315da` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:37:45.080428 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd24b03c-a159-407e-9032-ad89ac85fd77 admin admin] RBAC: Authorizing `identity:delete_user(user_id=894c8e55bad84e3286eeea21cfa315da)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:37:45.082398 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd24b03c-a159-407e-9032-ad89ac85fd77 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:37:45.123861 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=90,keystone:INSERT=5,keystone:DELETE=5 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:37:45.130799 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-cd24b03c-a159-407e-9032-ad89ac85fd77 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '894c8e55bad84e3286eeea21cfa315da'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:37:45.131562 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-cd24b03c-a159-407e-9032-ad89ac85fd77 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '894c8e55bad84e3286eeea21cfa315da'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:37:45.138861 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-cd24b03c-a159-407e-9032-ad89ac85fd77 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '894c8e55bad84e3286eeea21cfa315da'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:37:45.139482 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-cd24b03c-a159-407e-9032-ad89ac85fd77 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '894c8e55bad84e3286eeea21cfa315da'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:37:45.146390 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-cd24b03c-a159-407e-9032-ad89ac85fd77 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '894c8e55bad84e3286eeea21cfa315da'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:37:45.163676 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1436/2868] 10.222.0.44 () {58 vars in 1223 bytes} [Thu Jun 16 12:37:45 2022] DELETE /identity/v3/users/894c8e55bad84e3286eeea21cfa315da => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:37:45.168948 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad51574c-b577-4a4e-a520-42f841f7f763 None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:37:45.169238 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad51574c-b577-4a4e-a520-42f841f7f763 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:37:45.169516 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad51574c-b577-4a4e-a520-42f841f7f763 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:37:45.186969 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-ad51574c-b577-4a4e-a520-42f841f7f763 None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:37:45.188178 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-ad51574c-b577-4a4e-a520-42f841f7f763 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:37:45.251374 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1433/2869] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 12:37:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:37:45.261623 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd24b03c-a159-407e-9032-ad89ac85fd77 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:37:45.263014 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-cd24b03c-a159-407e-9032-ad89ac85fd77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:37:45.318356 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd24b03c-a159-407e-9032-ad89ac85fd77 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:37:45.322566 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b247764e-77a3-4940-8fd2-a27e4c5294d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1094729b25a4be7b0b394998c9ca681', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '601361df39e34fcca71175aa94e425c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:37:45.323182 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b247764e-77a3-4940-8fd2-a27e4c5294d3 service neutron] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:37:45.323456 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b247764e-77a3-4940-8fd2-a27e4c5294d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:37:45.323725 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b247764e-77a3-4940-8fd2-a27e4c5294d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:37:45.332863 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b247764e-77a3-4940-8fd2-a27e4c5294d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:37:45.334341 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b247764e-77a3-4940-8fd2-a27e4c5294d3 service neutron] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:37:45.344451 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1437/2870] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 12:37:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 12:37:45.606664 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad51574c-b577-4a4e-a520-42f841f7f763 None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:37:45.608116 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-ad51574c-b577-4a4e-a520-42f841f7f763 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:37:45.621303 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad51574c-b577-4a4e-a520-42f841f7f763 None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:37:45.626493 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1d0cd2-7cf1-4849-87d4-6a79497156e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:37:45.627356 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1d0cd2-7cf1-4849-87d4-6a79497156e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:37:45.627630 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1d0cd2-7cf1-4849-87d4-6a79497156e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:37:45.627897 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1d0cd2-7cf1-4849-87d4-6a79497156e3 admin admin] PATH_INFO: `/v3/projects/faaa8df6b88d476e981d988a97bad8e9` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:37:45.629113 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1d0cd2-7cf1-4849-87d4-6a79497156e3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=faaa8df6b88d476e981d988a97bad8e9)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:37:45.631010 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1d0cd2-7cf1-4849-87d4-6a79497156e3 admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:37:45.639526 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:37:45.679308 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-af1d0cd2-7cf1-4849-87d4-6a79497156e3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'faaa8df6b88d476e981d988a97bad8e9', 'request_id': 'req-af1d0cd2-7cf1-4849-87d4-6a79497156e3'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:37:45.686627 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-af1d0cd2-7cf1-4849-87d4-6a79497156e3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'faaa8df6b88d476e981d988a97bad8e9', 'request_id': 'req-af1d0cd2-7cf1-4849-87d4-6a79497156e3'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:37:45.691968 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-af1d0cd2-7cf1-4849-87d4-6a79497156e3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'faaa8df6b88d476e981d988a97bad8e9', 'request_id': 'req-af1d0cd2-7cf1-4849-87d4-6a79497156e3'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:37:45.703384 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-af1d0cd2-7cf1-4849-87d4-6a79497156e3 admin admin] The token cache is being invalidate because project faaa8df6b88d476e981d988a97bad8e9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 12:37:45.703669 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-af1d0cd2-7cf1-4849-87d4-6a79497156e3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:37:45.704294 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-af1d0cd2-7cf1-4849-87d4-6a79497156e3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:37:45.705850 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1434/2871] 10.222.0.44 () {58 vars in 1232 bytes} [Thu Jun 16 12:37:45 2022] DELETE /identity/v3/projects/faaa8df6b88d476e981d988a97bad8e9 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:37:45.709755 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b247764e-77a3-4940-8fd2-a27e4c5294d3 service neutron] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:37:45.719417 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b247764e-77a3-4940-8fd2-a27e4c5294d3 service neutron] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:37:45.777343 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d7f93b-1d13-486c-9d33-f667f2745d21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:37:45.778208 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d7f93b-1d13-486c-9d33-f667f2745d21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:37:45.778487 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d7f93b-1d13-486c-9d33-f667f2745d21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:37:45.778756 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d7f93b-1d13-486c-9d33-f667f2745d21 admin admin] PATH_INFO: `/v3/users/1656db0b30844247a96b9bb2553ea089` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:37:45.779920 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d7f93b-1d13-486c-9d33-f667f2745d21 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1656db0b30844247a96b9bb2553ea089)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:37:45.781886 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d7f93b-1d13-486c-9d33-f667f2745d21 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:37:45.826601 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-26d7f93b-1d13-486c-9d33-f667f2745d21 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1656db0b30844247a96b9bb2553ea089'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:37:45.827242 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-26d7f93b-1d13-486c-9d33-f667f2745d21 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1656db0b30844247a96b9bb2553ea089'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:37:45.833971 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-26d7f93b-1d13-486c-9d33-f667f2745d21 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1656db0b30844247a96b9bb2553ea089'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:37:45.834603 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-26d7f93b-1d13-486c-9d33-f667f2745d21 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1656db0b30844247a96b9bb2553ea089'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:37:45.838488 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:37:45.843448 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-26d7f93b-1d13-486c-9d33-f667f2745d21 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1656db0b30844247a96b9bb2553ea089'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:37:45.862456 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1438/2872] 10.222.0.44 () {58 vars in 1223 bytes} [Thu Jun 16 12:37:45 2022] DELETE /identity/v3/users/1656db0b30844247a96b9bb2553ea089 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:37:46.126402 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1d0cd2-7cf1-4849-87d4-6a79497156e3 admin admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:37:46.127932 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-af1d0cd2-7cf1-4849-87d4-6a79497156e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:37:46.142126 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1d0cd2-7cf1-4849-87d4-6a79497156e3 admin admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:37:46.201013 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d004beae-2e21-4391-88ac-debd5cf4a9a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:37:46.201868 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d004beae-2e21-4391-88ac-debd5cf4a9a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:37:46.202149 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d004beae-2e21-4391-88ac-debd5cf4a9a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:37:46.202420 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d004beae-2e21-4391-88ac-debd5cf4a9a0 admin admin] PATH_INFO: `/v3/projects/42cb95fa57c74e5fa9a25336f46cd8c9` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:37:46.203604 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d004beae-2e21-4391-88ac-debd5cf4a9a0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=42cb95fa57c74e5fa9a25336f46cd8c9)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:37:46.205575 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d004beae-2e21-4391-88ac-debd5cf4a9a0 admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:37:46.250865 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-d004beae-2e21-4391-88ac-debd5cf4a9a0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '42cb95fa57c74e5fa9a25336f46cd8c9', 'request_id': 'req-d004beae-2e21-4391-88ac-debd5cf4a9a0'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:37:46.258599 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-d004beae-2e21-4391-88ac-debd5cf4a9a0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '42cb95fa57c74e5fa9a25336f46cd8c9', 'request_id': 'req-d004beae-2e21-4391-88ac-debd5cf4a9a0'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:37:46.264469 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-d004beae-2e21-4391-88ac-debd5cf4a9a0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '42cb95fa57c74e5fa9a25336f46cd8c9', 'request_id': 'req-d004beae-2e21-4391-88ac-debd5cf4a9a0'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:37:46.275223 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-d004beae-2e21-4391-88ac-debd5cf4a9a0 admin admin] The token cache is being invalidate because project 42cb95fa57c74e5fa9a25336f46cd8c9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 12:37:46.275511 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-d004beae-2e21-4391-88ac-debd5cf4a9a0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:37:46.276146 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-d004beae-2e21-4391-88ac-debd5cf4a9a0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:37:46.277697 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1435/2873] 10.222.0.44 () {58 vars in 1232 bytes} [Thu Jun 16 12:37:46 2022] DELETE /identity/v3/projects/42cb95fa57c74e5fa9a25336f46cd8c9 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:37:46.283042 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8c2fc0-2cc6-4607-b317-ff33b0bed1ba None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:37:46.283328 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8c2fc0-2cc6-4607-b317-ff33b0bed1ba None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:37:46.283605 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8c2fc0-2cc6-4607-b317-ff33b0bed1ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:37:46.301166 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-9f8c2fc0-2cc6-4607-b317-ff33b0bed1ba None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:37:46.302365 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-9f8c2fc0-2cc6-4607-b317-ff33b0bed1ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:37:46.360111 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1439/2874] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 12:37:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:37:46.368580 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9f71b6-7723-4a17-bf0a-63f1fb9259e8 None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:37:46.368889 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9f71b6-7723-4a17-bf0a-63f1fb9259e8 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:37:46.369168 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9f71b6-7723-4a17-bf0a-63f1fb9259e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:37:46.386866 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-7c9f71b6-7723-4a17-bf0a-63f1fb9259e8 None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:37:46.388078 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-7c9f71b6-7723-4a17-bf0a-63f1fb9259e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:37:46.396342 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1436/2875] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 12:37:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 12:37:46.400960 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8c2fc0-2cc6-4607-b317-ff33b0bed1ba None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:37:46.410565 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8c2fc0-2cc6-4607-b317-ff33b0bed1ba None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:37:46.415684 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b88754-22e2-410f-ae8a-772c9d22cc39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:37:46.416321 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b88754-22e2-410f-ae8a-772c9d22cc39 admin admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:37:46.416982 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b88754-22e2-410f-ae8a-772c9d22cc39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:37:46.417255 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b88754-22e2-410f-ae8a-772c9d22cc39 admin admin] PATH_INFO: `/v3/domains` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:37:46.417969 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b88754-22e2-410f-ae8a-772c9d22cc39 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:37:46.418268 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b88754-22e2-410f-ae8a-772c9d22cc39 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:37:46.419852 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b88754-22e2-410f-ae8a-772c9d22cc39 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:37:46.431085 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1440/2876] 10.222.0.44 () {58 vars in 1152 bytes} [Thu Jun 16 12:37:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:37:46.435083 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9f71b6-7723-4a17-bf0a-63f1fb9259e8 None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:37:46.444079 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9f71b6-7723-4a17-bf0a-63f1fb9259e8 None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:37:46.448675 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d37e5c9-8993-4197-b828-ec5bd0f661a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:37:46.449349 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d37e5c9-8993-4197-b828-ec5bd0f661a8 admin admin] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:37:46.449635 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d37e5c9-8993-4197-b828-ec5bd0f661a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:37:46.449905 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d37e5c9-8993-4197-b828-ec5bd0f661a8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:37:46.450584 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d37e5c9-8993-4197-b828-ec5bd0f661a8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:37:46.452458 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d37e5c9-8993-4197-b828-ec5bd0f661a8 admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:37:46.466635 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:37:46.480226 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1437/2877] 10.222.0.44 () {60 vars in 1152 bytes} [Thu Jun 16 12:37:46 2022] POST /identity/v3/projects => generated 375 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 12:37:46.484307 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b88754-22e2-410f-ae8a-772c9d22cc39 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:37:46.494113 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b88754-22e2-410f-ae8a-772c9d22cc39 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:37:46.549811 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dce1305-73bb-4c9d-ad34-077dd746987c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:37:46.550409 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dce1305-73bb-4c9d-ad34-077dd746987c admin admin] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:37:46.550694 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dce1305-73bb-4c9d-ad34-077dd746987c admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:37:46.550972 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dce1305-73bb-4c9d-ad34-077dd746987c admin admin] PATH_INFO: `/v3/users` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:37:46.551670 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dce1305-73bb-4c9d-ad34-077dd746987c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:37:46.553643 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dce1305-73bb-4c9d-ad34-077dd746987c admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:37:46.572020 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1441/2878] 10.222.0.44 () {60 vars in 1143 bytes} [Thu Jun 16 12:37:46 2022] POST /identity/v3/users => generated 288 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 12:37:46.576057 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d37e5c9-8993-4197-b828-ec5bd0f661a8 admin admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:37:46.586952 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d37e5c9-8993-4197-b828-ec5bd0f661a8 admin admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:37:46.591597 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed70615-fb4c-493b-8bc1-685f3eb0734f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:37:46.592246 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed70615-fb4c-493b-8bc1-685f3eb0734f admin admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:37:46.592528 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed70615-fb4c-493b-8bc1-685f3eb0734f admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:37:46.592838 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed70615-fb4c-493b-8bc1-685f3eb0734f admin admin] PATH_INFO: `/v3/roles` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:37:46.593564 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed70615-fb4c-493b-8bc1-685f3eb0734f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:37:46.595159 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed70615-fb4c-493b-8bc1-685f3eb0734f admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:37:46.605916 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1438/2879] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 12:37:46 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 12:37:46.609549 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dce1305-73bb-4c9d-ad34-077dd746987c admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:37:46.619355 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dce1305-73bb-4c9d-ad34-077dd746987c admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:37:46.623931 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d80746-e856-4b17-8d53-53e7ed515464 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:37:46.624571 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d80746-e856-4b17-8d53-53e7ed515464 admin admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:37:46.624892 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d80746-e856-4b17-8d53-53e7ed515464 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:37:46.625169 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d80746-e856-4b17-8d53-53e7ed515464 admin admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:37:46.625883 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d80746-e856-4b17-8d53-53e7ed515464 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:37:46.627459 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d80746-e856-4b17-8d53-53e7ed515464 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:37:46.637176 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1442/2880] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 12:37:46 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 12:37:46.641285 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed70615-fb4c-493b-8bc1-685f3eb0734f admin admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:37:46.651378 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed70615-fb4c-493b-8bc1-685f3eb0734f admin admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:37:46.656172 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29cd18e-c367-43a0-a80c-d8f27f77abfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:37:46.657066 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29cd18e-c367-43a0-a80c-d8f27f77abfb admin admin] REQUEST_METHOD: `PUT` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:37:46.657341 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29cd18e-c367-43a0-a80c-d8f27f77abfb admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:37:46.657624 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29cd18e-c367-43a0-a80c-d8f27f77abfb admin admin] PATH_INFO: `/v3/projects/c2c3fc63a0e24cdb9f02ccd2b72b213d/users/6df4e5124c8242d7aa6a9b3959fbd722/roles/c39882b202e942479a7cdac2fc6da72c` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:37:46.672578 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29cd18e-c367-43a0-a80c-d8f27f77abfb admin admin] RBAC: Authorizing `identity:create_grant(project_id=c2c3fc63a0e24cdb9f02ccd2b72b213d, user_id=6df4e5124c8242d7aa6a9b3959fbd722, role_id=c39882b202e942479a7cdac2fc6da72c)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:37:46.675224 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29cd18e-c367-43a0-a80c-d8f27f77abfb admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:37:46.687730 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1439/2881] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 16 12:37:46 2022] PUT /identity/v3/projects/c2c3fc63a0e24cdb9f02ccd2b72b213d/users/6df4e5124c8242d7aa6a9b3959fbd722/roles/c39882b202e942479a7cdac2fc6da72c => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:37:46.747451 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1dee46-8c53-4a47-8e52-2776198c4d67 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:37:46.748041 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1dee46-8c53-4a47-8e52-2776198c4d67 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:37:46.748041 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1dee46-8c53-4a47-8e52-2776198c4d67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:37:46.775398 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-3a1dee46-8c53-4a47-8e52-2776198c4d67 None None] MFA Rules not processed for user `6df4e5124c8242d7aa6a9b3959fbd722`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:37:46.776598 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-3a1dee46-8c53-4a47-8e52-2776198c4d67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:37:46.808282 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:37:46.842904 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1443/2882] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 12:37:46 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:37:46.853817 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29cd18e-c367-43a0-a80c-d8f27f77abfb admin admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:37:46.855807 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-c29cd18e-c367-43a0-a80c-d8f27f77abfb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:37:46.912578 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29cd18e-c367-43a0-a80c-d8f27f77abfb admin admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:37:46.916269 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09ef7fe-c331-493f-859b-9c4b2cde4f46 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f96fc14ed89478c8a8c2f11c87511e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '601361df39e34fcca71175aa94e425c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:37:46.916949 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09ef7fe-c331-493f-859b-9c4b2cde4f46 service cinder] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:37:46.917235 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09ef7fe-c331-493f-859b-9c4b2cde4f46 service cinder] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:37:46.917513 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09ef7fe-c331-493f-859b-9c4b2cde4f46 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:37:46.926330 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09ef7fe-c331-493f-859b-9c4b2cde4f46 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:37:46.927766 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09ef7fe-c331-493f-859b-9c4b2cde4f46 service cinder] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:37:46.936666 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1440/2883] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 12:37:46 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 12:37:56.842538 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=12 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:37:56.932556 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=43,keystone:INSERT=1 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:37:58.191337 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1dee46-8c53-4a47-8e52-2776198c4d67 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:37:58.252346 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1dee46-8c53-4a47-8e52-2776198c4d67 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:37:58.256892 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5781fb9-8eee-4a1e-a148-eb2c04824657 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:37:58.257753 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5781fb9-8eee-4a1e-a148-eb2c04824657 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:37:58.258032 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5781fb9-8eee-4a1e-a148-eb2c04824657 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:37:58.258305 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5781fb9-8eee-4a1e-a148-eb2c04824657 admin admin] PATH_INFO: `/v3/users/6df4e5124c8242d7aa6a9b3959fbd722` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:37:58.259962 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5781fb9-8eee-4a1e-a148-eb2c04824657 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6df4e5124c8242d7aa6a9b3959fbd722)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:37:58.261906 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5781fb9-8eee-4a1e-a148-eb2c04824657 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:37:58.308283 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-b5781fb9-8eee-4a1e-a148-eb2c04824657 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6df4e5124c8242d7aa6a9b3959fbd722'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:37:58.309005 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-b5781fb9-8eee-4a1e-a148-eb2c04824657 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6df4e5124c8242d7aa6a9b3959fbd722'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:37:58.315850 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-b5781fb9-8eee-4a1e-a148-eb2c04824657 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6df4e5124c8242d7aa6a9b3959fbd722'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:37:58.316520 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-b5781fb9-8eee-4a1e-a148-eb2c04824657 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6df4e5124c8242d7aa6a9b3959fbd722'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:37:58.324545 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-b5781fb9-8eee-4a1e-a148-eb2c04824657 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6df4e5124c8242d7aa6a9b3959fbd722'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:37:58.341753 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1444/2884] 10.222.0.44 () {58 vars in 1223 bytes} [Thu Jun 16 12:37:58 2022] DELETE /identity/v3/users/6df4e5124c8242d7aa6a9b3959fbd722 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:37:58.346193 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a791d91-7b08-4b92-818f-7ee1e8588e52 None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:37:58.346653 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a791d91-7b08-4b92-818f-7ee1e8588e52 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:37:58.346783 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a791d91-7b08-4b92-818f-7ee1e8588e52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:37:58.363594 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-1a791d91-7b08-4b92-818f-7ee1e8588e52 None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:37:58.364807 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-1a791d91-7b08-4b92-818f-7ee1e8588e52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:37:58.422016 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1441/2885] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 12:37:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:37:58.432002 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5781fb9-8eee-4a1e-a148-eb2c04824657 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:37:58.433420 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-b5781fb9-8eee-4a1e-a148-eb2c04824657 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:37:58.488518 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5781fb9-8eee-4a1e-a148-eb2c04824657 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:37:58.492162 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6306305c-5d1c-4c64-98de-a1ebb6671a27 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1094729b25a4be7b0b394998c9ca681', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '601361df39e34fcca71175aa94e425c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:37:58.492818 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6306305c-5d1c-4c64-98de-a1ebb6671a27 service neutron] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:37:58.493101 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6306305c-5d1c-4c64-98de-a1ebb6671a27 service neutron] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:37:58.493373 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6306305c-5d1c-4c64-98de-a1ebb6671a27 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:37:58.503349 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6306305c-5d1c-4c64-98de-a1ebb6671a27 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:37:58.504841 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6306305c-5d1c-4c64-98de-a1ebb6671a27 service neutron] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:37:58.515283 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1445/2886] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 12:37:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 12:37:58.778354 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a791d91-7b08-4b92-818f-7ee1e8588e52 None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:37:58.779847 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-1a791d91-7b08-4b92-818f-7ee1e8588e52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:37:58.792673 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a791d91-7b08-4b92-818f-7ee1e8588e52 None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:37:58.798439 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d5def0-f95e-47df-bd99-c0be5899746b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:37:58.799304 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d5def0-f95e-47df-bd99-c0be5899746b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:37:58.799589 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d5def0-f95e-47df-bd99-c0be5899746b admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:37:58.799870 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d5def0-f95e-47df-bd99-c0be5899746b admin admin] PATH_INFO: `/v3/projects/c2c3fc63a0e24cdb9f02ccd2b72b213d` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:37:58.801100 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d5def0-f95e-47df-bd99-c0be5899746b admin admin] RBAC: Authorizing `identity:delete_project(project_id=c2c3fc63a0e24cdb9f02ccd2b72b213d)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:37:58.803061 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d5def0-f95e-47df-bd99-c0be5899746b admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:37:58.849475 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-37d5def0-f95e-47df-bd99-c0be5899746b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c2c3fc63a0e24cdb9f02ccd2b72b213d', 'request_id': 'req-37d5def0-f95e-47df-bd99-c0be5899746b'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:37:58.857131 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-37d5def0-f95e-47df-bd99-c0be5899746b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c2c3fc63a0e24cdb9f02ccd2b72b213d', 'request_id': 'req-37d5def0-f95e-47df-bd99-c0be5899746b'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:37:58.862789 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-37d5def0-f95e-47df-bd99-c0be5899746b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c2c3fc63a0e24cdb9f02ccd2b72b213d', 'request_id': 'req-37d5def0-f95e-47df-bd99-c0be5899746b'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:37:58.874314 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-37d5def0-f95e-47df-bd99-c0be5899746b admin admin] The token cache is being invalidate because project c2c3fc63a0e24cdb9f02ccd2b72b213d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 12:37:58.874605 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-37d5def0-f95e-47df-bd99-c0be5899746b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:37:58.875238 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-37d5def0-f95e-47df-bd99-c0be5899746b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:37:58.876795 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1442/2887] 10.222.0.44 () {58 vars in 1232 bytes} [Thu Jun 16 12:37:58 2022] DELETE /identity/v3/projects/c2c3fc63a0e24cdb9f02ccd2b72b213d => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:37:58.881623 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f90e4b9-d5d4-4a7b-b5ec-493add114062 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:37:58.881915 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f90e4b9-d5d4-4a7b-b5ec-493add114062 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:37:58.882196 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f90e4b9-d5d4-4a7b-b5ec-493add114062 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:37:58.899765 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-5f90e4b9-d5d4-4a7b-b5ec-493add114062 None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:37:58.901002 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-5f90e4b9-d5d4-4a7b-b5ec-493add114062 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:37:58.918209 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:37:58.962640 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1446/2888] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 12:37:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:37:58.970138 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609250c3-86d0-4483-996c-0318cf31387c None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:37:58.970493 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609250c3-86d0-4483-996c-0318cf31387c None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:37:58.970838 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609250c3-86d0-4483-996c-0318cf31387c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:37:58.989379 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-609250c3-86d0-4483-996c-0318cf31387c None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:37:58.990569 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-609250c3-86d0-4483-996c-0318cf31387c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:37:59.000419 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1443/2889] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 12:37:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:37:59.005250 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f90e4b9-d5d4-4a7b-b5ec-493add114062 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:37:59.016369 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f90e4b9-d5d4-4a7b-b5ec-493add114062 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:37:59.020937 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d6e24e-b283-4fff-8572-6c669c711197 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:37:59.021587 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d6e24e-b283-4fff-8572-6c669c711197 admin admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:37:59.021862 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d6e24e-b283-4fff-8572-6c669c711197 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:37:59.022135 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d6e24e-b283-4fff-8572-6c669c711197 admin admin] PATH_INFO: `/v3/domains` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:37:59.022850 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d6e24e-b283-4fff-8572-6c669c711197 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 12:37:59.023149 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d6e24e-b283-4fff-8572-6c669c711197 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:37:59.024726 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d6e24e-b283-4fff-8572-6c669c711197 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:37:59.036525 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1447/2890] 10.222.0.44 () {58 vars in 1152 bytes} [Thu Jun 16 12:37:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 12:37:59.041636 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609250c3-86d0-4483-996c-0318cf31387c None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:37:59.050964 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609250c3-86d0-4483-996c-0318cf31387c None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:37:59.055759 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04736fdc-c682-471d-8c31-fdf53091f02e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:37:59.056418 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04736fdc-c682-471d-8c31-fdf53091f02e admin admin] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:37:59.056710 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04736fdc-c682-471d-8c31-fdf53091f02e admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:37:59.057024 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04736fdc-c682-471d-8c31-fdf53091f02e admin admin] PATH_INFO: `/v3/projects` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:37:59.057731 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04736fdc-c682-471d-8c31-fdf53091f02e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:37:59.059627 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04736fdc-c682-471d-8c31-fdf53091f02e admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:37:59.084839 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1444/2891] 10.222.0.44 () {60 vars in 1152 bytes} [Thu Jun 16 12:37:59 2022] POST /identity/v3/projects => generated 371 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 12:37:59.089454 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d6e24e-b283-4fff-8572-6c669c711197 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:37:59.099162 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d6e24e-b283-4fff-8572-6c669c711197 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:37:59.154428 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710c97bb-faa3-4534-819b-729386c11685 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:37:59.155073 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710c97bb-faa3-4534-819b-729386c11685 admin admin] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:37:59.155350 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710c97bb-faa3-4534-819b-729386c11685 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:37:59.155621 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710c97bb-faa3-4534-819b-729386c11685 admin admin] PATH_INFO: `/v3/users` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:37:59.156285 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710c97bb-faa3-4534-819b-729386c11685 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:37:59.158202 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710c97bb-faa3-4534-819b-729386c11685 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:37:59.177877 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1448/2892] 10.222.0.44 () {60 vars in 1143 bytes} [Thu Jun 16 12:37:59 2022] POST /identity/v3/users => generated 286 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 12:37:59.182022 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04736fdc-c682-471d-8c31-fdf53091f02e admin admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:37:59.192225 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04736fdc-c682-471d-8c31-fdf53091f02e admin admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:37:59.196773 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e01f1b2-c406-49b4-a96c-e4b06eea1976 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:37:59.197445 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e01f1b2-c406-49b4-a96c-e4b06eea1976 admin admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:37:59.197726 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e01f1b2-c406-49b4-a96c-e4b06eea1976 admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:37:59.198002 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e01f1b2-c406-49b4-a96c-e4b06eea1976 admin admin] PATH_INFO: `/v3/roles` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:37:59.198725 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e01f1b2-c406-49b4-a96c-e4b06eea1976 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:37:59.200315 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e01f1b2-c406-49b4-a96c-e4b06eea1976 admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:37:59.210507 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1445/2893] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 12:37:59 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 12:37:59.214821 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710c97bb-faa3-4534-819b-729386c11685 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:37:59.224465 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710c97bb-faa3-4534-819b-729386c11685 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:37:59.229693 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5569380-0e1c-4099-891c-570806838c2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:37:59.230326 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5569380-0e1c-4099-891c-570806838c2d admin admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:37:59.230602 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5569380-0e1c-4099-891c-570806838c2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:37:59.230871 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5569380-0e1c-4099-891c-570806838c2d admin admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:37:59.231581 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5569380-0e1c-4099-891c-570806838c2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:37:59.233189 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5569380-0e1c-4099-891c-570806838c2d admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:37:59.242835 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1449/2894] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 12:37:59 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 12:37:59.246670 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e01f1b2-c406-49b4-a96c-e4b06eea1976 admin admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:37:59.256360 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e01f1b2-c406-49b4-a96c-e4b06eea1976 admin admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:37:59.261006 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffd88ca-6666-46cc-9098-d32e25f81e12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:37:59.261876 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffd88ca-6666-46cc-9098-d32e25f81e12 admin admin] REQUEST_METHOD: `PUT` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:37:59.262152 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffd88ca-6666-46cc-9098-d32e25f81e12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:37:59.262420 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffd88ca-6666-46cc-9098-d32e25f81e12 admin admin] PATH_INFO: `/v3/projects/b9de536c5c5c4a27ac7e4d7d020876bb/users/1e4e4703200c4cf696fd86d51af76121/roles/c39882b202e942479a7cdac2fc6da72c` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:37:59.277393 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffd88ca-6666-46cc-9098-d32e25f81e12 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9de536c5c5c4a27ac7e4d7d020876bb, user_id=1e4e4703200c4cf696fd86d51af76121, role_id=c39882b202e942479a7cdac2fc6da72c)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:37:59.280001 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffd88ca-6666-46cc-9098-d32e25f81e12 admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:37:59.293313 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1446/2895] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 16 12:37:59 2022] PUT /identity/v3/projects/b9de536c5c5c4a27ac7e4d7d020876bb/users/1e4e4703200c4cf696fd86d51af76121/roles/c39882b202e942479a7cdac2fc6da72c => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:37:59.298591 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8552cf1e-b94e-4bcb-a4a0-9cc50f919662 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:37:59.298881 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8552cf1e-b94e-4bcb-a4a0-9cc50f919662 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:37:59.299159 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8552cf1e-b94e-4bcb-a4a0-9cc50f919662 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:37:59.316492 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-8552cf1e-b94e-4bcb-a4a0-9cc50f919662 None None] MFA Rules not processed for user `63ec8f96a497486a9d373a6514f7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:37:59.317716 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-8552cf1e-b94e-4bcb-a4a0-9cc50f919662 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:37:59.374085 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1450/2896] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 12:37:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:37:59.383551 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffd88ca-6666-46cc-9098-d32e25f81e12 admin admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:37:59.385828 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-4ffd88ca-6666-46cc-9098-d32e25f81e12 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:37:59.407752 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:37:59.445047 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffd88ca-6666-46cc-9098-d32e25f81e12 admin admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:37:59.449383 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a181de72-e699-44bf-851f-7ecb741c4329 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1094729b25a4be7b0b394998c9ca681', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '601361df39e34fcca71175aa94e425c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:37:59.450042 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a181de72-e699-44bf-851f-7ecb741c4329 service neutron] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:37:59.450320 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a181de72-e699-44bf-851f-7ecb741c4329 service neutron] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:37:59.450616 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a181de72-e699-44bf-851f-7ecb741c4329 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:37:59.459633 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a181de72-e699-44bf-851f-7ecb741c4329 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:37:59.461088 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a181de72-e699-44bf-851f-7ecb741c4329 service neutron] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:37:59.471026 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1447/2897] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 12:37:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 12:38:00.050047 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6ff24a-c98e-43c4-8191-05f2689a4cae None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:38:00.050438 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6ff24a-c98e-43c4-8191-05f2689a4cae None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:38:00.050705 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6ff24a-c98e-43c4-8191-05f2689a4cae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:38:00.077868 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-4c6ff24a-c98e-43c4-8191-05f2689a4cae None None] MFA Rules not processed for user `1e4e4703200c4cf696fd86d51af76121`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:38:00.079082 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-4c6ff24a-c98e-43c4-8191-05f2689a4cae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:38:00.096910 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:38:00.157144 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1451/2898] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 12:38:00 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:38:00.167975 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a181de72-e699-44bf-851f-7ecb741c4329 service neutron] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:38:00.169406 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-a181de72-e699-44bf-851f-7ecb741c4329 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:38:00.227059 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a181de72-e699-44bf-851f-7ecb741c4329 service neutron] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:38:00.231167 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d0e7a0-b9f9-449f-bc16-78adca77bc4e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f96fc14ed89478c8a8c2f11c87511e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '601361df39e34fcca71175aa94e425c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:38:00.231811 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d0e7a0-b9f9-449f-bc16-78adca77bc4e service cinder] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:38:00.232091 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d0e7a0-b9f9-449f-bc16-78adca77bc4e service cinder] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:38:00.232362 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d0e7a0-b9f9-449f-bc16-78adca77bc4e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:38:00.240614 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d0e7a0-b9f9-449f-bc16-78adca77bc4e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:38:00.242026 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d0e7a0-b9f9-449f-bc16-78adca77bc4e service cinder] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:38:00.251415 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1448/2899] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 12:38:00 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 12:38:01.586985 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703aebe1-ddb4-4128-be2b-caa1995f0f53 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:38:01.587467 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703aebe1-ddb4-4128-be2b-caa1995f0f53 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:38:01.587583 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703aebe1-ddb4-4128-be2b-caa1995f0f53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:38:01.604489 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-703aebe1-ddb4-4128-be2b-caa1995f0f53 None None] MFA Rules not processed for user `1e4e4703200c4cf696fd86d51af76121`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:38:01.605711 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-703aebe1-ddb4-4128-be2b-caa1995f0f53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:38:01.612427 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1452/2900] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 12:38:01 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 26 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:38:01.840323 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d0e7a0-b9f9-449f-bc16-78adca77bc4e service cinder] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:38:01.849777 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d0e7a0-b9f9-449f-bc16-78adca77bc4e service cinder] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:38:01.853781 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d74aa4-437c-4019-8eb2-c9a3a6b0d7ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1094729b25a4be7b0b394998c9ca681', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '601361df39e34fcca71175aa94e425c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:38:01.854409 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d74aa4-437c-4019-8eb2-c9a3a6b0d7ea service neutron] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:38:01.854690 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d74aa4-437c-4019-8eb2-c9a3a6b0d7ea service neutron] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:38:01.854962 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d74aa4-437c-4019-8eb2-c9a3a6b0d7ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:38:01.856724 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-83d74aa4-437c-4019-8eb2-c9a3a6b0d7ea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:38:01.866004 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d74aa4-437c-4019-8eb2-c9a3a6b0d7ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:38:01.867419 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d74aa4-437c-4019-8eb2-c9a3a6b0d7ea service neutron] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:38:01.876016 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1449/2901] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 12:38:01 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 12:38:03.201553 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703aebe1-ddb4-4128-be2b-caa1995f0f53 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:38:03.202931 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-703aebe1-ddb4-4128-be2b-caa1995f0f53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:38:03.271674 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703aebe1-ddb4-4128-be2b-caa1995f0f53 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:38:03.279000 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5821c5-1ae7-492b-b440-8ad3336a793a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8bff8ccf460a403d993c39327bbcbd29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '601361df39e34fcca71175aa94e425c4', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:38:03.279647 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5821c5-1ae7-492b-b440-8ad3336a793a service placement] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:38:03.279924 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5821c5-1ae7-492b-b440-8ad3336a793a service placement] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:38:03.280194 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5821c5-1ae7-492b-b440-8ad3336a793a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:38:03.282121 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-7d5821c5-1ae7-492b-b440-8ad3336a793a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:38:03.294760 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5821c5-1ae7-492b-b440-8ad3336a793a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:38:03.296346 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5821c5-1ae7-492b-b440-8ad3336a793a service placement] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:38:03.307581 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1453/2902] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 12:38:03 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 12:38:07.862442 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d74aa4-437c-4019-8eb2-c9a3a6b0d7ea service neutron] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:38:07.871702 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d74aa4-437c-4019-8eb2-c9a3a6b0d7ea service neutron] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:38:07.875301 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed85585-cb5a-4b52-abce-d85ef050b228 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1094729b25a4be7b0b394998c9ca681', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '601361df39e34fcca71175aa94e425c4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:38:07.875933 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed85585-cb5a-4b52-abce-d85ef050b228 service neutron] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:38:07.876212 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed85585-cb5a-4b52-abce-d85ef050b228 service neutron] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:38:07.876479 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed85585-cb5a-4b52-abce-d85ef050b228 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:38:07.878252 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-bed85585-cb5a-4b52-abce-d85ef050b228 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:38:07.888380 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed85585-cb5a-4b52-abce-d85ef050b228 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:38:07.889865 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed85585-cb5a-4b52-abce-d85ef050b228 service neutron] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:38:07.898036 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1450/2903] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 12:38:07 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 12:38:08.743314 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5821c5-1ae7-492b-b440-8ad3336a793a service placement] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:38:08.745005 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-7d5821c5-1ae7-492b-b440-8ad3336a793a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:38:08.839572 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5821c5-1ae7-492b-b440-8ad3336a793a service placement] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:38:08.845593 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1843fb-71c8-43b5-b322-a97420c5863b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edfb12d445e74136b90800e93941f468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '601361df39e34fcca71175aa94e425c4', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:38:08.846227 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1843fb-71c8-43b5-b322-a97420c5863b service nova] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:38:08.846559 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1843fb-71c8-43b5-b322-a97420c5863b service nova] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:38:08.846823 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1843fb-71c8-43b5-b322-a97420c5863b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:38:08.848640 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-1e1843fb-71c8-43b5-b322-a97420c5863b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:38:08.862149 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1843fb-71c8-43b5-b322-a97420c5863b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:38:08.863753 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1843fb-71c8-43b5-b322-a97420c5863b service nova] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:38:08.875438 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1454/2904] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 12:38:08 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 12:38:12.621480 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed85585-cb5a-4b52-abce-d85ef050b228 service neutron] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:38:12.635625 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed85585-cb5a-4b52-abce-d85ef050b228 service neutron] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:38:12.641408 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcce2ff-bfe3-4aa7-a802-4c7a7b44b318 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edfb12d445e74136b90800e93941f468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '601361df39e34fcca71175aa94e425c4', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:38:12.642051 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcce2ff-bfe3-4aa7-a802-4c7a7b44b318 service nova] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:38:12.642331 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcce2ff-bfe3-4aa7-a802-4c7a7b44b318 service nova] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:38:12.642598 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcce2ff-bfe3-4aa7-a802-4c7a7b44b318 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:38:12.644368 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-bdcce2ff-bfe3-4aa7-a802-4c7a7b44b318 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:38:12.656931 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcce2ff-bfe3-4aa7-a802-4c7a7b44b318 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:38:12.658490 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcce2ff-bfe3-4aa7-a802-4c7a7b44b318 service nova] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:38:12.669608 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1451/2905] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 12:38:12 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 12:38:17.489665 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2afe2d-d388-449c-a386-03f820fc15b7 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:38:17.490203 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2afe2d-d388-449c-a386-03f820fc15b7 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:38:17.490203 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2afe2d-d388-449c-a386-03f820fc15b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:38:17.507139 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-3a2afe2d-d388-449c-a386-03f820fc15b7 None None] MFA Rules not processed for user `1e4e4703200c4cf696fd86d51af76121`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:38:17.508368 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-3a2afe2d-d388-449c-a386-03f820fc15b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:38:17.515772 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1455/2906] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 12:38:17 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:38:22.664439 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=61 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:38:27.502424 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=91 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:38:30.478124 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507f8e5c-9b6f-444c-bf77-ccf62de26e5c None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:38:30.478596 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507f8e5c-9b6f-444c-bf77-ccf62de26e5c None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:38:30.478702 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507f8e5c-9b6f-444c-bf77-ccf62de26e5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:38:30.497434 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-507f8e5c-9b6f-444c-bf77-ccf62de26e5c None None] MFA Rules not processed for user `222b53cae3d64412b9b0a89d162311f4`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:38:30.498619 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-507f8e5c-9b6f-444c-bf77-ccf62de26e5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:38:30.550674 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1452/2907] 10.222.0.44 () {58 vars in 1009 bytes} [Thu Jun 16 12:38:30 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:38:30.595432 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2afe2d-d388-449c-a386-03f820fc15b7 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:38:30.596876 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-3a2afe2d-d388-449c-a386-03f820fc15b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:38:30.664496 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2afe2d-d388-449c-a386-03f820fc15b7 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:38:30.670253 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8f366a-aead-4cb8-b688-868254b8d8ae service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c159f79c1921496487101aac5d530ae5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '601361df39e34fcca71175aa94e425c4', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:38:30.670899 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8f366a-aead-4cb8-b688-868254b8d8ae service swift] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:38:30.671179 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8f366a-aead-4cb8-b688-868254b8d8ae service swift] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:38:30.671450 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8f366a-aead-4cb8-b688-868254b8d8ae service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:38:30.679972 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8f366a-aead-4cb8-b688-868254b8d8ae service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:38:30.681551 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8f366a-aead-4cb8-b688-868254b8d8ae service swift] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:38:30.690062 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1456/2908] 10.222.0.44 () {60 vars in 1384 bytes} [Thu Jun 16 12:38:30 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 16 12:38:40.544289 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=25 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:38:40.686931 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=32 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:38:45.246885 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbff4ea-eb91-417e-a51a-d826e3d0f00b None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:38:45.247357 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbff4ea-eb91-417e-a51a-d826e3d0f00b None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:38:45.247458 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbff4ea-eb91-417e-a51a-d826e3d0f00b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:38:45.265185 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-8fbff4ea-eb91-417e-a51a-d826e3d0f00b None None] MFA Rules not processed for user `222b53cae3d64412b9b0a89d162311f4`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 12:38:45.266381 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-8fbff4ea-eb91-417e-a51a-d826e3d0f00b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:38:45.273507 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1453/2909] 10.222.0.44 () {58 vars in 967 bytes} [Thu Jun 16 12:38:45 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 12:38:45.285327 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8f366a-aead-4cb8-b688-868254b8d8ae service swift] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:38:45.296188 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8f366a-aead-4cb8-b688-868254b8d8ae service swift] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:38:45.301377 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ed20cb-1331-44e3-aed8-345abd2c3650 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c159f79c1921496487101aac5d530ae5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '601361df39e34fcca71175aa94e425c4', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:38:45.302037 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ed20cb-1331-44e3-aed8-345abd2c3650 service swift] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:38:45.302317 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ed20cb-1331-44e3-aed8-345abd2c3650 service swift] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:38:45.302617 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ed20cb-1331-44e3-aed8-345abd2c3650 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:38:45.311420 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ed20cb-1331-44e3-aed8-345abd2c3650 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:38:45.313039 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ed20cb-1331-44e3-aed8-345abd2c3650 service swift] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:38:45.321057 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1457/2910] 10.222.0.44 () {60 vars in 1384 bytes} [Thu Jun 16 12:38:45 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 16 12:38:47.591268 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbff4ea-eb91-417e-a51a-d826e3d0f00b None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:38:47.603794 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbff4ea-eb91-417e-a51a-d826e3d0f00b None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:38:47.608645 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0992c671-df8d-4812-99cb-83ee3c208461 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8bff8ccf460a403d993c39327bbcbd29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '601361df39e34fcca71175aa94e425c4', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:38:47.609410 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0992c671-df8d-4812-99cb-83ee3c208461 service placement] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:38:47.609693 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0992c671-df8d-4812-99cb-83ee3c208461 service placement] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:38:47.609965 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0992c671-df8d-4812-99cb-83ee3c208461 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:38:47.611728 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-0992c671-df8d-4812-99cb-83ee3c208461 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:38:47.624146 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0992c671-df8d-4812-99cb-83ee3c208461 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:38:47.625759 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0992c671-df8d-4812-99cb-83ee3c208461 service placement] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:38:47.637872 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1454/2911] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 12:38:47 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 12:38:47.641888 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ed20cb-1331-44e3-aed8-345abd2c3650 service swift] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:38:47.652668 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ed20cb-1331-44e3-aed8-345abd2c3650 service swift] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:38:47.657603 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bf9c88-cfa6-4167-9330-56f83f1d6aa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:38:47.658635 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bf9c88-cfa6-4167-9330-56f83f1d6aa3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:38:47.658983 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bf9c88-cfa6-4167-9330-56f83f1d6aa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:38:47.659327 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bf9c88-cfa6-4167-9330-56f83f1d6aa3 admin admin] PATH_INFO: `/v3/users/1e4e4703200c4cf696fd86d51af76121` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:38:47.660604 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bf9c88-cfa6-4167-9330-56f83f1d6aa3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1e4e4703200c4cf696fd86d51af76121)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:38:47.662718 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bf9c88-cfa6-4167-9330-56f83f1d6aa3 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:38:47.709309 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-45bf9c88-cfa6-4167-9330-56f83f1d6aa3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1e4e4703200c4cf696fd86d51af76121'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:38:47.709951 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-45bf9c88-cfa6-4167-9330-56f83f1d6aa3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1e4e4703200c4cf696fd86d51af76121'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:38:47.717224 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-45bf9c88-cfa6-4167-9330-56f83f1d6aa3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1e4e4703200c4cf696fd86d51af76121'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:38:47.717847 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-45bf9c88-cfa6-4167-9330-56f83f1d6aa3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1e4e4703200c4cf696fd86d51af76121'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:38:47.724959 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-45bf9c88-cfa6-4167-9330-56f83f1d6aa3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1e4e4703200c4cf696fd86d51af76121'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:38:47.742897 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1458/2912] 10.222.0.44 () {58 vars in 1223 bytes} [Thu Jun 16 12:38:47 2022] DELETE /identity/v3/users/1e4e4703200c4cf696fd86d51af76121 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:38:47.913548 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0992c671-df8d-4812-99cb-83ee3c208461 service placement] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:38:47.928985 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0992c671-df8d-4812-99cb-83ee3c208461 service placement] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:38:47.994096 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124772f2-1664-475f-80c8-43983b9c7be5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ec8f96a497486a9d373a6514f7d0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '487834c5a8184e199d372be1da9a9d39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:38:47.994955 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124772f2-1664-475f-80c8-43983b9c7be5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:38:47.995239 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124772f2-1664-475f-80c8-43983b9c7be5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:38:47.995508 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124772f2-1664-475f-80c8-43983b9c7be5 admin admin] PATH_INFO: `/v3/projects/b9de536c5c5c4a27ac7e4d7d020876bb` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:38:47.996704 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124772f2-1664-475f-80c8-43983b9c7be5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b9de536c5c5c4a27ac7e4d7d020876bb)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:38:47.998710 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124772f2-1664-475f-80c8-43983b9c7be5 admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:38:48.044266 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-124772f2-1664-475f-80c8-43983b9c7be5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b9de536c5c5c4a27ac7e4d7d020876bb', 'request_id': 'req-124772f2-1664-475f-80c8-43983b9c7be5'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:38:48.051323 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-124772f2-1664-475f-80c8-43983b9c7be5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b9de536c5c5c4a27ac7e4d7d020876bb', 'request_id': 'req-124772f2-1664-475f-80c8-43983b9c7be5'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:38:48.056883 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-124772f2-1664-475f-80c8-43983b9c7be5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b9de536c5c5c4a27ac7e4d7d020876bb', 'request_id': 'req-124772f2-1664-475f-80c8-43983b9c7be5'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:38:48.079686 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-124772f2-1664-475f-80c8-43983b9c7be5 admin admin] The token cache is being invalidate because project b9de536c5c5c4a27ac7e4d7d020876bb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 12:38:48.079970 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-124772f2-1664-475f-80c8-43983b9c7be5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:38:48.080603 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-124772f2-1664-475f-80c8-43983b9c7be5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 12:38:48.082157 dv-cinder-846149-2-smb devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1455/2913] 10.222.0.44 () {58 vars in 1232 bytes} [Thu Jun 16 12:38:47 2022] DELETE /identity/v3/projects/b9de536c5c5c4a27ac7e4d7d020876bb => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 12:38:57.739306 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=35,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:38:58.077503 dv-cinder-846149-2-smb devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=68,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 12:41:00.837043 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bf9c88-cfa6-4167-9330-56f83f1d6aa3 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 12:41:00.838547 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-45bf9c88-cfa6-4167-9330-56f83f1d6aa3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:41:00.976886 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bf9c88-cfa6-4167-9330-56f83f1d6aa3 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 12:41:01.032962 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246009ca-093e-4819-a039-725e53cc52f7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8bff8ccf460a403d993c39327bbcbd29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '601361df39e34fcca71175aa94e425c4', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 12:41:01.033566 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246009ca-093e-4819-a039-725e53cc52f7 service placement] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 12:41:01.033841 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246009ca-093e-4819-a039-725e53cc52f7 service placement] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 12:41:01.034112 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246009ca-093e-4819-a039-725e53cc52f7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 12:41:01.035865 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-246009ca-093e-4819-a039-725e53cc52f7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 12:41:01.047548 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246009ca-093e-4819-a039-725e53cc52f7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 12:41:01.049165 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246009ca-093e-4819-a039-725e53cc52f7 service placement] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 12:41:01.059082 dv-cinder-846149-2-smb devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1459/2914] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 12:41:00 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 12:41:11.054825 dv-cinder-846149-2-smb devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=89 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}